Much love to the Rust community. Thank you for the 65+ contributors from this community to Fluvio Open Source. Bookmark or Star the repo and check us out if you are new.
This announcement been 3 years in the making to build out a pretty big project. This is for all of the builders of AI / ML / User facing analytics applications.
For those who are seeing it for the first time, the first committers to the Fluvio codebase wanted to create a Rust based distributed streaming runtime instead of using Apache Kafka. They had experienced Kafka at scale while leading the service mesh infrastructure at NginX. The project started in 2019.
In 2021 the team got to a point where our distributed streaming system needed an unbounded stateful stream processing framework and we embarked on that journey with the web assembly component model.
After 14 developer preview releases we launched our beta a couple of weeks back.
We are building the Stateful DataFlow experience to be similar to Ruby on Rails for building data pipelines.
The first cohort of builders using Fluvio and Stateful DataFlow, have built end to end data pipelines to power predictive analytics and real-time AI applications in IoT, fintech, health-tech, and ecommerce.
You can start in our documentation: SDF Architecture
We are stoked to have the awesome rust community try Stateful DataFlows on Fluvio and inspire us to build the ultimate distributed streaming system in rust.