Rust crate closest to Apache Spark?

#1

What Rust crate (or group of crates) gets us closest to Apache Spark ?

The reason I am not giving up Spark directly is that I am unwilling to give up RAII and I really like Rust.

However, I need a way where I am programming an AWS cluster rather than programming a single machine.

What Rust crate (of group of crates) gets us closest to this ?

#2

Consider perhaps Amadeus with Constellation.

3 Likes
#3

There is also Ballista. It is built on top of the Arrow format, and thus leverages SIMD operations, memory alignment, and interoperability with other Arrow implementations.

More details here

3 Likes