Parallel Streaming with Kafka and Redis

help
1

Hi Guys,

I'm trying to build the Yahoo Streaming Benchmarks (https://github.com/yahoo/streaming-benchmarks) in Rust. I wanted to use Tokio.

  • What do you recommend, what I should learn first and how to go about it?

I started building a kafka consumer in Rust with this library: https://github.com/spicavigo/kafka-rust.

I am writing my bachelor thesis and have to use Rust for it. I'm quite a newbie to Rust and my programming skills overall are mediocre. I did a lot mathematic Python algorithms before. Now i learned some basics of Rust but i'm struggling about how i should proceed.

Cheers

2

@Adrivo

  1. Is tokio-kafka even active ? Last commit is from 2018.
  2. Check rdkafka - Rust which supports streaming
  3. Not entirely sure what your goal is. From the brief glance at Yahoo Straming Benchmarks it seems that Spark/Storm/Flink read data from Kafka Broker and write results to Redis. The data generator that puts data on appropriate Kafka topic is written in Clojure. Is your objective to re-write the generator ? Or something else.
3

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.