Dynamically decode protobuf possible?

Busy with implementing protobuf support for the Confluent schema registry. The path when you already created the rust code from the proto files is clear. Although I really don't know if I should support protobuf , prost or both? But there doesn't seem to be a way to create structured data form just the proto file and the bytes dynamically?

There are some issues on Prost’s tracker regarding this, like this and this, but as far as I know there’s nothing concrete yet.

protofish seems to provide this functionality? I remember there being others, but that seemed the most prominent dynamic one when searching for protocol buffer crates (https://crates.io/search?q=protocol%20buffers).

Awesome, seems exactly what I was looking for.

Also decided to restructure my library, so that the real convertions move to the edge, and are easier to change. Putting them as features.

Thanks a lot.

1 Like

I didn’t know about protofish. It’ll be useful!

1 Like

Just a small, to let you now it worked out, https://github.com/gklijs/schema_registry_converter/blob/master/src/proto_decoder.rs.
It will be part of the Kafka Summit talk about using Protobuf and Rust together with the Confluent Schema Registry (it's the 25th of August).

This topic was automatically closed 90 days after the last reply. We invite you to open a new topic if you have further questions or comments.