JSON parser which picks up values directly without performing tokenization in Rust


#1

I released pikkr, which is a new kind of JSON parser in Rust.

This JSON parser is implemented based on Y. Li, N. R. Katsipoulakis, B. Chandramouli, J. Goldstein, and D. Kossmann. Mison: a fast JSON parser for data analytics. In VLDB, 2017.

It picks up values directly from a JSON record using SIMD instructions and learning JSON structure pattern without performing tokenization.

Here is the summary of benchmark:

Please visit the pikkr GitHub repository for the details.

This crate is very new and immature, so there might be a lot of things to be improved.

Comments, suggestions, questions, contributions, etc. are welcomed.

Thanks.


#2

Impressive! This is going to be hard to beat.

…until one day Intel includes a JSON parsing instruction in their CPUs. :laughing:


#3

Is the name based on python’s pickle module?