Scraping ajax/spa with Rust

[zicklag]

@d4h0

It seems, unfortunately, that headless_chrome isn't maintained at the moment. Pull requests weren't merged for some time, and headless_chrome still uses failure for error handling, which makes it difficult to use with the current way to handle errors.

Yeah, I just noticed that as I just started to try it out as an experimental Tauri backend to hack in Windows support until they get that nailed down.

@d4h0

For a few months now, I'm working on a new DevTools protocol client for Rust. I'm generating my DevTools protocol API automatically from the official protocol definition, so all DevTools protocol functionality will be available from the beginning (headless_chrome implements this API by hand, but only partially).

Ooh, that sounds cool. I'd love to hear about that when it comes out.

@d4h0

There is also Fantoccini which uses WebDriver instead of the DevTools protocol.

Yeah, it seems that web driver is a bit less featured.