Build from actual source

Let's be realistic here. The Rust compiler is almost a million lines of code. It depends on LLVM, which is an order of magnitude larger. The compiler is constantly changing, you'd have to audit every intermediate version. There is zero chance that you're going to audit that in any meaningful way, it's just a bureaucratic requirement.