I think the closest concept for sharing precompiled dependencies between packages on your computer are workspaces. I'm not aware of a way to tell cargo to use precompiled artefacts from somewhere else but the local build cache.
Edit: the second resource I posted actually contains a link to the tool you need: sccache
All of your dependencies already have their directory inside .cargo/registry in your home dir.
They're not arranged the way you would like for two reasons:
there can be multiple incompatible versions of the same dependency, and Cargo makes sure different versions don't get mixed up.
dependencies are supposed to be immutable. Having them in some easily accessible directory could tempt users to modify their code, which would make it difficult to build their Rust projects on another machine.
That's actually impossible to do. Cargo verifies at build time that the hash of locally cached dependencies matches the expected one. I think a mismatch results in a build error, but my memory is hazy.
For performance reasons, it doesn't do that inside the .cargo dir after the crate has been unpacked. If you modify code in there, it won't invalidate caches in target/, so the changes may not get noticed until a clean build.