Manual install problems with finding crate std

For reasons, I can't install Rust the canonical way on the remote computer (Ubuntu) I'm using and had to add rustc and cargo paths to my PATH env. I'm using a standalone installation from Other Installation Methods - Rust Forge which I've downloaded and extracted.

When running cargo build, I get the following error:

error[E0463]: can't find crate for `std`

error: aborting due to previous error

I don't get this problem on my local environment (MacOS)