Hi guys,
In case this helps someone. After installing rust-analyzer extension for vscode, I was not getting the test explorer. Turns out there is a setting in the vscode Settings->Extensions->Rust-analyzer->tick the "Test Explorer" (Whether to show test explorer). Your tests wil be automatically be collected and available in the test explorer icon in Activity Bar. Now you can run and debug them!
Thanks