I didn't pursue this much further.
What I meant to do was start my test in a thread and kill it after a certain time.
In that thread we pointed out how to kill a thread, though I never actually tried it at home 
It would be cool if this was a feature of Rusts testing functionality though.