I'm only aware of a single vectored exception handler being installed. The one for invalid memory accesses. This one is used to show a nice message in case of a stack overflow. The only options to not have it get registered are either modifying the standard library source or bypassing libstd's main wrapper using something like:
Which unwind code exactly? There shouldn't be any for your own code with panic=abort and also none for the standard library if you use -Zbuild-std (even without -Zbuild-std-features=panic_immediate_abort).