Is isize always pointer sized?

Are isize and usize guaranteed to be the same byte width as pointers? Or is there a possibility they can differ? E.g. when pointer widths are larger than than the addressable memory.

Here is the current stance of the Unsafe Code Guidelines Reference: