Is disabling features of a dependency considered a breaking change?

Code is only allowed to depend on other code it explicitly declares as a dependency. If some code uses a feature of a crate without declaring that feature, because "a 3rd party will enable the feature anyways", then that code is broken. So no, you don't need to care about it, and this isn't a breaking change.