If your Debug implementations are not used somewhere, then they will not be included in the binary. So, if deleting them does not cause a compilation error, then they would have been discarded automatically anyway.
Whether you derive or impl the trait, and whether the trait is Display or Debug, doesn't make any difference to this principle.