How to keep Y-Axis inverted consistent between Mouse Aim and Mouse Joystick

Basically everything works fine with mouse aim. However as soon as I switch control modes the mouse inversion is no longer applied. If I toggle off the setting, then the opposite happens; mouse joystick is inverted but mouse aim no longer is. Is there no way of having mouse inversion be consistent with all control modes?