How to change control types easily?

I’m on Xbox and I use pointer aim on controller, when I want to do maneuvers I toggle my control mode to full but then I have to spend a minute setting up the controls for it, and then when I switch back to mouse aim it doesn’t work and have to reset the controls. Am I able to swap easily and keep controls?

I do not know if the menu looks the same for you, but:

You want to set “Toggle Control Mode.” It cycles through the various modes.