My Canvas Layer affects my camera

My camera is mouse based for my 3D project. I have two canvas layers, one for a 1st person gun in the center bottom, another for the UI, with cross hair and health bar. When it’s just the Gun visible, I can move freely, however the UI node locks the camera in place if it is visible. I want to keep the health bar and cross hair but it just doesn’t feel like an option with this issue. Any ideas?