Make sure your have set a reasonable deadzone when assigning your control axis
Sometimes, joystick axis aren't perfectly centered back to zero when released. This results in the view moving continuously.
You can set the Dead Zone when assigning your control axis in ChasePlane > Preferences > Control Assignments.