OK, I understand now, it seems like mechanical problem and magnet first moves to the opposite direction (maybe gimbal or magnet fitting ... hard to say...) Try to increase filtering and DZ center on both axes. Watch the change.