Some encoders share one pin of each left/right button with one pin of the push button, so wire this button in other line/column can cause error. Check in encoder datasheet how is.