Some encoders share one pin of each left/right button with one pin of the push button, so wire this button in other line/column can cause error. Check in encoder datasheet how is.
I have PEC11R's like available at ADAFRUIT and many other places , the Encoder side is separate from the Push button side on those and allows a separate momentary switch.