Fast forwarding

Sometimes when I fast forward, usually two presses, it wil suddenly take off and forward right to the end. I tried cleaning the remote thinking it might be sticking. Is this a box issue or a remote issue?