X1 voice remote not responding, just blinking white

My xfinity x1 voice remote for last three days, if it sits idle for any extended period of time, when I try to use it again it just keeps flashing white, the whole remote and does not do anything. I just put new batteries in it a week ago. To get the remote to finally respond I have to remove and replace the batteries once or twice and then hold the power button until the flashing stops. Any ideas?