Manual Connects to xFi Pods

Apparently there is no way to assign a specific device to a specific pod. This presents a real problem for my setup. I use a Chromecast Audio device to stream music to my non-bluetooth speaker on my outside deck/yard. I play Pandora from my phone to do this. The problem is my Chromecast is in a specific location all the time and therefore always connects to a specific pod. When I go to my deck, my phone always connects to a different pod, which then disconnects my ability to control my music from my phone because phone and Chromecast must be connected to the same pod for that to work. Sure would be nice to be able to assign and keep a specific device to a specific pod in a situation like this. And yes I know this sort of defeats what a "mesh" network is meant to do which is great for my other devices but not this situation