Remote desktop connection dropping and VPN Disconnecting multiple times

I've been encountering frequent disruptions with my VPN connection, leading to multiple disconnections from remote desktops. This issue appears to be specific to Xfinity internet, as I never faced similar problems with Verizon. Additionally, there's a recurring issue of the internet speed suddenly dropping to 40/25/80mbps. I'm keen to understand if this is an isolated problem on my end or if others are experiencing similar issues. Are there any permanent solutions available to address these concerns, or should we explore the option of switching back to Verizon as our service provider? I've also noticed that network latency randomly changes to 35/110ms.