Gigabit service but less than 500mb download

Using the gateway from Xfinity I'm only getting half the speed I'm paying for. Is it a problem with the service? Should I downgrade to the appropriate tier to what I'm getting for speed? Only had it for a week but have checked speed test right next to gateway and at best have got around 480mb/s for gigabit price.