New loan signing Ashley Woodwood started, and Lee Peacock returned from injury.
Stockport took the lead on 15 minutes against the run of play with a close range goal from Elding.
Lee Peacock should have scored for Swindon when he had a one-on-one with the Stockport 'keeper, but he shot straight at the 'keeper who made a good save.
At the start of the second half Aaron Brown replaced Ricky Shakes, but it was Stockport who doubled their lead on 50 minutes with another goal from 10 yards out from Elding.
Jerel Ifil was sent off for a second bookable offence after a late tackle on 75 minutes. He will now be banned for the next 2 games.
Dickinson then made it 3-0 on 85 minutes with his shot beating Phil Smith. Smith also had a few good saves to make to keep the Stockport score down to only 3-0.
Overall a poor display by Swindon against a very in form Stockport side who took their chances well. Swindon had plenty of the ball, but unlike Stockport didn't take their chances. They need a goal scorer, like Sam Parkin use to be. Swindon's next game is at home to Accrington Stanley next Saturday.