Steve Mildenhall in the Yeovil goal had to make some good saves to keep Swindon out, and Roberts once again came close, but his shot went just over the bar.
Yeovil hadn't looked like scoring until 78 minutes when a corner found Lloyd Owusu who headed in to give the Somerset side a 1-0 lead.
Swindon pushed forward for an equaliser, but ran out of time. Overall it was a fairly average game where Swindon had chances, but didn't take them where as Yeovil did. Swindon now face the long away trip to Hartlepool next Saturday, and have dropped down to 11th in the League One Table.