The Sky Blues secured all three points at the New York Stadium, after Leo Ostigard's goal in the second half.
The defender rose highest with 70 minutes on the clock and headed home to secure the points against Rotherham.
The win lifts City into 18th in the Championship, as they prepare to take on Barnsley this weekend.