Alternativly use a Hue and Saturation Adjustment layer
Layer> adjustment layer>Hue & Sat> move the saturation slider all the way to the left and ok it.
Now using the paintbrush and black paint start painting the colour back in where you want it, if you make a mistake change to white paint to take the colour back out.
When finished Layer > flatten image