Neoprene Pogies will keep the wind off as well as insulating your hands. They also give better paddle contact than gloves.

Warm and Windproof paddling mitts for cold conditions.