It is possible that you need to rejet when it is that cold. Hondas have a hard time starting in the cold. It's the nature of the beast, mine is the same way.
Air has mas and density. The colder it gets the more dense the air becomes. Because of this, it will effect your air/fuel ratio.
I'm assuming it idles fine in the warmer months?