cold

I live in Winnipeg, and the weather regularly gets down to -40°(the same in farenheit or Celsius). I've noticed that whenever I take them outside they develop a click. Even if they're just outside for a few minutes and in my jacket pocket. Is there anything I can do to avoid this?