My fingers swell on cold days but do not hurt terribly?

You need to wear a gloves on cold days for your fingers as this happens to almost everyone that goes out in the cold for an extended period without any protection for their hands.