I would think (but could be wrong) that as long as the temperatures are well above freezing, you would not get frostbite, and discomfort and poor functioning digits are the main problem (a risk in itself if your survival depends on properly functioning hands and feet). I have crossed streams in very cold water and my feet went numb- it feels like you are walking on stumps- you become very clumsy and fall easily.

If I had your problem I would not do longer trips or backpacking in well below freezing conditions. In this case you could actually seriously and permanently damage your fingers or toes. Winter backpacking in below freezing temperatures is serious business - not very forgiving. If you choose to go out in below freezing conditions for a day hike, I would take some chemical warmer packets for emergency. If you get hurt and cannot move, your hands can feet can get really cold without added external heat.