Cold weather & refusal to work?

I understand we work in all weather but with cold weather and wind chill, what would be deemed almost hazardous? Say like it’s 5 degrees outside and it’s 10-15mph winds or more. Bundling up can only do so much. So i am just curious how anyone else goes about it

Edit; my boss doesn’t mind us waiting for it to get warmer in the day but it’s mostly my party chief who just doesn’t seem to care or care about the equipment (and expects to work in a 8-10hr day out in it regardless when the project is due) and avoids being in the office which I get but he’s eventually going to be in the office soon anyways