Do you let your cats on your bed?

My husband got a cat a few months ago. I've never had a cat before (still have birds, a dog a long time ago). The cat loves getting all over the cabinets, beds, etc. Is it unsanitary? I'm just thinking about the bacteria after he uses the litter box.