Do visits stress anyone else out?

My 7.5 week old is really cranky due to possible reflux, milk allergies, gas which we are working on. We spend most of his awake time trying to stop him from crying. Our family and friends want to all visit and there are a lot of them, but it makes me stressed because then I have talk to them/entertain while also trying to keep him calm which is almost impossible. I also have to keep explaining to everyone who comes that they can’t hold him because he will literally go nuts. I’m so tired of the look on peoples faces when he starts screaming, it’s a constant reminder of how babies should be much happier than this and makes me feel so much worse for my poor baby. I know I cant hide him forever but should I just feel like telling everyone we need more time, is that reasonable?