Why is whistling considered as something "third class" to do?

My family always scolds me when I whistle a tune and tells me that only people from "gam" do it.