GPU fan doesn’t spin consistently

I’ve had my PC up and running for about 2 weeks now. After getting everything plugged in and tidied up, I’ve had no serious hardware issues; other than a strange, deep, motor-like sound that comes from my GPU (RTX 2060). This only happens when I’m not running any application that requires the GPU to actually do some hard work (i.e. when I’m just sitting at my desktop screen). However when I’m running a game, even at high settings, it sounds just fine.

After taking a closer look, it turns out that the fan isn’t consistently spinning while using the computer casually. The GPU will make the deep motor/cranking noise to get the fan to spin for a second or two, and then it’ll stop spinning. Then repeat. This pretty much goes on for most of the time I’m just on google or discord or something. But, strangely, in any game, it spins just fine.

Anyone know a fix?