Are you in favour or against on-premise server hosting

I've been having a discussion with my coworker about either having on-prem or cloud only servers.

I am looking into implementing netbox and monitoring on our prod environment, and personally I feel this sort of none intensive services can easily be deployed on-premises.

My colleague is all about cloud, but I feel that Azure VM or container pricing could spike up quickly, if done incorrectly.

What are your thoughts about on-prem infrastructure, is this a yey or ney?