Games are stuttering for few seconds after alt tabbing

As the title says, games runs perfectly fine without any issues until I alt tab out and back in, then it stutters for 10-15 seconds and runs fine again.
I have a ryzen 5 5600g
I tried downgrading to multiple previous drivers are uninstalling new ones with DDU in safe mode, but all of the previous version has the same problem, any fix for it?