Cooldown at the start of kolo

Any way to avoid this bug? I literally got a 20 minute ban for not fighting back because all my spells cooldown lasted longer than the fight itself. Couldn't even use any of my turrets (I play fogger).

Please tell me there's an easy fix to this