Delete mods

It's a stupid question, but can downloaded mods be deleted (.zip) after installing them?