OK to move laundry?

I went downstairs to put my clothes in the washer, only to find someone else's clothes still in it. Is it OK to remove their clothes and either lay them aside or put them in the dryer so I can start my wash, or should I wait and return later?