Koh Samui or Koh Phangan

I have 3 days in Samui how do I distribute it?

I am going during non full moon or half moon days.

Is it worth staying at koh Phangan for a night?