Should the show have ended with Season 4?

I feel that it would not be so bad if the show ended at season 4.