Question on What Three/Four Star Cards to Build

What it says on the tin (so to speak). I'm currently building Abysswalker (almost have the second card to Level 80), and I know as a myth pair, and five stars that it's good to build out but then, after that, I have ALLLLLLLL these three and four star cards - not just for Rafayel, but for all the other guys too. Outside of five star cards, how in the world do I know which of those three/four star cards to build? And how high do I build them? They all seem to be able to go to 80 which would be an insane amount of resources, and then I only have five of those awakening doodads (well, four now, because I used one on one of the Abysswalker cards).

Any help is greatly appreciated, thank you! :)