Sponge cake tasting eggy?

In the past week I’ve made two sponge cakes (first time making sponge cakes). The first attempt felt to eggy so the second one I took out one egg yolk from the recipe and added in a bit more stuff. I’m not sure if this is just how sponge cake is supposed to taste or if I’m doing something wrong?