This question has always interested me. You have the eggs and bunnies as signs of fertility. But you have Good Friday and Easter Sunday as well. I am certainly not a theologian (though I was a history major). I found this explanation from Methodist Minister Todd Stepp both informative and interesting. You can read it here. (Full disclosure, I am not Methodist, but he explained it using quotes from Obi Wan in Star Wars!! You know I was going to be all over that.)
His take, it depends on your point of view. Spring celebrations occurred long before the Resurrection. In that sense, Easter was a Pagan holiday first (and is likely the origination source for the eggs and bunnies). However, the death, burial and resurrection of Jesus Christ is the cornerstone of the Christian faith. The Jewish celebration of Passover forms the backdrop of the crucifixion story. As such, Easter is celebrated near the time of the Passover celebration. I thought it interesting that the word “Easter” originated from a Pagan goddess of spring. Other languages use a word derived from the word Passover for “Easter.”
Anyway, he does a better job than I could ever hope to do, but the gist is that if you are a pagan, you feel Christianity “took over” your holiday. While Christians believe that the most important day in the history of man, the day God in human form, perfect, allowed himself to die as a sacrifice for man’s sins so that man might be saved, dwarfs any prior celebration.