Why do "exceptions to the rules" exist? (in grammar)?

I mean, all they are is just a pain in the ***. Is there a certain etymology or something that causes them to turn out different? Because if there isn't, that really pisses me off. It's a lot easier to just remember rules for grammar instead of having lists of words to just memorize.