Language can definitely be odd -- but it's usually in interesting ways, not annoying ways. At least, that's how I see it. As some people already know, I'm fooling around a bit with studying Irish (not anything I'll ever study seriously, just something that I find interesting for various personal reasons). I recently learned about one way in which Irish has an interesting oddity.
In English, there are two verb tenses which have somewhat similar, but not identical meanings. For example:
1) The woman wears a dress.
2) The woman is wearing a dress.
In the first sentence, it means that the woman wears a dress in general but does not necessarily mean she's wearing one at the moment, whereas in the second sentence, it's the other way around: the woman is wearing a dress, but might not wear a dress in general. Irish makes the same distinction, but the way they do it is completely different from English.
1) An bean ag caitheamh gúna.
2) Tá an bhean ag caitheamh gúna.
The word "tá" is Irish for "yes", so very roughly translated: "The woman wears a dress" and "The woman [yes is wearing] a dress." I wonder how that particular construction evolved.