the lyrics need to either be really eloquent and elegant, or bizarre enough to evoke interesting mental visuals.
So they need to make sense either in a poignantly clear-cut way or they need to connect ideas that have never been connected before.
But yeah of course they need to make sense. Do you listen to foreign (that you don't know a word of) language songs and get a lot out of them? I don't.