Except when it comes to LLM, the fact that the technology fundamentally operates by probabilisticly stringing together the next most likely word to appear in the sentence based on the frequency said words appeared in the training data is a fundamental limitation of the technology.
So long as a model has no regard for the actual you know, meaning of the word, it definitionally cannot create a truly meaningful sentence.
This is a misunderstanding of what "probabilistic word choice" can actually accomplish and the non-probabilistic systems that are incorporated into these systems. People also make mistakes and don't actually "know" the meaning of words.
The belief system that humans have special cognizance unlearnable by observation is just mysticism.