None of these appeals to relative complexity, low level structure, or training corpuses relates to whether a human or NN "know" the meaning of a word in some special way. A lot of your description of what "know" means could be confused to be a description of how Word2Vec encodes words. This just indicates ignorance of how ML language processing works. It's not remotely on the same level as a human brain, but your view on how things work and what its failings are is just wrong.