How do you make your child associate a particular object to a word?
You show the object, point to it and utter something(the word) and the child gets it.
You can consider the object as the cat in above picture.
Now, what are the faculties or requisites preexisting in that child’s mind that made him get what the object is about with such a minimal training?
- He perceives depth.
- He was able to discretize different entities (cat, home, ground, wall, plant, sand etc) disregard to colour variations in each entity.
- He was able to discretize sub-entities inside the big entities like roof, wall, front door in the home entity.
- He might have already associated few entities with words or concepts.
Now consider training a Neural network without this hierarchical usability of other faculties.
Evidence for hierarchical nature of human brain processing:
The middle ground of Connectionists and GOFAI(especially in putting knowledge into the machine by brute force):