The scale of currently trendy over-engineering in AI is magnificent. Models treat almost every verbal concept in the human lexicon as an independent factor ( millions ), without consideration of the notion that all embodied human thought is derived from some 5-10 qualia dimensions, mapped to maybe 50-500 sensory nervous inputs.
For example, the entire sense modality of sound is a one-dimensional signal, per eardrum. Smells and tastes for all their compound structure, are rudimentary one-dimensional signals also once sliced down to minute timeframes in conscious memory, per unit of space. Vision is uniquely interesting in its three colour framework, perhaps more for tetrachromats. Dermatomuscular nerves are only a small bouquet of haptic, vibrational, hot, cold, pain, etc. one-dimensional signals also.
One day, a reversion to basic sensory data types will collapse complexity in anthropomorphic AI. We must look forward to that day.