2026-05-14 at

JEPA is still not inspiring

Finally got around to reading a definition of JEPA. Based on this limited skim, my first impression is that it's still operating on data structures which are too abstract, from a top-down approach, instead of just building a world-view from the bottom, upwards.

I'll keep tabs on it, but of course I don't have time to dive in right now. I have already discussed what I consider to the the basics : anthropomorphic AI must have (1) sensory data structures (2) spatio-temporal modelling (3) hypothesis formation and testing.

Meanwhile the probabilistic relationship between high-level abstract ideas like "dogs in walkers" is simply "less reified" or "more abstract", and basically will display the behavioural inefficiencies associated with reasoning about platonic forms in general, without instantiation.

https://youtu.be/oM4neOyZOi0?si=YFY5qnse8vb3MyWh

No comments :

Post a Comment