menggelistis / gedik / manja

My updated translations : "coyness arising from anxiety; descriptive of both childish social incongruence, and signalling in intimate relationships" 

LLMs - intuitive?

There is one outstandingly wrong, critique of most LLMs : 

"they don't have an intuition". 

Well, intuition is NEARLY ALL they have - just open it up and look at the data structure. This is because they are trained as probabilistic consolidations of all past uses of each word in known history, vis-a-vis "unsupervised learning". What they do NOT have is rules, because they are not trained with hard counterexamples, vis-a-vis "supervised learning", let alone trained to have strict rules, vis-a-vis "logic programming". 

on the merits of denying intelligence

Thanks for the thoughtful comment, haha. Without getting too much into the weeds, I think : Each of our perspectives on what AGI / or "I" in general means is shaped by unique personal experience, a bound set for each of us. These sets may or may not be commensurable - we don't currently know if the categories or your experience, and the categories of mine are even comparable. This has political consequences, mainly related to how seriously we take each other's speech.

Some of the technological steps you mentioned however, I must say are "operational improvements" which improve cache hierarchy and introduce compression in some cases -without really changing the overall "architectural" approach employed by the currently trendy transformer gang. 

I think it remains useful to query both, other humans, and the results of what we can make machines do ... in improving not just "what we think intelligence is", but also how we can communicate what we think it is.