2026-06-13 at 4:57 am
commerce > politics
why do we use QKV and not fewer parameters?
sex bots in Malaysia
2026-06-12 at 1:03 am
tatacara kenegaraan : BM tidak cukup
reflection on a journey with poors
2026-06-11 at 6:08 am
embarassing reflections
revision : toe and finger tip tracking
apostasy in Malaysia
2026-06-10 at 2:09 am
Elections : Interfaith Muhibbah
It is normal to be divided in politics, but it is (always) sad, to see Malaysians being fearful, angry, rude, and violent, about politics ... because some evil (maybe human) spirit has told them that this is a correct (bersopan) way to approach political (civil) life.
As a point of reflection, for non-Muslims (such as myself) and Muslims, perhaps we can all reflect on this frequently read Muslim text. Muslims are of course familiar with it, but it is less common knowledge to others.
Maybe this is a good reminder about how to engage with each other. Our responsibility to ourselves is to believe what we believe - and our responsibility to each other, is to encourage each other, to believe whatever they believe. 🙂
- Surah al-Kafirun (The Disbelievers)
- https://ms.wikipedia.org/wiki/Surah_Al-Kafirun
I think, the overall scope of discussion, is quite suitable for children also, on a daily basis. Hopefully if kids are raised to be more chill, they won't grow up into adults who are always yelling at each other.
Discussion :
2026-06-10 :
Part 1
Strategically, Malay centrists who seek political gain, need to have a structural narrative response to the Malay right's appeals to nativism and theism.
The Malay left is too tiny to make an active impact, given the laws and taboos against communism - whereas their position is favoured by the current phase of the global economic cycle where economic inequality is peaking.
I have detailed thought on each of these issues, but it is really just me hanging on the dividing wall, sipping a soda watching it play out in someone else's family. 🤣
Part 2
Earlier I posted an FMT op-ed by a Malay centrist, who had a view that there are many types of Malays.
Q : Someone in the comments asked why the Malay right seeks to unify against non-Malay citizens.
A : One of the driving factors of course, are our civil society NGOs with roots in the 1970s Muslim Brotherhood movement, like ABIM and ISMA, which our dear PMX helped to form a strong identity base back when he was a young man. See EUBI, and all those historical events back then.
These are of course, grassroots clubs with a common identity. Sometimes we make fun of them by saying it is not clear if race is riding on religion, or if religion is riding on race - it actually doesn't matter, these are our citizens and it is altogether part of our national society.
Whether we agree or not about how to run the country, we are still living together and must cooperate, to increase cultural exposure for our kids, so that everyone has a better understanding of everyone else ...
... instead of turning into adults who have gotten stuck in the idea, "my culture is my culture, their culture is their culture, we do not talk or share these with each other" - these are the people of all races who reduce GDP 15% annually, compounded for decades, because people are worried about their neighbours instead of worrying about all the other countries coming to eat out lunch.
2026-06-08 at 8:13 pm
Tradeoffs
Why (current) LLMs are fat, and dumb as shit
Consolidated notes over a few days, nothing really new, but the talking points were related, so here they are. Mainly response to he following propositions made by others :
❌ "We don't yet have the language to understand LLMs"
❌ "LLMs are bad at maths"
❌ "World models are timeless"
- 2026-06-06 0133
- "We don't yet have the language to understand LLMs"
- WTF is this nonsense - there are infinite opportunities to make language more complex. We have a perfectly precise language for describing what LLMs do ... it's the literal data, and algorithms operating on the data.
If you say "it's not clear in English," well read the maths. If you say, "I don't understand the maths," then it's either a you problem, or a request for poetic expansion of English, which the LLMs are more than happy to to provide if you append "ELI5" to the name of the step in the demised computation 😂 - 2026-06-06 0809
- "LLMs are bad at maths"
- Just have ALUs do math. Use LLMs for guesswork. The dumbest shit architecture in the world making frontier models learn maths as if they are made of meat.
- 2026-06-07 1743
- "World models are timeless"
- You need to give an example of thinking that is time independent. All thinking is intrinsically time embedded
Thinking= computation
Thought objects = data
Comp on data
Operations on operands
Concept of causality / implication depends on concept of time ( Good place to start )
You're probably thinking about transformer archi as a way to parallelise the temporal dimension. It is not "independent". - Let's go with a simple example.
Say the input is a ball balanced on a pencil, standing upright on a flat surface, on a gravitational planet.
Let's say the input is just a photo.
Just to get from photo to physical model requires inference (comp) by the bot. Then more comp is needed to forecast the "next incremental state".
There are two ways to do the comp.
A : transpose the time dimension to space, which is what embedding layers + attention weights do : these contain a memory of past events, and associate the input data with similar past events.
B : after that association is done, logic is performed, in the temporal dimension, at the FFN layer ( after the attention layer in the transformer ). Typically if you have a transformer doing logic, maths, physics, it is happening here.
Because transformers are not Just A, but A+B, there is always a temporal i.e. logical computation step during inference. Only A is time agnostic. B is not.
Currently LLMs are fat because they try to move more B to A.
But as we all know, sometimes just a bit of B time will save a lot of A space, plus all the time needed to create A space in the training step.
So it comes down to target workload. Fat A is not for everything.