Daily Shaarli

All links of one day in a single page.

June 24, 2024

On the Paradox of Learning to Reason from Data

Further clues that transformer models can't learn logic from data.

Of Psion and Symbian - by Bradford Morgan White
thumbnail

Another story of precursors in the tech space. They basically invented the palmtop and spawned Symbian which was very much dominant on mobile for a while. The end of the Nokia story is a bit oversimplified for my taste just glancing over Maemo, but it is forgivable since it wasn't the focus of this piece.

Scalable MatMul-free Language Modeling

Interesting paper showing a promising path to reduce the memory and workload of transformer models. This is much more interesting than the race to the gigantic size.

Inside the tiny chip that powers Montreal subway tickets
thumbnail

Nice reverse engineering of a NFC chip used in a disposable transportation ticket.