TIL: The AI Wall
Gen AI helps people in adjacent roles perform almost like experts, but it can't close the gap for people far from the domain. Here's what the AI wall means.
Things I've learned or things I find interesting will be logged here. For long-form content, you might want to check out my newsletter.
Gen AI helps people in adjacent roles perform almost like experts, but it can't close the gap for people far from the domain. Here's what the AI wall means.
What GGUF and ONNX actually contain, what they expect from the runtime, and why choosing between them is not simply a question of quantisation or hardware.
Trading cheap guesses for expensive forward passes
How to think about Q, K, and V vectors in the Attention layer of a Large Language Model
Lilian Weng's Why We Think is a survey of test-time compute and chain-of-thought reasoning. Here's what I pulled out of it.
I think we are still too loose with the phrase “world model”.
Quantisation is really a precision-allocation problem.
A study of 52 developers found that using AI to learn a new Python library led to worse comprehension scores, with no speed improvement. Here's what actually works.