AI by Hand
byhand.ai> AI by Hand is the research publication of By Hand Research, founded by Prof. Tom Yeh. By Hand Research studies model interpretability and explainability at the math and algorithm level. Subscribers receive free new articles and join live seminars. Members get access to our full research library.
The philosophy is the same: "What I cannot create, I do not understand." https://github.com/workofart/ml-by-hand
Train your own LLM - https://github.com/angelos-p/llm-from-scratch
HN Discussion - https://news.ycombinator.com/item?id=48017948
However, I wonder about the use of this. Typically, you'd want to use a GPU for inference, and programming those in C is quite a challenge. The educational value of learning LLMs in C/C++ seems a lot lower than in Python. May I ask why you're interested in this specifically?
Also, why ask this here, and not simply use Google or an LLM to find the information? It comes off as a bit lazy, especially given that you provide no extra context.
You gave a good answer: why SO the thread? Conversation is the goal here, right? If you’re feeling put out by the question, why bother answering it and then complaining that they asked it? Just move along.
Foundations of Large Language Models[0]
0 - https://arxiv.org/pdf/2501.09223v2- other half have no visualizations whatsoever
- i have posted far better resources than this in the past collecting everything HN has over a 10 yr period on these subjects https://news.ycombinator.com/item?id=49183198
- every post is locked https://www.byhand.ai/archive
- sorry bruh, not gonna bother with a paywall that big
- amaze me first, i am happy to pay
If anyone is interested: https://github.com/kvladsrc/gym/tree/main/neural_network/nn_...