> AI by Hand is the research publication of By Hand Research, founded by Prof. Tom Yeh. By Hand Research studies model interpretability and explainability at the math and algorithm level. Subscribers receive free new articles and join live seminars. Members get access to our full research library.
i created something similar a while back. Inspired by micrograd for showing the connection between math/calculus and code, then building along the way to a full NumPy deep learning library that I pretrained GPT-2 124M model with it. One way to learn is to trace through the PRs merged to the repo in chronological order.
Train your own LLM - https://github.com/angelos-p/llm-from-scratch
HN Discussion - https://news.ycombinator.com/item?id=48017948
> AI by Hand is the research publication of By Hand Research, founded by Prof. Tom Yeh. By Hand Research studies model interpretability and explainability at the math and algorithm level. Subscribers receive free new articles and join live seminars. Members get access to our full research library.
https://nostarch.com/deep-learning-visual-approach
The philosophy is the same: "What I cannot create, I do not understand." https://github.com/workofart/ml-by-hand