← All topics
microgpt
Latest stories covering microgpt, with summaries and links to related coverage.
2 stories · 2 reports · page 1 of 1
Connected topics
Microgpt explained interactively
tool
10 min read
Andrej Karpathy developed a 200-line Python script that trains and runs a GPT model from scratch without any libraries or dependencies. The model is trained on a dataset of 32,000 human names, with each name listed on a separate line.
Microgpt
tool
28 min read
microgpt is a single-file Python script consisting of 200 lines that implements a GPT-like model with no dependencies. It includes components such as a dataset, tokenizer, autograd engine, neural network architecture, Adam optimizer, and both training and inference loops.