Discussions

• 92 You must be logged in to vote

  📣

  Beating GPT-2 for <<$100: the nanochat journey

  update

  karpathy announced Jan 31, 2026 in Announcements

  

  

  

  

  25
• 227 You must be logged in to vote

  📣

  Introducing nanochat: The best ChatGPT that $100 can buy.

  update

  karpathy announced Oct 13, 2025 in Announcements

  

  

  

  

  96
• 55 You must be logged in to vote

  💬

  [Jan 7 2026] nanochat miniseries v1

  update

  karpathy started Jan 7, 2026 in General

  

  

  

  

  27
• 1 You must be logged in to vote

  🙏

  Security Testing - Nanochat

  sbhagavat asked Jan 29, 2026 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Why did bigram hash embeddings not scale?

  serdardoesml started Jan 28, 2026 in General

  

  

  2
• 1 You must be logged in to vote

  🙌

  DCLM-baseline dataset for nanochat (drop-in replacement)

  ddudek started Jan 28, 2026 in Show and tell

  

  

  1
• 1 You must be logged in to vote

  💬

  Question regarding NeuroAI

  tesla-cat started Jan 27, 2026 in General

  

  

  0
• 2 You must be logged in to vote

  🙏

  Need clarity on total batch size

  nitishpandey04 asked Nov 13, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How was karpathy split generated ?

  Atharva-Phatak asked Nov 18, 2025 in Q&A · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  What is num_fewshot in eval configuration icl_tasks?

  kmcnayr asked Dec 12, 2025 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  💬

  Python capability in nanochat?

  leolbyy started Jan 23, 2026 in General

  

  

  1
• 1 You must be logged in to vote

  💡

  Model likes it for Value Embedding at a deeper layer? [A sweep experiment at small scale]

  jojo23333 started Jan 25, 2026 in Ideas

  

  

  3
• 1 You must be logged in to vote

  💬

  Support for arbitrary architecture parameters with the implemented DistAdamW

  feature New feature or request

  VovaTch started Nov 21, 2025 in General

  

  

  1
• 0 You must be logged in to vote

  🙏

  Request for Guidance: NCCL Timeout during torch.compile on 8x A10G (ml.g5.48xlarge) at "Initializing first step"

  Mohamed-Abdirizak asked Jan 25, 2026 in Q&A · Unanswered

  

  

  0
• 3 You must be logged in to vote

  💬

  Perhaps a multimodal version will be released in the future？

  wonderNefelibata started Dec 28, 2025 in General

  

  

  1
• 21 You must be logged in to vote

  💬

  Anyone managed to run training on an NVIDIA Spark yet?

  low resource Discussions & PRs addressing how to run nanochat on local hardware / CPU

  simonw started Oct 14, 2025 in General

  

  

  

  

  122
• 4 You must be logged in to vote

  🙌

  running on strix halo and other shenanigans

  LokiMetaSmith started Dec 9, 2025 in Show and tell

  

  

  

  

  4
• 1 You must be logged in to vote

  💡

  Time Reversed NanoChat

  aschweig started Jan 19, 2026 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💡

  Anyone interested in helping make nanochat ~100 lines of code + train faster? I have a proof of concept too.

  nanocreator2 started Jan 18, 2026 in Ideas

  

  

  0
• 4 You must be logged in to vote

  💬

  Experiment: Evolving nanochat with LLM Guided Mutations

  badlogicmanpreet started Jan 14, 2026 in General

  

  

  0
• 41 You must be logged in to vote

  📣

  d34 model (~$2,500)

  update

  karpathy announced Nov 20, 2025 in Announcements

  

  

  

  

  14
• 2 You must be logged in to vote

  🙏

  Training for another language

  Delev1n asked Nov 26, 2025 in Q&A · Unanswered

  

  

  

  

  4
• 1 You must be logged in to vote

  💡

  Converted into Rust by AI

  foss4u started Jan 9, 2026 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙏

  Question about weight decay in Muon

  jootanehorror asked Jan 7, 2026 in Q&A · Closed · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  llama.cpp support

  Mihaiii asked Jan 8, 2026 in Q&A · Unanswered

  

  

  0