Train large language models in pure C and CUDA without any deep learning framework. Created by Andrej Karpathy, llm.c demonstrates that GPT-2 training can be expressed in roughly 1,000 lines of C code.
llm.c — LLM Training in Simple Raw C/CUDA
Train large language models in pure C and CUDA without any deep learning framework. Created by Andrej Karpathy, llm.c demonstrates that GPT-2 training can be expressed in roughly 1,000 lines of C code.
Agent 可直接安装
这个资产可安装;Agent 先选择当前运行时、检查安装计划,再运行匹配命令。
npx -y tokrepo@latest install 8cefedb2-45df-11f1-9bc6-00163e2b0d79 --target codex先 dry-run 确认安装计划,再运行此命令。
讨论
相关资产
LLM Foundry — LLM Training Code for Foundation Models by Databricks
An open-source library for training, fine-tuning, and evaluating large language models, built on the Composer training library by MosaicML/Databricks.
Liger Kernel — Efficient Triton Kernels for LLM Training
A collection of fused Triton kernels that reduce GPU memory usage and increase throughput when training large language models with PyTorch.
Liger-Kernel — Efficient GPU Kernels for LLM Training
Liger-Kernel provides optimized Triton kernels for LLM training that reduce GPU memory usage and improve throughput, serving as drop-in replacements for standard HuggingFace Transformers layers.
Unsloth — 2x Faster Local LLM Training & Inference
Unsloth is a unified local interface for running and training AI models. 58.7K+ GitHub stars. 2x faster training with 70% less VRAM across 500+ models including Qwen, DeepSeek, Llama, Gemma. Web UI wi