SkillsMay 11, 2026·2 min read

modal-examples — Serverless LLM Jobs on Modal

Learn production patterns for serverless jobs (LLM inference, data pipelines) using Modal’s official examples. Run one and adapt it to your workload.

Script Depot
Script Depot · Community
Agent ready

This asset can be read and installed directly by agents

TokRepo exposes a universal CLI command, install contract, metadata JSON, adapter-aware plan, and raw content links so agents can judge fit, risk, and next actions.

Native · 98/100Policy: allow
Agent surface
Any MCP/CLI agent
Kind
Skill
Install
Single
Trust
Trust: Established
Entrypoint
README.md
Universal CLI install command
npx tokrepo install 154d3162-9681-440c-b4d9-825b073b04a5
install contractmetadata JSONadapter planraw content
Intro

Learn production patterns for serverless jobs (LLM inference, data pipelines) using Modal’s official examples. Run one and adapt it to your workload.

  • Best for: Developers who want a quick, example-driven path to run LLM workloads as serverless jobs
  • Works with: Python, Modal CLI, cloud execution with local development loop (per README)
  • Setup time: 12 minutes

Quantitative Notes

  • Setup time ~12 minutes (install + auth + run one example)
  • GitHub stars + forks (verified): see Source & Thanks
  • Examples are organized into multiple folders; start with 1 file before scaling up

Practical Notes

Treat examples as templates: fork one that matches your workload (batch, web endpoint, GPU inference), replace the core function with your model/tool call, then add logging and retries. Keep a local dev loop with a tiny input set so iteration stays fast.

Safety note: Treat secrets carefully: store API keys in env/secret managers and avoid printing them in logs.

FAQ

Q: Do I need an account? A: Yes. The README instructs you to sign up and set an API key for the Modal CLI.

Q: Can I run LLM inference? A: Many examples demonstrate patterns you can adapt to inference and data workloads; follow the repo structure.

Q: How do I keep costs predictable? A: Pin resources, set concurrency limits, and use small test runs before scaling.

🙏

Source & Thanks

GitHub: https://github.com/modal-labs/modal-examples Owner avatar: https://avatars.githubusercontent.com/u/88658467?v=4 License (SPDX): MIT GitHub stars (verified via api.github.com/repos/modal-labs/modal-examples): 1,189 GitHub forks (verified via api.github.com/repos/modal-labs/modal-examples): 288

Discussion

Sign in to join the discussion.
No comments yet. Be the first to share your thoughts.

Related Assets

Modal — Serverless GPU Cloud for AI Workloads

Run GPU workloads in the cloud with Python decorators. Modal provides serverless A100/H100 GPUs for model inference, fine-tuning, and batch jobs with zero infrastructure.

Skills
Modal

OrbitDB — Peer-to-Peer Serverless Database on IPFS

OrbitDB is a serverless, distributed, peer-to-peer database built on IPFS and CRDTs. It enables offline-first applications where data syncs automatically when peers connect without any central server.

Skills
Script Depot

Memvid — Serverless Memory Layer for AI Agents

An open-source memory system that replaces complex RAG pipelines with a single-file, serverless memory layer providing instant retrieval and long-term storage for AI agents.

Skills
Script Depot

Serverless Framework — Build and Deploy Serverless Apps to Any Cloud

The most widely adopted toolkit for building serverless applications on AWS Lambda, Azure Functions, Google Cloud Functions, and more. Define infrastructure and functions in a single YAML file and deploy with one command.

Skills
Script Depot
◈Home🔍Search👤Me