Esta página se muestra en inglés. Una traducción al español está en curso.
SkillsMay 11, 2026·2 min de lectura

modal-examples — Serverless LLM Jobs on Modal

Learn production patterns for serverless jobs (LLM inference, data pipelines) using Modal’s official examples. Run one and adapt it to your workload.

Script Depot
Script Depot · Community
Listo para agents

Instalación lista para agent

Este activo puede instalarse después de elegir el runtime, revisar el plan y ejecutar el comando correspondiente.

Native · 98/100Política: permitir
Superficie agent
Cualquier agent MCP/CLI
Tipo
Skill
Instalación
Single
Confianza
Confianza: Established
Entrada
README.md
Comando de instalación directa
npx -y tokrepo@latest install 154d3162-9681-440c-b4d9-825b073b04a5 --target codex

Ejecutar después de confirmar el plan con dry-run.

Introducción

Learn production patterns for serverless jobs (LLM inference, data pipelines) using Modal’s official examples. Run one and adapt it to your workload.

  • Best for: Developers who want a quick, example-driven path to run LLM workloads as serverless jobs
  • Works with: Python, Modal CLI, cloud execution with local development loop (per README)
  • Setup time: 12 minutes

Quantitative Notes

  • Setup time ~12 minutes (install + auth + run one example)
  • GitHub stars + forks (verified): see Source & Thanks
  • Examples are organized into multiple folders; start with 1 file before scaling up

Practical Notes

Treat examples as templates: fork one that matches your workload (batch, web endpoint, GPU inference), replace the core function with your model/tool call, then add logging and retries. Keep a local dev loop with a tiny input set so iteration stays fast.

Safety note: Treat secrets carefully: store API keys in env/secret managers and avoid printing them in logs.

FAQ

Q: Do I need an account? A: Yes. The README instructs you to sign up and set an API key for the Modal CLI.

Q: Can I run LLM inference? A: Many examples demonstrate patterns you can adapt to inference and data workloads; follow the repo structure.

Q: How do I keep costs predictable? A: Pin resources, set concurrency limits, and use small test runs before scaling.

🙏

Fuente y agradecimientos

GitHub: https://github.com/modal-labs/modal-examples Owner avatar: https://avatars.githubusercontent.com/u/88658467?v=4 License (SPDX): MIT GitHub stars (verified via api.github.com/repos/modal-labs/modal-examples): 1,189 GitHub forks (verified via api.github.com/repos/modal-labs/modal-examples): 288

Discusión

Inicia sesión para unirte a la discusión.
Aún no hay comentarios. Sé el primero en compartir tus ideas.

Activos relacionados

Modal — Serverless GPU Cloud for AI Workloads

Run GPU workloads in the cloud with Python decorators. Modal provides serverless A100/H100 GPUs for model inference, fine-tuning, and batch jobs with zero infrastructure.

Skills
Modal

OrbitDB — Peer-to-Peer Serverless Database on IPFS

OrbitDB is a serverless, distributed, peer-to-peer database built on IPFS and CRDTs. It enables offline-first applications where data syncs automatically when peers connect without any central server.

Skills
Script Depot

Memvid — Serverless Memory Layer for AI Agents

An open-source memory system that replaces complex RAG pipelines with a single-file, serverless memory layer providing instant retrieval and long-term storage for AI agents.

Skills
Script Depot

Serverless Framework — Build and Deploy Serverless Apps to Any Cloud

The most widely adopted toolkit for building serverless applications on AWS Lambda, Azure Functions, Google Cloud Functions, and more. Define infrastructure and functions in a single YAML file and deploy with one command.

Skills
Script Depot
◈Inicio🔍Buscar👤Yo