GroqCloud runs Llama 3.3 70B at 250+ tok/sec on LPU silicon. OpenAI-compatible API. Free tier, sub-second TTFT, ideal for streaming.
May 8, 2026·1 min read
GroqCloud Quickstart — 250 tokens/sec OpenAI-Compat API
GroqCloud runs Llama 3.3 70B at 250+ tok/sec on LPU silicon. OpenAI-compatible API. Free tier, sub-second TTFT, ideal for streaming.
Agent ready
Safe staging for this asset
This asset is staged first. The copied prompt tells the agent to inspect the staged files and ask before activating scripts, MCP config, or global config.
Stage only · 27/100Policy: stage
Agent surface
Any MCP/CLI agent
Kind
Knowledge
Install
Stage only
Trust
Trust: Community
Entrypoint
Asset
Safe staging command
npx -y tokrepo@latest install 8ac70a0d-0996-4fa9-a316-c9e586d54f86 --target codexStages files first; activation requires review of the staged README and plan.
Discussion
Sign in to join the discussion.
No comments yet. Be the first to share your thoughts.