Cette page est affichée en anglais. Une traduction française est en cours.
CLI ToolsMay 14, 2026·2 min de lecture

Spikee — Prompt Injection Eval Kit (CLI)

ReversecLabs/spikee is a modular CLI for prompt injection/jailbreak evals; verified 184★ and documents `spikee generate` → `spikee test`.

Script Depot
Script Depot · Community
Prêt pour agents

Cet actif peut être lu et installé directement par les agents

TokRepo expose une commande CLI universelle, un contrat d'installation, le metadata JSON, un plan selon l'adaptateur et le contenu raw pour aider les agents à juger l'adaptation, le risque et les prochaines actions.

Native · 94/100Policy : autoriser
Surface agent
Tout agent MCP/CLI
Type
Cli
Installation
Pip
Confiance
Confiance : Established
Point d'entrée
spikee generate --seed-folder ...
Commande CLI universelle
npx tokrepo install a7d0dde3-6f49-5ae6-a26a-5667b707d2bb
contrat d'installationJSON metadataplan adaptateurcontenu raw
Introduction

ReversecLabs/spikee is a modular CLI for prompt injection/jailbreak evals; verified 184★ and documents spikee generate → spikee test.

Best for: Security-minded teams evaluating LLM apps, RAG systems, and guardrails against injection/jailbreak attacks

Works with: Python envs, OpenAI-compatible endpoints by default, optional extras for Bedrock/Azure/Ollama/Groq

Setup time: 10-30 minutes

Key facts (verified)

  • GitHub: 184 stars · 41 forks · pushed 2026-05-13.
  • License: Apache-2.0 · owner avatar + repo URL verified via GitHub API.
  • README-backed entrypoint: spikee generate --seed-folder ....

Main

  • Follow the two-stage loop in README: generate datasets from seed folders, then test a target with consistent judges/providers.

  • Keep installs lean: README says the default install targets OpenAI-compatible endpoints; use extras only for providers you need.

  • Treat results as evidence: keep JSONL datasets + configs and re-run generate + test in CI or on release candidates.

Source-backed notes

  • README says Spikee migrated away from LangChain to any-llm to reduce dependency bloat, with optional extras like spikee[all].
  • README quickstart uses pip install spikee, then spikee init for a workspace and spikee list for modules.
  • README describes dataset generation (spikee generate) and testing (spikee test) as the core workflow stages.

FAQ

  • Is Spikee only for standalone models?: No — README includes LLM applications/agents and guardrails as targets.
  • Do I have to install heavyweight SDKs?: No — README says the default install stays minimal and provider SDKs are optional extras.
  • How do I keep evals repeatable?: Version your seed folders/datasets and re-run with pinned providers/judges.
🙏

Source et remerciements

Source: https://github.com/ReversecLabs/spikee > License: Apache-2.0 > GitHub stars: 184 · forks: 41

Fil de discussion

Connectez-vous pour rejoindre la discussion.
Aucun commentaire pour l'instant. Soyez le premier à partager votre avis.

Actifs similaires

Margin Eval — Local Evals for CLI Coding Agents

Margin Eval is an eval runtime that benchmarks CLI coding agents and records accuracy, token usage, runtime, and traces in a reproducible format.

CLI Tools
Script Depot

DSPy Micro Agent — CLI + FastAPI + Evals

evalops/dspy-micro-agent is a minimal agent runtime (CLI + FastAPI + eval harness); verified 73★ and documents `micro-agent ask` and `run_evals.py --n 50`.

CLI Tools
Agent Toolkit

CLI-Anything — Install Agent-Native CLIs via CLI-Hub

CLI-Anything makes software agent-native: install CLI-Hub (`pip install cli-anything-hub`) and add harnesses via `npx skills add ... --skill ...`.

CLI Tools
Script Depot

Uni-CLI — Governed Software Commands + MCP for Agents

Searchable CLI catalog (282 sites, 1680 commands) that serves governed tools to agents via MCP, with repairable adapters; verified 73★, pushed 2026-05-13.

CLI Tools
Script Depot
◈Accueil🔍Rechercher👤Moi