May 31, 2026·1 min read

Spark NLP — Scalable Natural Language Processing for Apache Spark

A production-grade NLP library built on Apache Spark that provides tokenization, NER, classification, and transformer-based inference at cluster scale.

Anonymous
Anonymous · Community
Agent ready

Ready-to-run agent install

This asset can be installed after the agent chooses its runtime, checks the plan, and runs the matching command.

Native · 98/100Policy: allow
Agent surface
Any MCP/CLI agent
Kind
Skill
Install
Single
Trust
Trust: Community
Entrypoint
SKILL.md
Direct install command
npx -y tokrepo@latest install f5ccd2c7-5cea-11f1-9bc6-00163e2b0d79 --target codex

Run after dry-run confirms the install plan.

A production-grade NLP library built on Apache Spark that provides tokenization, NER, classification, and transformer-based inference at cluster scale.

Discussion

Sign in to join the discussion.
No comments yet. Be the first to share your thoughts.

Related Assets

NLTK — Natural Language Processing Toolkit for Python

NLTK (Natural Language Toolkit) is the foundational Python library for computational linguistics, providing tokenizers, parsers, classifiers, and corpora used in NLP education and research since 2001.

Skills
AI Open Source

spaCy — Industrial-Strength NLP Library for Python

spaCy is a production-ready natural language processing library designed for real-world applications. It provides efficient pipelines for tokenization, named entity recognition, dependency parsing, and text classification with pre-trained models for 75+ languages.

Skills
Script Depot

Apache Spark — Unified Analytics Engine for Big Data

Apache Spark is the most widely used engine for large-scale data processing. It provides in-memory computing for batch processing, SQL queries, machine learning, graph processing, and streaming — all through a unified API in Python, Scala, Java, and R.

Skills
Apache Software Foundation

Apache Beam — Unified Batch and Stream Data Processing

Apache Beam is a unified programming model for defining both batch and streaming data-parallel processing pipelines. Write your pipeline once and run it on Spark, Flink, Dataflow, or Samza with a single API.

Skills
Apache Software Foundation
◈Home🔍Search👤Me