A real-time data processing framework for Python that unifies batch and streaming ETL pipelines, with built-in connectors for LLM applications and retrieval-augmented generation.
Pathway — Python ETL Framework for Stream Processing and RAG
A real-time data processing framework for Python that unifies batch and streaming ETL pipelines, with built-in connectors for LLM applications and retrieval-augmented generation.
Instalación lista para agent
Este activo puede instalarse después de elegir el runtime, revisar el plan y ejecutar el comando correspondiente.
npx -y tokrepo@latest install b7eadc96-8930-11f1-9bc6-00163e2b0d79 --target codexEjecutar después de confirmar el plan con dry-run.
Discusión
Activos relacionados
Apache Airflow — Programmatic Workflow Orchestration Platform
Apache Airflow is the industry-standard platform for authoring, scheduling, and monitoring data workflows. Define DAGs in Python to orchestrate ETL pipelines, ML training, data processing, and any complex workflow with dependencies.
Mage — Modern Data Pipeline Tool for Engineers
Mage is an open-source data pipeline tool that combines the best of notebooks and orchestrators. It offers a visual editor for building ETL/ELT pipelines in Python, SQL, or R, with built-in orchestration, observability, and one-click deployment.
xsv — Fast CSV Toolkit Written in Rust
xsv is a blazing-fast command-line toolkit for working with CSV data. It provides indexing, slicing, searching, joining, aggregation, and statistics — processing millions of rows per second for data analysis, ETL pipelines, and CSV manipulation.
Kestra — Event-Driven Orchestration & Scheduling Platform
Kestra is an open-source orchestration platform for scheduling and running complex data pipelines, ETL jobs, and automation workflows with declarative YAML.