Elasticsearch — Distributed Search and Analytics Engine

What it is

Elasticsearch is a distributed search and analytics engine built on Apache Lucene. It provides near-real-time full-text search, structured search, analytics, and log aggregation across petabytes of data. It powers search for applications, log analysis pipelines, security analytics, and observability stacks.

Elasticsearch targets backend engineers, data engineers, and DevOps teams who need fast search and analytics over large datasets.

How it saves time or tokens

Elasticsearch indexes data in near real-time, so newly ingested documents are searchable within seconds. The distributed architecture scales horizontally by adding nodes. A query that would take minutes in a relational database returns in milliseconds in Elasticsearch.

The Query DSL supports complex queries (boolean, fuzzy, range, aggregation) without writing custom search code.

How to use

1. Install Elasticsearch: docker run -d -p 9200:9200 elasticsearch:8.13.0
2. Create an index and map your fields
3. Index documents via the REST API
4. Query with the JSON Query DSL

Example

# Create an index with mappings
curl -X PUT 'localhost:9200/products' -H 'Content-Type: application/json' -d '{
  "mappings": {
    "properties": {
      "name": { "type": "text" },
      "price": { "type": "float" },
      "category": { "type": "keyword" },
      "description": { "type": "text" }
    }
  }
}'

# Index a document
curl -X POST 'localhost:9200/products/_doc' -H 'Content-Type: application/json' -d '{
  "name": "Wireless Mouse",
  "price": 29.99,
  "category": "electronics",
  "description": "Ergonomic wireless mouse with USB receiver"
}'

# Search with full-text query
curl -X GET 'localhost:9200/products/_search' -H 'Content-Type: application/json' -d '{
  "query": {
    "bool": {
      "must": { "match": { "description": "wireless" } },
      "filter": { "range": { "price": { "lte": 50 } } }
    }
  }
}'

Related on TokRepo

• Database tools -- Search and database engines
• Monitoring tools -- Log analytics and observability

Common pitfalls

• Elasticsearch consumes significant RAM for indexing; allocate at least half of available memory to the JVM heap
• Mapping changes on existing indexes require reindexing; plan your field types carefully before production
• The free tier (Basic license) covers core search; advanced security, cross-cluster replication, and ML features require a paid subscription