Member-only story
Rust in the real world: Super fast data indexing with ElasticSearch
This article is a continuation of my previous article where I talked about Rust and ScyllaDB. (Part 3 of the series is here)
This article is the second part of a series of articles where I will show real world use cases implemented using Rust alongside some other key technologies. The goal is to prove Rust can be used safely for production workloads and that to do so is relatively simple. I hope that at the end of the series, you will be comfortable using Rust alongside other technologies such as ElasticSearch, Kafka, Pulsar, S3 and many more, so you can introduce Rust in your current company, and just by doing so, you can gain 3–5x performance boost and reduce the number of bugs while keeping costs at a minimum!
In this article, I will walk you through a real world example of a full blown application (microservice) which showcases the following capabilities:
- Creating ultra fast REST APIs using Actix Web Framework in Rust.
- Reading and parsing Big Data files from AWS S3.
- Fast data ingestion from S3 into ScyllaDB (Cassandra compatible super fast NoSQL database).
- Graph data modeling in a NoSQL database.
- Indexing massive amounts of data into ElasticSearch using the bulk api and…