Member-only story
Rust in the real world: Super fast data ingestion using ScyllaDB
This article is the first part of a series (part 2 & part 3)of articles where I will show real world use cases implemented using Rust alongside some other key technologies. The goal is to prove Rust can be used safely for production workloads and that to do so is relatively simple. I hope that at the end of the series, you will be confortable using Rust alongside other technologies such as ElasticSearch, Kafka, Pulsar, S3 and many more, so you can introduce Rust in your current company, and just by doing so, you can gain 3–5x performance boost and reduce the number of bugs while keeping costs at a minimum!
In this article I will walk you through a real world example of a full blown application (microservice) which showcases the following capabilities:
- Creating ultra fast REST APIs using Actix Web Framework in Rust.
- Reading and parsing Big Data files from AWS S3.
- Fast data ingestion from S3 into ScyllaDB (Cassandra compatible super fast NoSQL database).
- Graph data modeling in a NoSQL database.
- Writing highly asynchronous concurrent applications using Tokio.
- Best cloud native practices: multi-stage docker build, Kubernetes, microservices, etc.
