There is more to Postgres performance than setting up indexes. — So you have set up your indexes correctly, but your API latency is still high due to the database. What else can you do? Well, you can reduce the number of database calls that you make. Read on. Queries have overhead Many things are going on when you query a database, such as…

The concise guide for getting things done. — Setup Let’s run MongoDB using Docker. docker run --name some-mongo -e MONGO_INITDB_ROOT_USERNAME=mongo -e MONGO_INITDB_ROOT_PASSWORD=root -p 27017:27017 mongo Include the following dependencies in your Rust project. mongodb = "2.5.0" tokio = "1.28.1" serde = { version = "1.0.162", features = ["derive"] } futures = "0.3.28" Here’s why we need them: mongodb is…

It’s not the best tool for the job, but it might be the best for your situation — A message queue is a foundational architectural building block. Typically, it’s used for offloading workloads with high latency and needs resilience. For example, sending a receipt via email when a customer has placed an order. Many queue systems are available: RabbitMQ, Kafka, or Amazon SQS. Using a relational database as…

Foundation and best practices to set up the right indexes for your PostgreSQL database. — PostgreSQL is a popular database that powers big sites like Reddit, Twitch and Spotify. It can house terabytes of data while still providing low query latency. The key to achieve this feat is by having the right indexes. What is an index and how does it work? Instead of jumping to the practical index tips, it’s better to get…

The important things you need to know to get the job done — Setup Let’s first set up a local PostgreSQL so our application can interact with it. For simplicity, we will use Docker. docker run -p 5432:5432 --name some-postgres -e POSTGRES_PASSWORD=mysecretpassword -d postgres This command will set up a PostgreSQL database named “postgres” with the password “mysecretpassword.” The database is accessible via localhost…

Design better systems by understanding the trade-offs and benefits of database replication — Benefits Database replication is a database scale-out approach where the same data is replicated to multiple machines. That sounds wasteful, but it is not without justifiable benefits: High availability and performance improvement. High availability is achieved by having nodes with identical data. If one of the nodes fails, the system will…

A better guideline for choosing your software testing strategy — One of the software engineering practices that I’m against is Software Test Pyramid. The recommendation is along the lines of “do have more isolated tests and fewer integration tests”: Write lots of small and fast unit tests. Write some more coarse-grained tests and very few high-level tests that test your…

See what the data says about the best ways to optimize MySQL bulk inserts. — In Data Science projects, a common last step in the data pipeline is to persist the result into a database (e.g. MySQL). The result of this data pipeline is usually big, so optimizing the writes into the database is important to achieve the acceptable pipeline latency. I’ve benchmarked and analyzed…

The easiest and quickest way to render charts in Laravel apps — People say that a picture is worth a thousand words. That couldn’t be truer for charts, which allow you to condense data into a meaningful message that one can easily digest. In this article, we will discuss how to render charts in a Laravel application. The approach that we will…