Database - Dan The Engineer

Dan The Engineer

Sign in Subscribe

Database

A collection of 52 posts

Using AWS DMS to Replicate Data from Aurora RDS to CockroachDB

Using AWS DMS to Replicate Data from Aurora RDS to CockroachDB

In this blog I will demonstrate the process of using AWS DMS to aid in a basic migration from Aurora PostgreSQL (RDS) to CockroachDB to simplify your migration needs. Database migration is the process of transferring data from one database to another. There are many reasons why database migration might

How to Choose the Right Database Platform for Your Business: A Guide to Mitigating Risk, Reducing Costs, and Increasing Revenue with CockroachDB

How to Choose the Right Database Platform for Your Business: A Guide to Mitigating Risk, Reducing Costs, and Increasing Revenue with CockroachDB

Selecting the right database platform for your business is crucial for ensuring success in today's digital landscape. As a a leader with intimate knowledge of business fundamentals, you understand that your database is a critical component of your company's infrastructure. It supports critical business functions and enables you to make

Beginners Guide to JSONB in CockroachDB

Beginners Guide to JSONB in CockroachDB

In this blog we will cover the fundamentals of using JSONB in cockroach and some of the common ways to access and match data. This will cover: * Creating tables * Populating data * Select data and subsets of data * Filtering data * Updating data * Matching between tables * Performance tuning * How to making life

Real World Example of a Real time Analytics pipeline using CockroachDB, Kafka and Apache Pinot/Startree.ai

Real World Example of a Real time Analytics pipeline using CockroachDB, Kafka and Apache Pinot/Startree.ai

Real-time analytics are becoming increasingly important for line of business transactional use cases such as fraud detection, real-time personalisation, and real-time inventory management. These use cases require the ability to process and analyse large volumes of data in real-time to make quick, informed decisions. To meet this need, many organisations

CockroachDB: Multi-Region refresher

CockroachDB: Multi-Region refresher

This post will take us through a high-level refresher of what it takes to be a Multi-Region, distributed SQL database and how we achieve this at Cockroach Labs. But first, here is a little bit of information that will allow you to get up and running with CockroachDB and its

Want to speed up your reads?

Want to speed up your reads?

Be a Leader and a Follower :-) In CockroachDB, a follower is a replica of a database that synchronises with the leader to ensure data consistency and availability. The leader is the node that accepts write requests and coordinates updates to the database. The followers replicate the leader's data and

Comparing B-Tree and LSM Index Structures: Pros, Cons, and Use Cases

Comparing B-Tree and LSM Index Structures: Pros, Cons, and Use Cases

Indexes are crucial in the realm of databases for effective data processing and retrieval. An index is a type of data structure that arranges data to make it easier to search, sort, and retrieve information quickly based on certain criteria, like a single value or a range of values. Two

EXPLAIN ANALYZE : What You Need To Know

EXPLAIN ANALYZE : What You Need To Know

CockroachDB is an open-source, distributed SQL database that offers consistent, scalable, and highly available data storage. As with any relational database system, one of the most important tasks for a database administrator or developer is optimizing queries for performance. One tool that can be incredibly helpful for this task is

Ensure 24/7 Availability of Your Retail or E-Commerce Application with CockroachDB: A Resilient, Scalable, and Consistent Database Solution

Ensure 24/7 Availability of Your Retail or E-Commerce Application with CockroachDB: A Resilient, Scalable, and Consistent Database Solution

Retail and e-commerce companies operate in a highly competitive environment where customer satisfaction is the key to success. Customers expect an always-on 24/7 application and website. Any downtime can lead to customer dissatisfaction, loss of revenue, and damage to the brand reputation. To ensure continuous availability of their application

CockroachDB meets the Gaming Industry

CockroachDB meets the Gaming Industry

CockroachDB is proving to be a highly successful database in the world of online gaming. Many games companies support and actively promote the use of CockroachDB to develop your games and store your players "in-play" data and subscription details. Online gaming relies heavily on real-time data processing and storage, which

CockroachDB and the Symfony Framework

symfony framework

CockroachDB and the Symfony Framework

CockroachDB is a distributed SQL database that is designed to be scalable, resilient, and highly available. It is compatible with PostgreSQL, which means that applications built to use PostgreSQL can use CockroachDB as a drop-in replacement with minimal modifications. Symfony, on the other hand, is a popular PHP web application

CockroachDB is a great fit if your business is Logistics

CockroachDB is a great fit if your business is Logistics

When it comes to logistics we see regularly that there is a clear set of priorities that need to managed in order for your business to be successful. These include, keeping transportation costs down as well as keeping up with customer/industry demands. Sourcing consistent, reliable carrier capacity while keeping

The Importance of Encryption for Database Platforms: Protecting Your Data

The Importance of Encryption for Database Platforms: Protecting Your Data

Hello everyone, having worked in the database industry for over 30 years, I know firsthand the importance of protecting your data. One of the most effective ways to do this is through encryption, which transforms sensitive information into a code that only authorised parties can decode. In this blog post,

Reliable banking with CockroachDB

Reliable banking with CockroachDB

There is probably not a day goes by without us accessing our banking apps on our smartphones. Like me, you have probably experienced that time when the app is unavailable to log you in or you have read on social media that a leading high street bank’s payment system

Optimising Performance and Availability with CockroachDB Monitoring Tools

Optimising Performance and Availability with CockroachDB Monitoring Tools

In my experience as a seasoned Database Administrator and Engineer, monitoring tools play a crucial role in the efficient maintenance of databases. With the aid of these technologies, administrators can enhance the performance of their systems, spot problems early, fix them, and ultimately give users better services. A database that

CockroachDB and the RAFT Protocol

CockroachDB and the RAFT Protocol

CockroachDB is a Survivable, Thriveable and Scalable distributed SQL database. A winning formula for modern, mission critical applications at scale. To maintain its goal of being all three it uses the RAFT protocol to align and agree on one single state So, what is RAFT? The RAFT protocol is a

Serialisable Isolation doesn't have to mean slower!

Serialisable Isolation doesn't have to mean slower!

We recently came across a scenario where the assumption was that a current production workload needed to rely on Read Committed isolation to support lower latency requests to and from the database. This assumption albeit it correct made us think. If you can utilise only Serialisable Isolation due to consistency

Synthetic vs Non-Synthetic Benchmarking: Understanding the Difference

Synthetic vs Non-Synthetic Benchmarking: Understanding the Difference

As technology advances, businesses are finding themselves dealing with massive amounts of data. Databases play a significant role in storing and managing this data, and businesses need to ensure their databases perform optimally. Benchmarking is one way to assess the performance of a database, and there are two types of

Getting to know the CockroachDB 'demo' feature

Getting to know the CockroachDB 'demo' feature

Getting started with CockroachDB demo Prerequisite Download the CockroachDB binary from this location (MacOS, Linux or Windows available) What is the CockroachDB demo? The cockroach demo command starts a temporary, in-memory CockroachDB cluster of one or more nodes, with or without a preloaded dataset, and opens an interactive SQL shell

CockroachDB : The multi-region database

CockroachDB : The multi-region database

CockroachDB is a distributed database that you can span across multiple geographic regions. To provide this multi-region capability, CockroachDB uses a combination of techniques such as data replication, distributed consensus, and node replication. 1. Data Replication: CockroachDB automatically replicates data across multiple regions to ensure that data is available even