Open in app

Sign In

Write

Sign In

Yitaek Hwang
Yitaek Hwang

9.95K Followers

Home

About

Published in

ITNEXT

·Pinned

Migrating from Relational Databases to Time Series Databases

More than 50 years after their inception, relational databases remain popular as ever to model, manage, and process data. In fact, 7 of the top 10 most popular database management systems are relational databases, including MySQL, SQL Server, and PostgreSQL. The rationale for the popularity is clear: There is a…

Database

6 min read

Migrating from Relational Databases to Time Series Databases
Migrating from Relational Databases to Time Series Databases
Database

6 min read


Published in

ITNEXT

·Pinned

Kubernetes Sandbox Environments with Virtual Clusters

Achieving strong isolation without sacrificing resource utilization with Virtual Clusters. Kubernetes is eating the cloud-native world. In the most recent Cloud Native Computing Foundation (CNCF) Annual Survey, 96% of organizations reported being either using or evaluating Kubernetes, up from 83% in 2020 and 78% in 2019. It is also estimated…

Kubernetes

5 min read

Kubernetes Sandbox Environments with Virtual Clusters
Kubernetes Sandbox Environments with Virtual Clusters
Kubernetes

5 min read


Published in

Towards Data Science

·Pinned

Data Integration Strategies for Time Series Databases

Exploring popular data integration strategies for TSDBs including ETL, ELT, and CDC — As digital transformation reaches more industries, the number of data points generated is growing exponentially. As such, data integration strategies to collect such large volumes of data from different sources in varying formats and structures are now a primary concern for data engineering teams. …

Time Series Database

6 min read

Data Integration Strategies for Time Series Databases
Data Integration Strategies for Time Series Databases
Time Series Database

6 min read


Published in

Geek Culture

·Pinned

A Practical Guide to Improving the Developer Experience with Kubernetes at Startups

Reducing the “Kubernetes tax” for startups without a dedicated platform engineering or developer experience team. Let’s face it. Kubernetes is still not easy in 2023. Despite years of development and innovation, Kubernetes remains a challenge for small teams. For non-infrastructure engineers not living and breathing Kubernetes every day, there is…

Kubernetes

5 min read

A Practical Guide to Improving the Developer Experience with Kubernetes at Startups
A Practical Guide to Improving the Developer Experience with Kubernetes at Startups
Kubernetes

5 min read


Published in

ITNEXT

·Pinned

How to Design and Provision a Production-Ready EKS Cluster

A comprehensive guide to create and configure a production-grade Kubernetes cluster on AWS with Terraform, Helm, and other open-source tools. According to Flexera’s 2021 State of Cloud report, AWS leads the container orchestration market share with 51% of the respondents using Amazon EKS and ECS compared to 43% for AKS…

Kubernetes

8 min read

How to Design and Provision a Production-Ready EKS Cluster
How to Design and Provision a Production-Ready EKS Cluster
Kubernetes

8 min read


Published in

Dev Genius

·Jan 27

Deploying HarperDB on AWS and GCP

Diving into a distributed database platform designed for the edge on AWS and GCP. I recently came across an interesting database called HarperDB that aims to simplify most database operations that developers have trouble with while maintaining high performance (e.g., changing schemas over time, performance degradation with multi-region, etc). HarperDB…

Database

7 min read

Deploying HarperDB on AWS and GCP
Deploying HarperDB on AWS and GCP
Database

7 min read


Published in

Dev Genius

·Jan 10

Introducing the QuestDB Kafka Connector

A more performant change data capture (CDC) setup to stream data from Kafka to QuestDB leveraging the InfluxDB line protocol. Back in 2021, I wrote about a reference architecture for streaming realtime cryptocurrency prices with Kafka and QuestDB. That project polled the public Coinbase API for the price of various…

Questdb

4 min read

Introducing the QuestDB Kafka Connector
Introducing the QuestDB Kafka Connector
Questdb

4 min read


Published in

Level Up Coding

·Dec 26, 2022

Change Data Capture with QuestDB & Debezium

Streaming data into QuestDB with change data capture via Debezium and Kafka Connect. Modern data architecture has largely shifted away from the ETL (Extract-Transform-Load) paradigm to ELT (Extract-Load-Transform) where raw data is first loaded into a data lake before transformations are applied (e.g., aggregations, joins) for further analysis. Traditional ETL…

Timeseries

11 min read

Change Data Capture with QuestDB & Debezium
Change Data Capture with QuestDB & Debezium
Timeseries

11 min read


Published in

Dev Genius

·Nov 1, 2022

Data Lifecycle with QuestDB

For most applications dealing with time series data, the value of each data point diminishes over time as the granularity of the dataset loses relevance as it gets stale. For example, when applying a real-time anomaly detection model, more granular data (e.g., data collected at second resolution), would yield better…

Data Science

5 min read

Data Lifecycle with QuestDB
Data Lifecycle with QuestDB
Data Science

5 min read


Published in

Level Up Coding

·Oct 20, 2022

Lessons Learned from Upgrading to PostgreSQL 13

Documenting performance improvements with VACUUM, ANALYZE, and REINDEX as well as some AWS RDS surprises. With the PostgreSQL community planning to deprecate support for PostgreSQL 10 after November 10, 2022 and AWS RDS following suit in April 17, 2023, I was recently tasked with upgrading our database to PostgreSQL 13…

AWS

4 min read

Lessons Learned from Upgrading to PostgreSQL 13
Lessons Learned from Upgrading to PostgreSQL 13
AWS

4 min read

Yitaek Hwang

Yitaek Hwang

9.95K Followers

Software Engineer at NYDIG writing about cloud, DevOps/SRE, and crypto topics: https://yitaekhwang.com

Following
  • Marcin Cuber

    Marcin Cuber

  • Mark Helfman

    Mark Helfman

  • Tom Harrison

    Tom Harrison

  • Aaron Dinin, PhD

    Aaron Dinin, PhD

  • Offchain Labs

    Offchain Labs

See all (307)

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech