Data projects are an intrinsic part of an organization's technical ecosystem, but data engineers in many companies are still trying to solve problems that others have already solved. This hands-on guide shows you how to provide valuable data by focusing on various aspects of data engineering, including data ingestion, data quality, idempotency, and more.
Author Bartosz Konieczny guides you through the process of building reliable end-to-end data engineering projects, from data ingestion to data observability, focusing on data engineering design patterns that solve common business problems in a secure and storage-optimized manner. Each pattern includes a user-facing description of the problem, solutions, and consequences that place the pattern into the context of real-life scenarios.
Throughout this journey, you'll use open source data tools and public cloud services to see how to put each pattern into practice. You'll learn:
Bartosz Konieczny is a freelance data engineer who's been coding for more than 15 years. He's held various senior hands-on positions that helped him work on many data engineering problems in batch and stream processing.
| ISBN: | 9781098165819 |
| Publication date: | 29th April 2025 |
| Author: | Bartosz Konieczny |
| Publisher: | O'Reilly an imprint of O'Reilly Media |
| Format: | Paperback |
| Pagination: | 340 pages |
| Genres: |
Database design and theory |
Data projects are an intrinsic part of an organization's technical ecosystem, but data engineers in many companies are still trying to solve problems that others have already solved. This hands-on guide shows you how to provide valuable data by focusing on various aspects of data engineering, including data ingestion, data quality, idempotency, and more.
Author Bartosz Konieczny guides you through the process of building reliable end-to-end data engineering projects, from data ingestion to data observability, focusing on data engineering design patterns that solve common business problems in a secure and storage-optimized manner. Each pattern includes a user-facing description of the problem, solutions, and consequences that place the pattern into the context of real-life scenarios.
Throughout this journey, you'll use open source data tools and public cloud services to see how to put each pattern into practice. You'll learn:
Bartosz Konieczny is a freelance data engineer who's been coding for more than 15 years. He's held various senior hands-on positions that helped him work on many data engineering problems in batch and stream processing.
Data Engineering Design Patterns features in the following genres: Database design and theory
Data Engineering Design Patterns is available in Paperback
Data Engineering Design Patterns was written by Bartosz Konieczny and published by O'Reilly an imprint of O'Reilly Media
Data Engineering Design Patterns has 340 pages
£57.59