Leonard, Sev
Cost-Effective Data Pipelines: Balancing Trade-Offs When Developing Pipelines in the Cloud
- ISBN 13:
- 9781492098645
- author:
- Leonard, Sev
- format:
- Paperback
- publisher:
- O'Reilly Media
- language:
- English
- Publication Year:
- 2023
- Pages:
- 286
- Dimensions:
- 23.3 x 17.8 x 1.5 centimetres (0
- Genre:
- Computers
- Condition:
- New
- Availability:
- Item usually sent within 10 working days
Description
Designing Scalable Data Pipelines in the Cloud: A Practical Guide Sev Leonard provides a holistic approach to designing scalable data pipelines in the cloud. This practical guide helps you navigate cost/performance trade-offs and choose and configure compute and storage, while also picking up best practices for code development, testing, and monitoring. By focusing on the entire design process, you'll be able to deliver cost-effective, high-quality products. You'll learn how to reduce cloud spend with lower cost cloud service offerings and smart design strategies, minimize waste without sacrificing performance by rightsizing compute resources, and set up development and test environments that minimize cloud service dependencies. You'll also create data pipeline code bases that are testable and extensible, fostering rapid development and evolution, and improve data quality and pipeline operation through validation and testing.