Advanced Data Engineering with Snowflake Part 2: Observability with Snowflake!
Welcome to Part 2: Observability with Snowflake! In part 2, You'll specifically learn about Snowflake's observability framework, Snowflake Trail, and how to implement its core components. You'll use event tables, logs, and traces to implement detailed records of events occurring within your data pipeline. You'll also learn how to generate alerts to detect specific conditions in your data environment, and how to combine them with notifications to communicate information to key stakeholders, like a broader data engineering team.
By the end of the module, you'll understand how data pipelines can be built collaboratively by large teams, and how they can be evolved efficiently and reliably.
Objectives:
After completing this course, you will be able to:
- •Implement notifications in Snowflake to prompt user action for critical errors detected in the data pipeline.
- •Implement alerts in Snowflake using SQL to monitor data quality, traces using Snowflake-specific telemetry libraries, and logging using language-specific logging libraries.
- •Create and use event tables to capture telemetry data for data pipelines.
- •Understand that Snowflake captures telemetry data based on the OpenTelemetry standard.
- •Know Snowflake's observability framework, Snowflake Trail, and how it encompasses foundational elements of observability in Snowflake, like event tables, alerts, and notifications.
- •Understand how observability can be used to monitor the health and performance of data pipelines.
- •Recall foundational concepts and practices of observability in data engineering.
Audience
- •Technical Sales
- •Consultants
Learning Tracks
Snowflake Learning Journey
You know what you’re looking for, and we have curated paths to help you achieve whatever your learning goals. From skill building badges, to preparation for the SnowPro core certifications we have you covered.
Snowflake Education Services includes Instructor-Led Training, SnowPro Certifications, and this online, on-demand educational courses website. Our on-demand courses are branded as "Snowflake University." Snowflake University (aka Uni) offers a badge program called Hands-On Essentials as well as other courses.