Snowflake Guide

Snowflake Data Warehouse Guide

What and why

Snowflake is our Enterprise Data Warehouse (EDW) and is the core technology in our Enterprise Data Platform.

What does Snowflake Contain?

Snowflake contains all of our analytical data and Data Sources defines the set of original/raw data available.

Logging In

Navigating the UI

The Snowflake Quick Tour of the Web Interface provides comprehensive documentation for the UI.

Snowflake account configuration

ABORT_DETACHED_QUERY

ABORT_DETACHED_QUERY parameter is set on account level to True.

We often have cases where the connectivity was lost and the query keeps trying to run and still does not complete. It is meaningless for the query to keep running in these cases and adds no value. There is a grace period of 5 minutes. If the connectivity isn’t fixed in 5 minutes, it stops the execution so the warehouses won’t be running unnecessarily.

Data Freshness

We leverage automatic monitors in MonteCarlo for monitoring the freshness of the data.

Clustering in Snowflake

Guide for correctly and responsibly using Snowflake's clustering

Snowflake SNS integration for Snowflake SnowPipe and task for failure

Overview

Snowpipe can push error notifications to a cloud messaging service when it encounters errors while loading data i.e. through snowpipe or on failure of snowflake task. The notifications describe the errors encountered in each file, enabling further analysis of the data in the files for snowpipe. Task error notifications trigger a notification describing the errors encountered when a task executes SQL code. The notifications describe any errors encountered during task execution.

Last modified November 14, 2024: Fix broken external links (ac0e3d5e)

View page source - Edit this page - please contribute.