Configure event notifications
Learn how to configure event notifications for your S3 bucket to notify Snowpipe when new data is available to load.
Snowflake manages the Snowpipe queues you use. The queue name must be in the required event notification, so when we push any object to the bucket a notification is sent to the SQS queue. Snowpipe then consumes data and it is loaded to a single table. For more information, see topic Introduction to Snowpipe.
To configure event notifications in your Snowflake environment:
- In the worksheet area, run the show pipes command. The value in the notification_channel column is the SQS queue created by Snowflake that is used to create notifications from the S3 bucket. Snowflake then downloads new files when they are available and loads it to the target table.
- Log in to the Amazon S3 console.
- In the Console home page, select S3.
- In the Buckets page, select the name of the bucket that you want to enable events for.
- Select the Properties tab.
- Scroll down to the Event Notifications section and select Create event notification.
- In the Create event notification page, provide the following details for your event notification:
- Name: In the General configuration section, enter a name for the event notification. For example: Auto-ingest Snowflake.
- Event type: In the Event types section, select All object create events.
- Destination: In the Destination section, select SQS queue.
- Specify SQS queue: select Enter SQS queue ARN.
- SQS queue: Enter the value in the notification_channel column from step 1. For example: arn:aws:sqs:us-east-1:713795429718:sf-snowpipe-AIDA2MMMF4VLMNI5KESTV-bHVbiwsnUnY6icU-zr52Q. For more information, see topic Enabling and configuring event notifications.
- Grant the permissions mentioned in Automating Snowpipe for Amazon S3 to complete the configuration.
After you've configured event notifications in the SQS queue, enable error notifications in the SNS queue. The Amazon Simple Notification Service (SNS) web service makes it easy to set up, operate, and send notifications to Snowflake. For more information, see topic Enabling error notifications.