Loading Files from a Named External Stage vs External Location

0
votes

We have our data files as JSON on GCP Cloud Storage.

Which of the below 2 approach is the ideal/efficient way to load it to snowflake existing table

  1. Use GCS as Named External Stage
  2. Use GCS as External Location to load data

If (1), then should we go for Calling Snowpipe REST Endpoints to Load Data ?

1
snowflake-cloud-data-platform

1 Answers

1
votes

the "efficiency" is pretty much the same for either method, but I'd strongly recommend going the route of Auto Ingest Snowpipe, as outlined in this link:

https://docs.snowflake.com/en/user-guide/data-load-snowpipe-auto-gcs.html

This works really well and allows for a "set it and forget it" type of project.

I hope this helps...Rich

p.s. If this (or another) answer helps you, please take a moment to "accept" the answer that helped by clicking on the check mark beside the answer to toggle it from "greyed out" to "filled in".