how to copy data from internal stage to snowflake table continuously?

Question

I have loaded data in internal/names stage in snowflake and now want to copy data from internal stage to snowflake table continuously. I read that continuous load via snowpipe is supported only for external stage and not for internal stage. So what is the way to load data from internal stage to snowflake table continuously?

Thanks in advance. Amrita

Answer 1

I think you can use Snowpipe but you'll need to call the REST API for Snowpipe to load the data.

Have you considered simply running a COPY statement immediately after you run the PUT command to get the file into the table?

Answer 2

Try using Tasks and Schedule it for every 5 mins.

// Task DDL
CREATE OR REPLACE TASK MASTER_TASK
    WAREHOUSE  = LOAD_WH
    SCHEDULE = '5 MINUTE'
    AS 
    COPY INTO STAGE_TABLE
    FROM @STAGE;

You can always change the frequency based on your requirement. Refer to this Documentation
For External Stage, please refer this link