0
votes

I'm using KNIME's Database Connection & Database Writer in combination with Simba's JDBC driver to try uploading a dataset as a BigQuery table.

However, I don't get it working. For example, I don't know where to specify a BiqQuery dataset. Do I have to add it in the connection URL in the Database Connection node? And if so, do I need a new parameter?

Does someone has experience uploading data from KNIME to BigQuery or knows a workaround, for example with GCS?

1

1 Answers

0
votes

when you download SIMBA driver you will find within folder pdf file named Simba JDBC Driver for Google BigQuery Install and Configuration Guide. There you will find that connection URL depends on Authentication type you use. You will see that you do not specify dataset in Database Connection node but only ProjectId. Within Database Writer node you will specify dataset and table.

Here you can find more on loading data in BigQuery: https://cloud.google.com/bigquery/docs/loading-data

From my experience I did not find it easy to load data into BigQuery anyhow.