What is "Error in SQL Launcher" means when using Dataflow SQL UI?

0
votes

I tried to create a Dataflow job using the Dataflow SQL UI. I followed the Using Dataflow SQL Tutorial and the job ran properly. I changed the data source to a BigQuery table. My plan is:

  1. Query from the BigQuery table
  2. Save the result back to a BigQuery Table.

When I creating the dataflow job, I got the error message: Error in SQL Launcer

What does the error mean? Thanks for your help!

1
google-cloud-dataflow
Question: if you need to query a table and save the results to another table, why dont you use the BigQuery engine instead of Dataflow engine? – rmesteves
Thanks for the question, @rmesteves. Yes, you're right. Using BQ engine is the best solution for my plan. But, I just want to learn how to use Dataflow SQL. Is my case plan can't be applied using Dataflow SQL? – coblon
Sure, you can use Dataflow. May you share your query? I would like to see what is going on. Also, can you let me know whether you are using a native table or an external table? – rmesteves
SUPERB!! Thanks @PeterKim. I drop the date_edited column in the SELECT query, change it with cars_type and sum count_search column. It works! – coblon
Also thanks to @rmesteves for your attention to this issue – coblon

1 Answers

1
votes

Dataflow SQL does not yet support the DATE type (there was a bug in the SQL Validator that didn't catch that). Selecting a field with DATE type will cause that NPE error message, and the fix is to only select fields that are supported.