Web API to Google Cloud Pub Sub

1
votes

I'm new to google cloud technologies. If I have a streaming web API online where I want to access JSON data from and write it into Cloud Pub/Sub, Do I need to create a python app engine or something that reads that Web API and writes the data into Cloud Pub/Sub or is there an easier way? Basically just poling a web API and getting JSON data.

1
google-cloud-platformgoogle-cloud-pubsub
You can directly steam your json data into Cloud Pub/Sub, no need to create anything extra to read the Web API and writes the data. – JL-HaiNan
@JL-HN How so? Like this sample? cloud.google.com/appengine/docs/flexible/python/… – Colman

1 Answers

1
votes

There's multiple ways that this could be achieved:

Cloud Function: With the help of triggers, you could have the cloud function grab the data and write it to pub/sub using its API Service. Cloud functions uses a Nodejs runtime so you will need to use javascript to code the function.

Direct Stream: You can altogether skip the extra work and simply adapt your web service to use the Pub/Sub API service and write the data directly to it.

You can look into the Pub/Sub Client API Documentation which offer sample and guidance on how to properly use the API.

Hope this is helpful.