Using AWS X-Ray within a Glue Python Shell Job

0
votes

Is it possible to use x-ray patching for boto3 within a Glue python shell job using the standard deployed environment?

The aws-xray-sdk library is not in the list of supported libraries. But not including the ability to instrument boto3, which is in the supported library list, would seem like a glaring omission.

Thank you in advance for your consideration and response.

1
pythonamazon-web-servicesboto3aws-glueaws-xray
Have you tried using easy install inside your python shell job and pass aws-xray-sdk as explained in stackoverflow.com/a/54852126/4326922 ? - Prabhakar Reddy

1 Answers

1
votes

You can try the easy install method suggested by Prabhakar to include the aws-xray-sdk in your glue job. But the SDK needs the X-Ray Daemon to send data to the AWS X-Ray service. You'll need to spin up the daemon and have its host and port open to receive segments from your glue job. You'll also need to set the AWS_XRAY_DAEMON_ADDRESS env var to the daemon's address.