AWS Lambda cannot connect to Kinesis Firehose “Max retries exceeded with url”

Question

I've followed several tutorials and added different IAM configurations and security groups to keep things as open and obvious as possible and nothing has worked. Here is the debug log, and the main error pasted below. Let me know if there's any other data I should add to make this clear.

[DEBUG] 2016-09-22T13:57:40.965Z    5b770867-80cc-11e6-b5b8-018d2de39616    ConnectionError received when sending HTTP request.
Traceback (most recent call last):
File "/var/runtime/botocore/endpoint.py", line 174, in _get_response
proxies=self.proxies, timeout=self.timeout)
File "/var/runtime/botocore/vendored/requests/sessions.py", line 573, in send
r = adapter.send(request, **kwargs)
File "/var/runtime/botocore/vendored/requests/adapters.py", line 419, in send
raise ConnectTimeout(e, request=request)
ConnectTimeout: HTTPSConnectionPool(host='firehose.us-east-1.amazonaws.com', port=443): Max retries exceeded with url: / (Caused by ConnectTimeoutError(<botocore.awsrequest.AWSHTTPSConnection object at 0x7fbbc4c92c10>, 'Connection to firehose.us-east-1.amazonaws.com timed out. (connect timeout=60)'))

Is your Lambda function running inside your VPC? And if so, do you have a NAT Gateway in your VPC? — Mark B
It's in a VPC, but we do not have a NAT. Do I have to send this outside of the VPC to reach Kinesis? I just want it to end up in an RDS instance in the same VPC... I'm looking at changing my lambda function to just insert the records to RDS instead of bothering with kinesis... it was taken me way too long — Caullyn
The Kinesis service isn't running inside your VPC, so yes you have to send the request outside the VPC. You'll need a NAT gateway for that. — Mark B

johni johni · Accepted Answer · 2016-09-23T11:41:13

Please follow my answer in this thread. This will explain how to make lambda contact any service on the internet (such as S3, kinesis and so).

AWS Lambda cannot connect to Kinesis Firehose “Max retries exceeded with url”

2 Answers