Aws Glue Etl - no module named dynamicframe

Question

I have a problem trying to execute aws example fro Aws Glue Etl - locally

after read all those steps: https://docs.aws.amazon.com/glue/latest/dg/dev-endpoint-tutorial-local-notebook.html

and create my endpoints into aws glue. When i try to execute this code:

%pyspark
import sys
from awsglue.transforms import *
from awsglue.utils import getResolvedOptions
from pyspark.context import SparkContext
from awsglue.context import GlueContext
from awsglue.job import Job


# sc = SparkContext()
#glueContext = GlueContext(sc)

glueContext = GlueContext(SparkContext.getOrCreate())
spark = glueContext.spark_session




persons = glueContext.create_dynamic_frame.from_catalog(
        database="sampledb",
        table_name="avro_avro_files"
    )


print(persons.count())
persons.printSchema()

I have this error:

File "/usr/share/aws/glue/etl/python/PyGlue.zip/awsglue/__init__.py", line 13, in <module>
    from dynamicframe import DynamicFrame
ImportError: No module named 'dynamicframe'

And i don't know how solve this problem

i'm have zeppeling0.7.3 config locally.

the idea with the code showed before is , get this result:

2019-04-01 11:37:22 INFO avro-test-bo: Test log message
Count: 5
root
|-- name: string
|-- favorite_number: int
|-- favorite_color: string

Julio Julio · Accepted Answer · 2019-04-24T10:09:59

Hello finally i get the answer here

the problem is when i create my endpoint , i create it just on a private network. After create a new endpoint with public network. this error was solved.

Thanks for the help for everybody

Regards

Aws Glue Etl - no module named dynamicframe

2 Answers