31
votes

I have this code:

keys_file = open("keys.json")
keys = keys_file.read().encode('utf-8')
keys_json = json.loads(keys)
print(keys_json)

There are some none-english characters in keys.json. But as a result I get:

[{'category': 'мбт', 'keys': ['Блендер Philips',
'мультиварка Polaris']}, {'category': 'КБТ', 'keys':
['холод ильник атлант', 'посудомоечная
машина Bosch']}]

what do I do?

1
What do you want to do? Remove non-ASCII characters? - MarkWeston
I want to display them to normal language not list of rundom not understandable symbols - user2950593
@user2950593 You've specified the utf-8 encoding. Is that the encoding of the file? - freakish
what is the encoding of "keys.json", utf-8? - georgexsh
@Stefan Okay, a little bit of back-pedalling here. By default it is decoded, yes. It depends on what it is decoded as (whatever locale.getpreferredencoding() returns) is what I should have said. Additionally I wasn't really advocating that OP call decode, I wanted to point out that they're doing the logically wrong operation to begin with. - deceze♦

1 Answers

80
votes

encode means characters to binary. What you want when reading a file is binary to characters → decode. But really this entire process is way too manual, simply do this:

with open('keys.json', encoding='utf-8') as fh:
    data = json.load(fh)

print(data)

with handles the correct opening and closing of the file, the encoding argument to open ensures the file is read using the correct encoding, and the load call reads directly from the file handle instead of storing a copy of the file contents in memory first.

If this still outputs invalid characters, it means your source encoding isn't UTF-8 or your console/terminal doesn't handle UTF-8.