Loading a json file in python

Question

I've got multiple file to load as JSON, they are all formatted the same way but for one of them I can't load it without raising an exception. This is where you can find the file:

File

I did the following code:

def from_seed_data_extract_summoners():
   summonerIds = set()
   for i in range(1,11):
       file_name = 'data/matches%s.json' % i
       print file_name
       with open(file_name) as data_file:    
           data = json.load(data_file)
       for match in data['matches']:
           for summoner in match['participantIdentities']:
               summonerIds.add(summoner['player']['summonerId'])
   return summonerIds

The error occurs when I do the following: json.load(data_file). I suppose there is a special character but I can't find it and don't know how to replace it. The error generated is:

UnicodeDecodeError: 'utf8' codec can't decode byte 0xeb in position 6: invalid continuation byte

Do you know how I can get ride of it?

Yonatan Kiron · Answer 1 · 2016-06-27T14:27:36.320

2

replace file_name = 'data/matches%s.json' % i with file_name = 'data/matches%i.json' % i
the right syntax is data = json.load(file_name) and not -

with open(file_name) as data_file: data = json.load(data_file)

EDIT:

def from_seed_data_extract_summoners():
 summonerIds = set()   
   for i in range(1,11):
        file_name = 'data/matches%i.json' % i
        with open(file_path) as f:
            data = json.load(f, encoding='utf-8')
        for match in data['matches']:
            for summoner in match['participantIdentities']:
                summonerIds.add(summoner['player']['summonerId'])    
    return summonerIds

edited Jun 27 '16 at 14:27

answered Jun 27 '16 at 13:34

Yonatan Kiron

2,148
16
24

I did the change and get the following error: AttributeError: 'str' object has no attribute 'read' – mel Jun 27 '16 at 13:41
1

I will rewrite my answer for you – Yonatan Kiron Jun 27 '16 at 13:56
1

Also take a look at https://docs.python.org/2/library/json.html#json.load and https://docs.python.org/2/library/json.html#json.load @mel – Yonatan Kiron Jun 27 '16 at 14:01

score 2 · Answer 2 · edited May 23 '17 at 11:52

2

Your JSON is trying to force the data into unicode, not just a simple string. You've got some embedded character (probably a space or something not very noticable) that is not able to be forced into unicode.

How to get string objects instead of Unicode ones from JSON in Python?

That is a great thread about making JSON objects more manageable in python.

edited May 23 '17 at 11:52

Community

1
1

answered Jun 27 '16 at 13:34

rob

1,657
1
18
34

score 1 · Answer 3 · edited Jun 27 '16 at 14:41

1

try :

json.loads(data_file.read(), encoding='utf-8')

edited Jun 27 '16 at 14:41

Yonatan Kiron

2,148
16
24

answered Jun 27 '16 at 13:36

Loïc

10,366
1
26
42

I got the following: 'ascii' codec can't decode byte 0xc3 in position 16260798: ordinal not in range(128) – mel Jun 27 '16 at 13:38

score 1 · Accepted Answer · answered Jun 27 '16 at 13:43

1

Try:

json.loads(unicode(data_file.read(), errors='ignore'))

or :

json.loads(unidecode.unidecode(unicode(data_file.read(), errors='ignore')))

(for the second, you would need to install unidecode)

answered Jun 27 '16 at 13:43

ntg

9,002
6
48
73

Loading a json file in python

4 Answers4