0

I am trying to scrape data from a website with python3. The website contains data on players from a champion based FPS multiplayer game named "Paladins". I wanted to get the champion based stats of a player as shown in the website. The problem I'm facing is, when I inspect the page source with Chrome, I get this code which contains "table" tag and is clean and I could scrape it easily:

INSPECTED CODE (my gist link)

but when I make the soup object, I get a different code. and when I went over to the page source, it was the same as the soup. there was no tag there in the page source. (you may check the page source for a better understanding).

Now how may I scrape champion-wise data from the website? I am using requests and beautifulsoup for python3

import requests as req
import bs4
res = req.get('http://paladins.guru/profile/pc/Encrytedbro/champions')
soup = bs4.BeautifulSoup(res.text, "lxml")
soup.select('#root')

It is giving me this result: HERE'S A LINK TO MY GIST And i have no idea how to get the data out of there.

Vadim Kotov
  • 7,103
  • 8
  • 44
  • 57
Akib Sadmanee
  • 99
  • 10

1 Answers1

-2

I think you're getting error because you are using wrong parser, you should use html.parser instead of lxml

soup = bs4.BeautifulSoup(res.text, "html.parser")

hope this solves the problem

Giorgi Jambazishvili
  • 683
  • 5
  • 13