Questions tagged [scraper]

Synonym of [web-scraping]

Synonym of : Let's [scrape] these tags off the bottom of our shoe

366 questions
4
votes
1 answer

Python + Mechanize not working with Delicious

I'm using Mechanize and Beautiful soup to scrape some data off Delicious from mechanize import Browser from BeautifulSoup import BeautifulSoup mech = Browser() url = "http://www.delicious.com/varunsrin" page = mech.open(url) html =…
varunsrin
  • 850
  • 2
  • 15
  • 24
4
votes
2 answers

delay in a for loop for http request

I am just getting started with JS and Node.js. I am trying to build a simple scraper as first project, using Node.js and some modules such as request and cheerio. I would like to add a 5 secs delay between each http request for each domain contained…
ale
  • 41
  • 1
  • 5
4
votes
1 answer

Python selenium get inside a #document

How can I keep looking for elements in a #document: