Stack Overflow
Stack Overflow

Questions tagged [rselenium]

The goal of RSelenium is to make it easy to connect to a Selenium Server/ Remote Selenium Server from within R. RSelenium provides R bindings for the Selenium Webdriver API. Selenium is a project focused on automating web browsers. RSelenium allows you to carry out unit testing and regression testing on your webapps and webpages across a range of browser/OS combinations.

The goal of RSelenium is to make it easy to connect to a Selenium Server/ Remote Selenium Server from within R. RSelenium provides R bindings for the Selenium Webdriver API.

Selenium is a project focused on automating web browsers. See http://docs.seleniumhq.org/

RSelenium allows you to carry out unit testing and regression testing on your webapps and webpages across a range of browser/OS combinations. This allows us to integrate from within R testing and manipulation of popular projects such as shiny, sauceLabs.

Selenium Server is a standalone java program which allows you to run HTML test suites in a range of different browsers, plus extra options like reporting.

See vignette for more details- http://cran.r-project.org/web/packages/RSelenium/vignettes/RSelenium-basics.html

714 questions
5
votes
0 answers

Cannot start a session with phantomjs in RSelenium

Cannot start a new session with phantomjs using rsDriver. Other browsers work fine, but when i try the option of phantomjs it does not work and I cannot fully grasp the meaning of the output of the error. How can I solve…
John Doe
  • 386
  • 8
  • 24
5
votes
0 answers

Faster alternative to Rselenium

I am creating a scraper for this page: https://www.oddsportal.com. Since the page use javascript rendering I decided for Rselenium. My aim is to scrape odds for each match played in this year. I use login form for the page since I set my own…
Tomas
  • 83
  • 5
5
votes
0 answers

Setting proxy in RSelenium with Chrome

How can I setup RSelenium (via Chrome) to use a proxy server with username/password authentication? This is what I have so far (where ip, port, username and password get replaced by actual values). ## Run the Selenium server selServ <-…
Adam
  • 1,377
  • 11
  • 23
5
votes
1 answer

Scrolling to an element and clicking on it

I am trying to web scrape the data from the Flipkart site. The link for the webpage is as follows: https://www.flipkart.com/mi-a1-black-64-gb/product-reviews/itmexnsrtzhbbneg?aid=overall&pid=MOBEX9WXUSZVYHET I need to automate navigation to the NEXT…
Sana Ansari
  • 111
  • 4
5
votes
1 answer

Run yaml file for parallel selenium test from R or python

I have a simple yaml file: seleniumhub: image: selenium/hub ports: - 4444:4444 firefoxnode: image: selenium/node-firefox-debug ports: - 4577 links: - seleniumhub:hub chromenode: image:…
Mislav
  • 1,393
  • 10
  • 29
5
votes
2 answers

Chrome hangs/self closes when using RSelenium (Using R)

Trying to convert a python project (that uses selenium to scrape twitter tweets without using the limited twitter api) into R programming. Works fine in Python but I want to recreate it in R. New to R but i have some MatLab experience if it…
user3120554
  • 511
  • 1
  • 8
  • 18
5
votes
1 answer

RSelenium through docker

My OS is windows 8.1 and I have the version 3.3.3 of R. I have installed the RSelenium packages and I try to run it using this: library("RSelenium") #start RSelenium server startServer() checkForServer() and I receive this error: Error:…
Keri
  • 343
  • 1
  • 3
  • 12
5
votes
1 answer

Scrape website with R by navigating doPostBack

I want to extract a table periodicaly from below site. price list changes when clicked building block names(BLOK 16 A, BLOK 16 B, BLOK 16 C, ...) . URL doesn't change, page changes by…
Selcuk Akbas
  • 609
  • 1
  • 8
  • 18
5
votes
1 answer

R Change IP Address programmatically

Currently changing user_agent by passing different strings to the html_session() method. Is there also a way to change your IP address on a timer when scraping a website?
tonyk
  • 308
  • 4
  • 19
5
votes
3 answers

Parse HTML and Read HTML Table with Selenium Python

I am converting some of my web-scraping code from R to Python (I can't get geckodriver to work with R, but it's working with Python). Anyways, I am trying to understand how to parse and read HTML tables with Python. Quick background, here is my code…
d84_n1nj4
  • 1,255
  • 5
  • 18
  • 32
5
votes
1 answer

RSelenium: Find link with Xpath

I want to find all links to PDF files in a page with RSelenium and Xpath. Please consider require(RSelenium) RSelenium::checkForServer() RSelenium::startServer() remDr <-…
CptNemo
  • 5,805
  • 14
  • 46
  • 95
5
votes
2 answers

RSelenium UnknownError - java.lang.IllegalStateException with Google Chrome

I am running the following script based on the RSelenium Basics CRAN page: library(RSelenium) startServer(args = c("-port 4455"), log = FALSE, invisible = FALSE) remDr <- remoteDriver(browserName = "chrome") remDr$open() This produces the following…
hfisch
  • 1,232
  • 3
  • 20
  • 33
5
votes
2 answers

inconsistent behavior in RSelenium

On Linux, the RSelenium/Selenium seems to be behaving erratically. I start the server manually and it seems to start up fine. Sometimes I am able to connect to it from my R session and other times I get an error. I cannot yet pinpoint the cause: the…
Alex
  • 17,745
  • 33
  • 112
  • 182
4
votes
2 answers

Setting geolocation in Firefox using RSelenium

I am using RSelenium on my EC2 server for several projects. I am trying to set automatically the location in the parameters of my Firefox profile but I am not sure of where and how to include them. I would assume somewhere in the makeFirefoxProfile…
ML_Enthousiast
  • 709
  • 9
  • 26
4
votes
1 answer

RSelenium with RSDriver. Error: httr output: Failed to connect to localhost port 4445: Connection refused

I am trying to use RSelenium for webscraping. I am following the basics tutorial as explained on cran. The recommended approach is to install Docker (see tutorial as well as this stackoverflow answer). If I understand correctly, this is not an…
eigenvector
  • 245
  • 1
  • 2
  • 9
1 2
3
…
47 48