Problems with RSelenium
In the end, I could solve the issue using Docker. The following https://cran.r-project.org/web/packages/RSelenium/vignettes/RSelenium-docker.html gives good information on how to proceed. The script works fine and does not stop (for now, I tested for about 100 pages, and launched the loop this morning). It is still running and will take probably more than a day to finish. I could not solve the issue using rsDriver, it would always stop with the error Error in subprocess::spawn_process(tfile, ...) : could not create a pipe: system error message could not be fetched
I have no idea why. Even though I solved my problem and can again run my script, I would appreciate if anyone would know the reason why rsDriver() was not doing the job.