Python, Selenium, BS4 - Navigating to the next Page Python, Selenium, BS4 - Navigating to the next Page selenium selenium

Python, Selenium, BS4 - Navigating to the next Page


You don't need to use BeautifulSoup here. Selenium is pretty powerful in terms of locating elements.

One option is to keep finding the next page link by id until it is not found:

while True:    try:        next_button = driver.find_element_by_id('oq-nav-nxt')    except NoSuchElementException:        break    next_button.click()