Python, Selenium, BS4 - Navigating to the next Page
You don't need to use BeautifulSoup
here. Selenium
is pretty powerful in terms of locating elements.
One option is to keep finding the next page link by id until it is not found:
while True: try: next_button = driver.find_element_by_id('oq-nav-nxt') except NoSuchElementException: break next_button.click()