'Selenium - clicking page number changes page but does not reload/populate data

I'm trying to scrape usercomments (see disclaimer below). The comments are organized with the following pagination

pagination

Im getting the different numbered elements and just clicking on the next button >. The page does change, but the new data does not populate and it looks like this

enter image description here

Here is a short excerpt of the code:

from selenium import webdriver
from selenium.webdriver.common.by import By
import time
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

DRIVER_PATH = '***/chromedriver.exe'
driver = webdriver.Chrome(executable_path=DRIVER_PATH)  # depreciation, update!

URL = "https://www.kbb.com/mercedes-benz/cla/2018/consumer-reviews/"
driver.get(URL)
time.sleep(5)
button = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.XPATH, '//button[@class="css-kazo96-NavButton-defaultState-activeState-focusState ehp7fkv0"]')))
button.click()

WebDriverWait(driver, 50)
   
# driver.close()

What can I do to make the fields reload properly? I appreciate all the info I can get :- )

Disclaimer: This is a first test for a research project, there will be no illegal scraping without permission or any missuse of data!



Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source