'How can I get Selenium to keep pulling down vertical scroll bar in element?

So I am trying to get Selenium to keep pulling down vertical scroll bar in an element, see here. Vertical scrolling

enter image description here

This is the code I have been using, it does work - However when most is loaded, it just suddenly stops and keep loading further followers in Instagram

def _get_names(self):
    sleep(2)
    scroll_box = self.driver.find_element(By.XPATH, "/html/body/div[6]/div/div/div/div[3]")
    last_ht, ht = 0, 1
    while last_ht != ht:
        last_ht = ht
        sleep(1)
        ht = self.driver.execute_script("""
            arguments[0].scrollTo(0, arguments[0].scrollHeight); 
            return arguments[0].scrollHeight;
            """, scroll_box)
    links = scroll_box.find_elements_by_tag_name('a')
    names = [name.text for name in links if name.text != '']
    # close button
    self.driver.find_element(By.XPATH, "/html/body/div[4]/div/div[1]/div/div[2]/button")\
        .click()
    return names

Which then means, it is not checking all Followers, as it stops scrolling.



Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source