Category "selenium"

How to scrape related searches on google?

I'm trying to scrape google for related searches when given a list of keywords, and then output these related searches into a csv file. My problem is getting be

RegistryBasedServlet Equivalent in Selenium 4

With Selenium 3, I was able to create custom servlets that can be configured to be used with Hub and Node. It was possible to extend org.openqa.grid.web.servlet

how to scroll a local div element with selenium

I am trying to scroll through a local div element using driver.find_element_by_xpath(element).send_keys(Keys.PAGE_DOWN) the problem is that element is not an el

On Selenium WebDriver how to get Text from div with Mark Tag

On Selenium Webdriver, how I can retrieve entire text from div with Mark Tag? I need to verify that the word 'correctly' is present. Example HTML code: <div

Pytest hangs indefinitely running tests after Selenium image update

A day ago selenium updated their standalone-images (https://hub.docker.com/search?q=selenium&type=image) and at the same time selenium 4.0.0 was released on

how to run java selnium junit Tests using groovy

I am using ReadyAPI which use Groovy as Scripting language. But, I built a Selenium 4 framework which Tests some IHMs in my work using java8 and Junit4, and it

Python & Selenium: How to get values generated by JavaScript

I use Selenium in Python for scraping. I can't get values though these values are displayed on the browser. So I checked the HTML source code, then I found that

How to extract multiple texts from span elements using python selenium?

I am trying to extract all the texts in span into list, using the following HTML code from Selenium webdriver method: ['1a', '1b', '1c', '2a', ' ', ' ', '3a', '

extracting the desired link and its order from the links taken with selenium

from selenium import webdriver import time driver = webdriver.Chrome("chromedriver.exe") driver.get('https://www.google.com.tr/search?num=100&q=istanbul%20h

Scrape Website that is running meteor, using python requests

You see, there is this website called edabit. All you need to know is that I want to scrape the website without using selenium. I want to learn how. What does s

Why does my Selenium script work only every other time?

I think I should start off by mentioning I have Mac OS and am using Safari browser. This script is a web-scraper that is supposed to search for a given type of

Java.lang.NoClassDefFoundError: junit/framework/TestCase

After upgrading from JUnit 4 to JUnit 5 getting this error when i am trying to run test as JUnit in eclipse. Getting warning: failed to load class 'org.eclipse.

Selenium won't load specific webpages on bet365

I am trying to scrape data from bet365 for basketball odds however I am encountering where certain leagues webpages wont load even when simply just loading the

Automate user action export

I'm using ASP.NET WEBFORMS and Telerik and I want to export a document with Telerik components. I'm doing this with client export manager of Telerik https://dem

Selenium DevTools should log ALL but only logs ERROR and VERBOSE, how come?

I'm currently working on a Selenium project and we've just updated to the most recent version of Selenium. Now I wanted to output the result of my console.log()

Selenium cant find an element unless the page is inspected

I am automating with selenium and noticed something weird, on a specific webpage, there is a ul list containing some li roles that are buttons. For some reason,

Clear CAPTCHA Success From HTML

I'm trying to scrape some site data and have cleared the CAPTCHA I'm triggering manually - however I continue to load the CAPTCHA success page after I close and

Why am I not able to get rid of a context menu with Selenium or brute force Javascript

I have tried just about everything, but I am not able to get rid of the context menu. Steps Right click context menu. Accept alert Try to get rid of the context

Selenium Webhook equivalent / listen to new data from telegram without bot

I have a web scraping project that requires the scraper to wait for when there is new data. I thought about reverse engineering the websocket but that might tak

unable to install pywebview

I try to install pywebview but it just gives me a long error: ERROR: Command errored out with exit status 1: in general, I'm trying to find a way to wrap a webs