Category "puppeteer"

Cannot query clipboard when running puppeteer in headless mode

The code below works when puppeteer runs with { headless: false } but fails when it's true. The error is DataError: No valid data on clipboard.. Why is this hap

puppeteer page.evaluate() returns empty object

I am trying to scrape this web https://poe.ninja/challenge/builds?time-machine=day-6 using Puppeteer. I tried Puppeteer page.evaluate querySelectorAll return em

Puppeteer Scrolling And Clicking Selectiors with Same Class names

I'm quiet new to Puppeteer and NodeJs, so im trying to scrape a certain website where there are multiple posts that has this List element on clicking on it the

Puppeteer - How to use page.click() inside page.evaluate()

I am scraping a table and each row has a button to show a modal with information. I need to scraping the information from the modal for each row but I dont know

Why isn't Puppeteer page.click waiting (maybe Browserless?)

Goal: I have a page that I need to get html from after first clicking something on the page. Issue: The html that comes back is not waiting for that element cli

What is causing Error TypeError: text is not iterable? - Web scraper Puppeteer NodeJs

I am learning nodejs/puppeteer and having issues getting Puppeteer to fill UPC numbers from a CSV file onto the search bar of a book website. I managed to get a

Get Puppeteer Page/Frame Handle for new page after `ElementHandle.click()`

Using puppeteer, I have a specific page that I am web-scraping for data and screenshot-ing for proof that the data is correct. The web page itself includes a bu

Puppeeteer hangs when multiple instances of node are run

We have a node application which will launch a web application using puppeteer and take multiple screen shots to create a pdf file. This node application is lau

How can I get an element by xpath?

I need to find any element in DOM by xpath. I already tried the following: let el = await page.$x('//*[@id="readium-right-panel"]/ul/li[1]'); The returning e

Puppeteer not giving accurate HTML code for page with shadow roots

I am trying to download the HTML code for the website intersight.com/help/. But puppeteer is not returning the HTML code with hrefs as we can see in the page (e

Selecting value in drop down list in Chrome recorder

I am trying to record a web workflow using the Chrome inbuilt recorder. When selecting a value from a drop down list, the following code is generated. "type":

Return observable while doing task - Firebase Functions

I have a function in my Firebase Cloud Functions that needs to run a scraping task. While the function is scraping the public website I need to return to the co

How to get children of elements by Puppeteer

I understand that puppeteer get its own handles rather than standard DOM elements, but I don't understand why I cannot continue the same query by found elements

Disk usage is increasing with puppeteer - chromium installed using snap

I have installed chromium using snap install chromium on my Ubuntu server with Arm cpu because when I wanted to install puppeteer using npm it throwed errors, I

Running Puppeteer on WSL2 controlling the Chrome on Windows

I'm trying to get to run puppeteer on WSL2. I've tried using a remote display via VcXsvr but my firewall settings and host have custom changes and I've frankly

Changing user-agent on puppeteer-extra doesn't seem to take affect

I'm trying to scrape different websites using puppeteer. As I'm using puppeteer-extra for that (for their stealth-plugin), I've decided to use their anonymize-u

How can I download images on a page using puppeteer?

I'm new to web scraping and want to download all images on a webpage using puppeteer: const puppeteer = require('puppeteer'); let scrape = async () => {

Puppeteer wait until page is completely loaded

I am working on creating PDF from web page. The application on which I am working is single page application. I tried many options and suggestion on https://g

Override the browser date with puppeteer

I'm trying to setup puppeteer to run a few performance tests. I'd like to override the date to a specific value so that I can mock the data my app needs without

PM2 does not restart Node JS application when this error occurs

For some reason, every time I get this particular error /home/pi/.pm2/logs/app-error.log last 15 lines: 0|scripts | { TimeoutError: Navigation timeout of 30000