I ran into an issue preparing data for database, since iam doing that very first time I scraped text from html dt and dd tags, so i'am getting a lot of informa
Would be great to get your help/ input on this! I'm trying to scrape job info from indeed. Everything in the code was working fine until I tried to get full job
A similar subject exists but I couldn't find the exact answer, so please could you help me? I copied from the internet the following code to s
BeautifulSoup getting href of a list with ++ records I have the following soup: <a href="some_url">next</a> <span class="class">...</span&g
How should i extract info i only need from <dt> and <dd> tags ? P.S and there is a lot of pages like that - hundreds Here is link for main page: ht
I'm trying to scrap phobos website using bs4 and getting 418 teapot error Here is my code ....I am getting error when i am using build_opener.open from url
I have been scraping using BeautifulSoup library in Python for scraping Amazon.com. I am successful in that using proxy rotation, but the problem is that the pa
I'm trying to get all information from this website using Python/Selenium: https://bitinfocharts.com/top-100-richest-bitcoin-addresses.html I have successfully
The task is to get data from the site. I have 800 URLs to request. But it takes a long time .I use aiohttp. At this stage, I have received links, by clicking on
Below is the xml that I'm trying to parse. <url> <loc>https://www.houseofindya.com/aqua-chanderi-pleated-sharara-pants-177/iprdt</loc> &
I would appreciate your help on this scraping problem. I would like to scrape this site: https://www.trustedshops.de/bewertung/info_XDAD39B874C275A0751198C2510C
the article passages are divided into different divs tags like in the image you can see it is written data-page-number="2" just like that the data is divided i
I have a lxml file and I need content from there. The file structure looks like this: <span class="ocr_line" id="line_1_1" title="bbox 394 185 1993 247">
I'm a web-scraping beginner and am trying to scrape this webpage: https://profiles.doe.mass.edu/statereport/ap.aspx I'd like to be able to put in some settings
import pandas as pd import glob import csv import re from bs4 import BeautifulSoup links_with_text = [] textfile = open("a_file.txt", "w") for filename in glob
import pandas as pd import glob import csv import re from bs4 import BeautifulSoup links_with_text = [] textfile = open("a_file.txt", "w") for filename in glob
I have the following code to scrape Reddit usernames: from bs4 import BeautifulSoup from requests import get from fake_useragent import UserAgent
I am trying to scrape the name of every favorites on the page of a user of our choice. but with this code I get the error "ResultSet object has no attribute 'fi
I am new to all of this, and this is my first real coding project so forgive me if the answer is obvious :) I am trying to extract sale items from [my grocery s
I'm trying to scrape my NYT mini crossword stats to then update a google sheet. But I'm having trouble with the login portion of the code. Here's my code so far
github-organizations