'WebScrapping - Python - Selenium + BeautifullSoup
I`m trying to build a web scrapper to get user profile information such as name, location, experience, skills and languages
The problem I'm facing is:
inside each li tag contains the text I'm looking for
When I look to get information on Experience the section id changes for each profile, and if I try to use a different tag, for example a div brings me information from other fields that I do not need.
Other thing, as you can see on the picture it shows 'div' id = 'experience', but as this tag do not nest any parent tag I cannot use it to extract the data.
Solution 1:[1]
I would recommend doing: soup.findAll('div')
for finding all div's and then just split the output, so you can get the id that you want ;D
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|---|
| Solution 1 | Rylixmods |