'Web Scraping in Google Scholar with beautifulsoup and selenium in python
I'm trying to scrape from Google Scholar profiles. I need profiles with special specifications that I specified. I use Beautifulsoup and selenium in Python. For example, I need professors in a university that work on some subjects which I specified. What is your idea?
My way is very slow and needs to visit every profile page to check my special specifications. Please offer me a faster way if you know.
If exist a fast and better way to do this work, please say it.
Solution 1:[1]
You can add the subjects you need in the url like this:
Here I'm searching for authors with two fields: computer vision and machine learning
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|---|
| Solution 1 | loginmind |