'Web scraping with request do not get the data of the website
I am trying to do web scraping to get the data of the tables of this web.
https://www.sciencedirect.com/science/article/pii/S0144861722004441?via%3Dihub
However, when I do:
import requests
headers = {'User-Agent' : 'Mozilla Firefox 99.0.1'}
url = "https://www.sciencedirect.com/science/article/pii/S0144861722004441"
data = requests.get(url, headers = headers).text # I also tried with: data = requests.get(url, headers = headers).content
print(data)
I get an output for data that does not even correspond with the content of the web...
What am I doing wrong?
Thank you
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|
