'How to scrape data from Twitter without its API using BeatifulSoup

I'm currently trying to scrape some data from Twitter, like username, screen name, the content of the tweet etc. But I've run into some problems: I've been trying to retrieve the HTML file of this tweet (https://twitter.com/Cristiano/status/1458009811833036802) using BeautifulSoup, but everytime I use the requests library to retrieve the info, it doesn't output the correct HTML.

This is the command I'm running:

print(requests.get(url=link).text)

This is its output:

JavaScript is not available.
We’ve detected that JavaScript is disabled in this browser. Please enable JavaScript or switch to a supported browser to continue using twitter.com. You can see a list of supported browsers in our Help Center.
Help Center

Terms of Service
Privacy Policy
Cookie Policy
Imprint
Ads info
      © 2021 Twitter, Inc.

Something went wrong, but don’t fret — let’s give it another shot.

I don't know how to solve this problem and I really don't want to use the Twitter API, because it's just a simple project. I just need the HTML file, how do I proceed?



Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source