'R Web Scrap of Dynamically Generated Table with a form method="post"
I am extremely novice when it comes to web scraping. I am trying to do some exploratory analytics on some public base salary information where I work. They have a website, but it is awful trying to get any information out of it (almost like they did it on purpose...). Reading some intro to web scraping tutorials in R, I think this is an embedded table; the formatting looks like it is from Tableau. After reading this post, I also think it is dynamic since the table isn't generated right away when the webpage is opened. When I inspect the webpage it has a form method="post" and that seems to make things harder from the little bit of reading I have done.
Due to this post, I think I need to use the package httr for a post request. But trying to read through this is making my head spin. https://f.briatte.org/r/scraping-form-results-with-httr
Now I am just realizing "All Campuses" the default is fine; I can filter later in R. So I just need to push the "Search" with httr.
Is there any way to scrap this information? I am most fluent in R if it is possible to do it there.
The website I am trying to scrape: https://www.cusys.edu/budget/cusalaries/
Thanks so much for the help!
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|
