'parsing reddit URLs beyond page 3
The following code works nice and quick to grab reddit threads based on keywords in a subreddit. I've ran in to the problem that it stops after parsing page 3. Unfortunately for very active subreddits this means it will only grab around 3 months of threads.
1 - Is there a way to have it parse beyond page 3?
2 - If not, is there a better package for scraping reddit threads within a subcommunity (On a keyword or scraping the full subreddit). I've searched around and this package was the best I could find.
library(tidyverse)
# install.packages("RedditExtractoR")
library(RedditExtractoR)
DF <- find_thread_urls(keywords="community",
subreddit="gaming",
sort_by="new",
period="all")
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|
