Australian politics research, based on data from Twitter and other open sources
The workflows at the moment, listed below in the order required to run
- data-collection.R - scrapping Australian parlament website for data of Members of Parlaments (MPs) Reference to blog post with more detailed explanation of the approach - https://levashov.biz/scrapping-data-about-australian-politicians-with-rselenium/
- tweets-collection.R - collecting tweets from MPs
- analysis.R - analysis of data
- dbcollection-rtweet.R initial collection of data (larger number), saving to results to the database (DB was used in past, not anymore)
- tweet-update.R script is running daily on schedule, collects the data and saves to the data file on S3
- visualization.R some visualization
- AUPolVizual/app.R Shiny R Application with visualization, available publically at https://rserv.levashov.biz/shiny/rstudio/
Retainer with DB suffix