Week 7: Scraping Webpages

This week covers the basics of scraping webpages, including an overview of the mechanics of website source code, query languages, and automated browsers.

Lecture Slides   Supporting Code  

Note: materials will be posted before lecture and seminar each week.

Additional resources

• Howe, Shay. 2015. Learn to Code HTML and CSS: Develop and Style Websites. New Riders. Chs 1-8.

• Kingl, Arvid. 2018. Web Scraping in R: rvest Tutorial.

• Munzert, Simon, Christian Rubba, Peter Meissner, and Dominic Nyhuis D. 2014. Automated Data Collection with R: A Practical Guide to Web Scraping and Text Mining. Hoboken, NJ/Chichester, UK:Wiley & Sons. Ch. 2-4, 9.

• Duckett, Jon. 2011. HTML and CSS: Design and Build Websites. New York: Wiley.

• XPath syntax

• RSelenium vignette

• Mozilla Developer Web Docs. What is JavaScript.