2.12 Where can we find big data sources data?

• Open data initiatives, e.g. Open Government Data

• Directly on Websites (e.g. tables on Wikipedia webpage)

• (Web) APIs = Advanced programming interfaces

  • What is that?
  • Overview of APIs: https://www.programmableweb.com/category/all/apis
  • Used with additional software, e.g. R packages
  • e.g. Twitter API; Wikipedia API

• Data repositories

  • Science: [Harvard Dataverse]; UK Data Service reshare; openICPSR; Open Science Framework; FAIRsharing
  • Kaggle datasets
  • Awesome public datasets
  • Open Data on AWS
  • Open Data in the United States
  • More on KDnuggest…

• Leaked data: Beware of legal implications

• Q: Go through a couple of sites: Which are the most interesting datasets you found? Generally and from a social science perspective?