Python for Harvesting Data on the Web

By Nick Wolf, Vicky Steeves.
Analysis Open Scholarship Tools and Technologies Research Data Management Tools Researchers

Abstract

This session is an intermediate-to-advanced level class that offers some ideas for how to approach the following common data wrangling needs in research: 1) Obtain data and load it into a suitable data “container” for analysis, often via a web interface, especially an API, 2) parse the data retrieved via an API and turn it into a useful object for manipulation and analysis, and 3) perform some basic summary counts of records in a dataset and work up a quick visualization.

Link to resource: https://nyu-dataservices.github.io/DataHarvesting-Python/

Type of resources: Activity/Lab

Education level(s): Graduate / Professional

Primary user(s): student, teacher

Subject area(s): Applied Science, Life Science, Physical Science, Social Science

Language(s): English