web scraping

Web scraping is the practice of harvesting large amounts of data from the internet and storing it locally or in a database to be processed, for example, pulling many scientific journals and processing the results.

Visit PubMed

Theory Jar, September 01, 2017

Theory Jar

The aim of Theory Jar was to translate scientific jargon into lay language. I was responsible for scraping text to build a corpora, and processed this using Python’s Natural Language Toolkit (NLTK).

Tuberculosis Sample Study, November 23, 2016

Tuberculosis Sample Study

28,000 tuberculosis (TB) sample entries were extracted from the NCBI Database in order to better understand the wide array of descriptors entered at the time these samples were uploaded.