Design and development of a custom web-scraping solution
Evaluated and set out requirements for a modular, easily maintained web-scraping system to target specific sites; collating and storing specific subject information
XML was used to create each site-specific template, to make them human-readable and easily-maintainable
The software was required to be easily extended to accomodate different types of semantic data
Managed and implemented development of the system, and introduced regression testing
Outlined design for a GUI to manage creation of the XML templates
Management of Data Processing personnel creating and maintaining templates for the web-scraping system
Back-end server software and ASP.NET/Python support tools development
