Case Study: Data Mining & Data Scraping for Hybrid Capital

Challenge

A Worktrooper client needed to put together an extensive list of contact details for 300 university faculty, staff, and alumni for a marketing campaign. Due to the amount of data mining the client would need to do, the project was initially put on hold thanks to the high costs and time-consuming nature of performing the task locally.

In addition, the client was not interested in hiring an outside team. The data mining task and marketing campaign was a one-off job. The hiring of an outside team or short-term team would be further time consuming and potentially costly.

Solution

Worktrooper’s solution to the problem was to create a two-person team of data scraping experts. The team’s goal was to scrape 300 universities and 4M profiles in six months. The two-person team set up data mining for each university with different layouts and scraping. Progress reports were sent to the client on a daily basis with the number of profiles scraped each day.

Results

Worktrooper’s two-person team was able to finish the data mining project in just five and half months of work. The team delivered the final results in a spreadsheet for the client to work from. The team was able to complete data scraping on 3,943,698 university faculty, staff, and alumni profiles. The team’s final spreadsheet included an extensive list of data points which included names, email addresses, department names, phone numbers, and more.