Deep Web University
Discover over 200 articles we’ve written about the Deep Web in our Deep Web University.
We partnered with the startup AMPLYFI to harvest and curate data for a new intelligence product. Learn how our open source data technologies streamlined services for this business.
Customer Problem
AI startup company AMPLYFI needed a massive amount of data to test their new business intelligence product DataVoyantTM. The company quickly realized that rapidly developing an in-house solution to harvest and extract web content at an enterprise scale would be extraordinarily di cult to achieve. AMPLYFI turned to BrightPlanet’s Data-as-a-Service (DaaS) to streamline web data collection for their broad client-base.
Technical Challenge
Effective dynamic access to all open source data, including the Deep Web, was needed to allow AMPLYFI’s AI to learn and grow. In addition to traditional data curation, AMPLYFI required the accurate identification of:
- Actual date of publication
- Actual location of publication
- Industry-specific keywords
BrightPlanet Methodology
BrightPlanet’s Data-as-a-Service platform is designed specifically to give you access to large amounts of web data. BrightPlanet Data Acquisition Engineers handled the harvesting and curation of the data that would go on to feed the DataVoyant engine. In collaboration with AMPLYFI, BrightPlanet enhanced the DaaS platform by developing custom curation rules to determine publish dates of articles and the country of origin for specific harvested web pages. These are extremely complex tasks to complete at large scale due to the hundreds of ways disparate sources handle web data.
Schedule a Consultation
Schedule a free consultation with a BrightPlanet® Data Acquisition Engineer today.
Case Studies
See how real businesses are using BrightPlanet’s technology to develop their own insights.
Schedule a Consultation
Schedule a free consultation with a BrightPlanet Data Acquisition Engineer today.