Entries by bluemonkeydev

AMPLYFI- Data and Beyond

Amplyfi is one of BrightPlanet’s Data-as-a-Service partners leveraging large-scale, open-source data from the Surface Web and Deep Web to build business intelligence for its clients. Our business and technology relationship has spanned years, and we are excited to see its market growth as a leader in artificial intelligence.

Keeping up with the constantly changing Deep Web, BrightPlanet has developed the solutions that work

Website structures are constantly changing. You might be surprised how often websites swap formatting, themes, or its entire layout. These changes will typically break custom harvest scripts from inexpensive or roll-your-own harvesting solutions. BrightPlanet’s harvest engine and quality assurance solution is designed to be robust and fault tolerant to these types of website changes. Our […]

All websites are not created equal. BrightPlanet knows how to harvest the exact data clients need, whether it is Deep Web, Dark Web or Surface Web content.

BrightPlanet provides terabytes of data for various analytic projects across many industries. Our role is to locate open-source web data, harvest the relevant information, curate the data into semi-structured content, and provide a stream of data feeding directly into analytic engines, data visualizations, or reports. In this blog series, we are going to be diving […]

Interview with Mikhail Shengeliya of Eagle Alpha: OSINT Data Collection Challenges & Solutions

Will Bushee, BrightPlanet’s Vice President of Technology, recently sat down with Mikhail Shengeliya from Eagle Alpha to discuss various topics, including: Challenges which come with harvesting open-source content Solutions for those challenges Specific project use-cases, such as harvesting job postings Eagle Alpha provides a full-service platform enabling asset managers to obtain solutions from alternative data […]

We harvest a lot of websites for our clients, but how do we know which sites to harvest in the first place?

BrightPlanet has provided terabytes of data for various analytic projects across many industries over the years. Our role is to locate open-source web data, harvest the relevant information, curate the data into semi-structured content, and provide a stream of data feeding directly into analytic engines or final reports. The first phase of all projects – […]

We talk a lot about Data-as-a-Service, but what exactly does that mean?

BrightPlanet has provided terabytes of data for various analytic projects across many industries over the years. Our role is to locate open-source web data, harvest the relevant information, curate the data into semi-structured content, and provide a stream of data feeding directly into analytic engines or final reports. These collections often contain data from dozens, […]

Mapping Bitcoin Metrics Across Deep Web News and Sentiment with Tableau

Bitcoin, and other cryptocurrencies, have been a hot topic of conversation recently. The volatile digital currency rocketed from $1,000 to nearly $20,000 in 2017 before crashing back down to around $10,000 in January 2018. We thought it would be intriguing to query BrightPlanet’s Global News Data Feed to compare Bitcoin price trends with news mentions […]

Harvest Web Data in Multiple Languages with Unstructured Data Mining and Deep Web Search

The Internet knows nearly no limit when it comes to languages. The social media platform Facebook, for example, is available in over 100 languages. And that’s just the beginning. Hundreds of languages also make up areas of the Deep Web and Dark Web. If businesses want to gain complete data insight into their organization, it […]