When demoing our products, we often spend a lot of time answering questions about how BrightPlanet’s solutions are different than a regular Google search. Potential users often want BrightPlanet to search a certain keyword for them across the entire web. We don’t do that.
Discover what we do, why it’s different than a Google search, and why it’s valuable to customers.
- Harvesting vs. Searching
- Solving Specific Problems vs. Being Everything to Everybody
- Specific Sites vs. The Entire Web
Harvesting vs. Searching
Unlike traditional search technologies like Google, which index links and allow users to search those results, BrightPlanet takes it a step further and harvests all the content. The harvest process involves BrightPlanet extracting all of the text content from each of the results pages, and then preparing the harvested content for some type of analysis depending on the needs of the end-user.
Search engine technology indexes billions of webpages over time, therefore allowing users to search an already assembled index. Search engines don’t find or store all the content on a web page; they simply link you to the content’s location. The amount of data stored from each page is a crucial difference between search engines and content harvesters.
Our Deep Web Harvester extracts every single word every time it accesses a webpage. Additionally the Deep Web Harvester stores every single page harvested as a separate version.
Solving Specific Problems vs. Being Everything to Everybody
You may be wondering why you would need every single word to be extracted every time? Search engines like Google are really good at finding Surface Web websites; providing answers to basic questions like “How late is Burger King open?” quickly. However, companies and organizations have significantly harder questions that can only be answered by web data beyond the scope of a search engine. Complex questions, like those listed below, require more than a search engine; they require a Deep Web Harvester.
- Who is selling my products fraudulently online?
- How many people have won grants on Fetal Alcohol Spectrum Disorders?
- What are clinical trial patients saying about my experimental drug?
- What new information has been published on my competitor’s website today?
- Has anything changed in this insurance coverage plan that would affect a pharmaceutical company’s stock price?
- What new breast cancer research has been published in the last month? What are people saying about it?
Put these questions in the Google search bar and you will not get the answer you are looking for. Our technology can help answer these questions by harvesting Big Data from the Deep Web, connecting the results, and delivering them in the way that is useful for the end-user.
Specific Sites vs. The Entire Web
Instead of searching the entire web, we perform directed harvests on specific websites. End-users can define hundreds or thousands of Deep Web sources for BrightPlanet to query with many keywords at once.
If an end-user does not know the exact websites they want to search, they can just identify the information they are trying to find or problem they are trying to solve and BrightPlanet will help them find and define the web sources. Sources can continue to be added as the project evolves and the end-user decides which data is most useful.
A Deep Web Solution For You
Looking to go beyond a Google search and answer more complex questions with data from the Deep Web? Looking to stop searching site-by-site on a regular basis for a project? Learn more about the Deep Web and ways different end users have utilized our Deep Web solutions for their organizations in our Understanding the Deep Web in 10 Minutes whitepaper.
Sign up to schedule a free demo with one of our Deep Web Investigators if you have a problem you think solutions from the Deep Web might be able to help you solve.