Deep Web refers to the part of the Internet that is not indexed by well-known search engines. Most of us believe that these search engines like Google and Bing see everything.
Unfortunately, they can not. They just go to the web, following one link after the other by recording the results. There are also some places that can not be entered.
For example, a library's databases need an access password, or pages belonging to private organizations networks.
Although search engine technology has made tremendous jumps (real-time search and results with Flash and PDF content), there are parts of the web that can not be indexed by the known techniques. Like the internet we refer to as Deep Net, Deep Web or Invisible Web.
To access this particular Internet, you need additional software, and you need to use the appropriate tools to perform searches.
Below we will see ten online Deep Web search tools.
It is considered the oldest web directory and started by Tim Berners-Lee, the creator of the internet. So, it's no wonder that he can have access to invisible resources on the internet. The Virtual Library WWW or WWW Virtual Library lists several related resources for many topics.
For example, in the central library there are 300 sub-libraries with their own categories. The sub-library of History is a very good example.
You can explore the categories or use the search bar. Your screen shows an alphabetical layout of the topics.
The official website of the US government and the portal to all the public information you need for any federal agency or state, local and racial government. The site has an index from A to Z for all portal themes and helps you locate the information you want.
In addition to instant access, you can use filters such as "Images" or "Videos" from the top of the page for more specific results. Please note that there are other partner websites such as Kids.USA.gov and Publications.USA.gov which have more specialized information.
Entering the homepage tells them everything. The scientific search engine has access to 60 databases and over 2.200 scientific sites that have scientific information such as latest research and development results. Try the most sophisticated search engine for all government databases in the US.
Imagine this search engine as the first door for interdisciplinary research covering everything from agricultural information to the current trends in scientific research in the US.
The site is governmental and is free of charge. It transmits data and information in real-time or near real-time to current Earth conditions and observations. It is a gold mine for academic or occasional research.
Try the catalog of the National Geological Map database. Explore satellite photos and images of the Earth with the EarthExplorer tool. Discover 100.000+ scientific publications and books. Did you do it? You are still at the beginning…
Search for articles in open access journals. These are academic papers that are available to anyone "without financial, legal or technical barriers." In short, knowledge is free.
DOAJ has quality control with rigorous peer review. The current page has 9000 + magazines with almost 2,5 million articles on all topics. This information may not be available in Google Search, though Google Scholar may have access to some of the information.
Do you like literature? Try the Voice of The Shuttle. It is a rich list of online resources for literature, humanities and cultural studies. The search list has evolved to include science fiction, culture, cyberculture and technology.
Started as a support tool for the University of California at Santa Barbara, 1994. Until today it continues to be informed and you can discover primary and secondary resources.
Although Google has medical information, there are more specialized ones. RxList is a comprehensive database containing all prescription drugs in the US. It's an encyclopedia of medicines.
The data comes from sources such as FDA, Cerner Multum and First Data Bank, Inc.
This online encyclopedia began as a quiz on the 1938 radio. Today, Infoplease is a huge information portal. Using the site, you can access many databases, e-journals, e-books, newsletters, mailing lists, library cards, research articles and papers.
This search engine has access to 72.000 libraries from 170 countries and can help you find books, theses, videos, multimedia, or even museum exhibits.
If you have difficulty with the huge amount of information, you can use the "Ask a Librarian" function to ask for help from the librarians in charge.
This is a non-governmental source for intrusive security documents and will give you access to more than 10 million pages of government documents.
These documents are mainly addressed to journalists, and security researchers.
Other pages worth mentioning:
- Free Lunch
- Clinical Trials
- Project Gutenberg
- The Library of Congress
- Internet Archive (Including the Way Back Machine)
- The National Gallery of Art
How to connect to the Deep Web?
The size of the Deep Web is estimated to be many times larger than the one we all know. What is true is that this is an area of incredible information. But how useful is it for the general public when a search on Google never goes beyond the second page of results?
The invisible web is said to be dominated by TOR sites and illegal services. No the depth changes. The illegal services are found on the Dark Web as the image below shows:
As for the Deep Web, the truth is that this is a huge dump of information that needs some technique to access. The invisible web is definitely not for the casual investigator. The information is limitless but if you know what you are looking for, and where to look are a few keywords away.