Searching Deep and Dark: Building A Google for The Less Visible Parts of The Web
Christian Mattmann, 11 Jan 17
       

A geographical map depicting hotbeds of dark web activity related to illegal products. Larger circles indicate more activity. Christian Mattmann, CC BY-SA

In today’s data-rich world, companies, governments and individuals want to analyze anything and everything they can get their hands on – and the World Wide Web has loads of information. At present, the most easily indexed material from the web is text. But as much as 89 to 96 percent of the content on the internet is actually something else – images, video, audio, in all thousands of different kinds of nontextual data types.

Further, the vast majority of online content isn’t available in a form that’s easily indexed by electronic archiving systems like Google’s. Rather, it requires a user to log in, or it is provided dynamically by a program running when a user visits the page. If we’re going to catalog online human knowledge, we need to be sure we can get to and recognize all of it, and that we can do so automatically.

How can we teach computers to recognize, index and search all the different types of material that’s available online? Thanks to federal efforts in the global fight against human trafficking and weapons dealing, my research forms the basis for a new tool that can help with this effort.

Understanding what’s deep

The “deep web” and the “dark web” are often discussed in the context of scary news or films like “Deep Web,” in which young and intelligent criminals are getting away with illicit activities such as drug dealing and human trafficking – or even worse. But what do these terms mean?

Sign in to view full article

       
How Gaming in The Classroom Prepares Children for Life in A Surveillance State
It’s well known that surveillance effects how we behave. A recent study on the issue showed that traffic to Wikipedia ...
Laura R. Pinkerton
Wed, 17 May 17
‘It’s All About Me, Me, Me!’ Why Children Are Spending Less Time Doing Household Chores
In August, Treasurer Scott Morrison warned that “Australia has a generation growing up expecting government handouts”.
Shi Li
Thu, 12 Jan 17
Why are We More Likely to Get Cancer as We Age?
This article is part of our series on older people’s health. It looks at the changes and processes that occur ...
Stuart Pitson
Wed, 1 Feb 17
Is The Developed World We’ve Created Giving Us Cancer?
I had assumed that the small lump in my breast was a blocked milk duct from nursing my seven-month-old son. ...
Chelsey Kivland
Thu, 8 Jun 17
The Disease of Struggle
When the Soviet Union collapsed, Ryszard Legutko, the minister of education of Poland, had an impression shared by many as ...
Joshua Philipp
Mon, 23 Jan 17
At Epoch Times, We Care :o)
An Epoch Times Survey
An Epoch Times Survey
Sports Elements
BUCHERER
Read about Forced Organ Harvesting