Searching Deep and Dark: Building A Google for The Less Visible Parts of The Web
Christian Mattmann, 11 Jan 17
       

A geographical map depicting hotbeds of dark web activity related to illegal products. Larger circles indicate more activity. Christian Mattmann, CC BY-SA

In today’s data-rich world, companies, governments and individuals want to analyze anything and everything they can get their hands on – and the World Wide Web has loads of information. At present, the most easily indexed material from the web is text. But as much as 89 to 96 percent of the content on the internet is actually something else – images, video, audio, in all thousands of different kinds of nontextual data types.

Further, the vast majority of online content isn’t available in a form that’s easily indexed by electronic archiving systems like Google’s. Rather, it requires a user to log in, or it is provided dynamically by a program running when a user visits the page. If we’re going to catalog online human knowledge, we need to be sure we can get to and recognize all of it, and that we can do so automatically.

How can we teach computers to recognize, index and search all the different types of material that’s available online? Thanks to federal efforts in the global fight against human trafficking and weapons dealing, my research forms the basis for a new tool that can help with this effort.

Understanding what’s deep

The “deep web” and the “dark web” are often discussed in the context of scary news or films like “Deep Web,” in which young and intelligent criminals are getting away with illicit activities such as drug dealing and human trafficking – or even worse. But what do these terms mean?

Sign in to view full article

       
Facebook’s New Anti-Fake News Strategy Is Not Going To Work – But Something Else Might
Over the past year, the social media company has been scrutinized for influencing the US presidential election by spreading fake ...
Paul Ralph
Mon, 1 May 17
The Disease of Struggle
When the Soviet Union collapsed, Ryszard Legutko, the minister of education of Poland, had an impression shared by many as ...
Joshua Philipp
Mon, 23 Jan 17
Fighting Online Trolls With Bots
The wonder of internet connectivity can turn into a horror show if the people who use online platforms decide that ...
Saiph Savage
Fri, 13 Jan 17
The Future: Making Singapore an Elder-Friendly Place
The government aims to make Singapore “an inclusive elder-friendly place” and the first step starts from the elders’ flats.
Jocelyn Neo
Mon, 2 Jan 17
Enough’s Enough: Buying More Stuff Isn’t Always the Answer to Happiness
The average German household contains 10,000 items. That’s according to a study cited by Frank Trentmann in his sweeping history ...
Anthony James
Thu, 5 Jan 17
An Epoch Times Survey
An Epoch Times Survey
An Epoch Times Survey
Sports Elements
Read about Forced Organ Harvesting
Sports Elements