The Future of Search and the Intelligent Web, From Vulcan Capital’s Steve Hall

Search is hot again. Just when you thought Google had everything figured out, along comes Microsoft with its new search engine, Bing. This upstart effort may not supplant the search king, or even compete with it all that seriously, but it will certainly make things interesting for a while.

Even more interesting, though, is the batch of new technologies and businesses bubbling up around the edges of traditional Web search. Take software that helps you understand relationships between people, places, and products online. Or Web services that try to collect content you are interested in, let you share it with others, and keep you up to date with the latest news about people you know. Google itself is getting into the act with its new Wave tool, which integrates e-mail, instant messages, documents, wikis, tweets, and other social media—all the comforts and stresses of modern life, really—in one place.

All of this raises the broader question of how we’re going to deal with all these different data streams on the Web and use them to improve our work and personal lives, rather than waste time doing an endless (and growing) number of searches for relevant information. To hear more about this emerging space, Luke and I talked recently with one of the field’s leading investors, Vulcan Capital managing director Steve Hall. (See also our wider-ranging interview with Hall and Vulcan Capital president Chris Temple here.)

In recent years, Hall has led investments in companies like ZoomInfo, Radar Networks, Evri, and Gist (the latter two are in Seattle), which all play in an arena he calls “information discovery and the intelligent Web.” Hall emphasized that “Google is not the be-all, end-all for how we discover information.” Indeed, in a deep dive into the technology and business opportunities of this fast-moving space, he talked about how companies can “rewire the Web” to be smarter, how to beat today’s search engines and help people find information more efficiently, and why World Wide Web pioneer Tim Berners-Lee is wrong about the “semantic Web”—his original notion that computers will someday be able to understand all kinds of content and transactions online, if we help them by tagging things like photos and documents with descriptions of their meaning.

An edited account of our discussion follows:

Xconomy: What is your background in online search and the intelligent Web?

Steve Hall: One of the themes I’ve been involved in, really since I started doing venture in 1998, has been information discovery, search, and evolution of Internet data. The first venture deal I ever did in 1998 is now called About.com. It used to be called The Mining Company. At the time, our thesis was that the amount of data on the Web is going up and to the right. It’s hard to find the needles in the haystack. Yahoo, Excite, and Lycos were portals, a main interface to the data, but they were largely a taxonomy directory of websites. You didn’t have very good needle in the haystack searchability. You had AltaVista, which had started, but didn’t have real relevancy control to it—there was no quality output on AltaVista.

Our thesis at the time was if you had humans, experts on many topics, comb through the

Author: Gregory T. Huang

Greg is a veteran journalist who has covered a wide range of science, technology, and business. As former editor in chief, he overaw daily news, features, and events across Xconomy's national network. Before joining Xconomy, he was a features editor at New Scientist magazine, where he edited and wrote articles on physics, technology, and neuroscience. Previously he was senior writer at Technology Review, where he reported on emerging technologies, R&D, and advances in computing, robotics, and applied physics. His writing has also appeared in Wired, Nature, and The Atlantic Monthly’s website. He was named a New York Times professional fellow in 2003. Greg is the co-author of Guanxi (Simon & Schuster, 2006), about Microsoft in China and the global competition for talent and technology. Before becoming a journalist, he did research at MIT’s Artificial Intelligence Lab. He has published 20 papers in scientific journals and conferences and spoken on innovation at Adobe, Amazon, eBay, Google, HP, Microsoft, Yahoo, and other organizations. He has a Master’s and Ph.D. in electrical engineering and computer science from MIT, and a B.S. in electrical engineering from the University of Illinois, Urbana-Champaign.