The Challenge of Computing on a Planetary Scale: Inside Google’s Faculty Summit

spoken search query, regardless of the accent of the user. While this sounds simple, it is a grand challenge problem in artificial intelligence. Our voice systems, which are available on Android, iPhone and other mobile devices, are trained on over 230 billion spoken utterances and possess a one million word vocabulary—and we are working to make them even better. Interestingly, we have a new challenge: Quite often, our systems are even more accurate than the humans that rate them for accuracy, making it challenging to evaluate our own quality!

In the domain of ultra-large software systems, John Wilkes, a distinguished engineer from Mountain View, spoke to the audience about a new system we are building that will automatically manage the seemingly endless number of computers in Google’s worldwide data centers.

Some of these computers are working round the clock answering user queries, processing e-mail, or otherwise attending to tasks that require instantaneous responses. Other computers are working on long jobs, for example, actually learning to do language translation from vast corpora in English, French, German, Chinese, etc. The key, John described, is to make sure that we can easily specify the requirements of each job that needs to run, and then have an uber-manager, “the cluster management system,” automatically allocate those jobs to the right sets of computers in a way that maximizes performance while minimizing costs. Our current cluster management system is seven years old, and we discussed its success and challenges, as well as our hopes for the new system we are building to replace it.

While you wouldn’t think that professors of computer science would be interested in shopping or commerce, Andrew Moore, a former professor at Carnegie Mellon and now the Director of Google’s Pittsburgh office, described the deep research questions in areas such as shoe shopping. How can we implement a system to analyze the image of a shoe—its color, shape and pattern? How can we show a pair of shoes that someone might purchase based on this image analysis? How can we simultaneously provide accurate results of shoes a shopper would most likely purchase, without showing shoes they would not like, and provide the serendipitous connections that a shopper would experience in a real store? Optimization, computer vision algorithms, auction theory and more all play a role, and are the subject of active research not only at Google, but across the computer science community.

The field of computer science is, in many ways, a large expanding sphere that grows into ever more domains of applicability. The greatest recent successes have been at the boundary of computer science and virtually every other discipline. So, we covered quite a diversity of topics in New York. There is more on our research blog and also on the Official Google Blog, where you can even see a poem by NYU Professor Ken Perlin in iambic pentameter, musing about the future of mobile devices.

Author: Alfred Spector

Alfred Spector is Vice President of Research and Special Initiatives at Google. Spector joined Google in 2007 and is responsible for research across Google and also a growing collection of special initiatives, such as open source, university relations and more. Recently Dr. Spector has assumed the executive engineering leadership for google.org, an effort that uses Google's strengths in information and technology to build products and advocate for policies that address global challenges. Dr. Spector speaks widely on research and innovation, and spends much time helping Google connect to the university research community. Previously, Dr. Spector was vice president of strategy and technology IBM’s Software Business, and prior to that, he was vice president of services and software research across IBM. He was also founder and CEO of Transarc Corporation, a pioneer in distributed transaction processing and wide area file systems, and was an associate professor of computer science at Carnegie Mellon University, specializing in highly reliable, highly scalable distributed computing. Dr. Spector received his Ph.D. in computer science from Stanford and a bachelor’s degree in applied mathematics from Harvard. He is a member of the National Academy of Engineering and a Fellow of American Academy of Arts and Sciences, the IEEE and the ACM. Dr. Spector is also the recipient of the 2001 IEEE Computer Society’s Tsutomu Kanai Award for work in scalable architectures and distributed systems.