Yale Spinoff Hadapt Hops Out of Stealth, Looks to Help Big Companies Handle Big Data

technical. For starters, take Cloudera, a heavily-funded Silicon Valley startup that is also trying to bring Hadoop to the masses. Borgman says Hadapt is actually complementary to Cloudera: Cloudera focuses on tools and services to help ordinary IT staffs run Hadoop, he says, whereas Hadapt is more fundamentally “trying to make Hadoop better.”

But then it gets more directly competitive. Other systems like Hive, an open-source platform built on top of Hadoop, similarly lets users query big data, but because Hive was driven by Facebook, it isn’t suited for business intelligence applications, Borgman says. For certain types of queries, Hadapt is about 50 times faster, he says. Another system that works with Hadoop is called HBase, and Borgman claims his company’s technology is 600 times faster than that. (The details of why involve shifting workloads to faster computing nodes, and the fact that the data is replicated three times in the system.)

Hadapt is based on Yale professor (and Hadapt co-founder) Daniel Abadi’s research on merging Hadoop with databases. Yale PhD student Kamil Bajda-Pawlikowski is also a co-founder. The company, which officially started last July, has filed three patents around the technology and has seven full-time employees. Hadapt got its start through a summer program at the Yale Entrepreneurial Institute and has since moved to CTech, an incubator sponsored in part by Yale, LaunchCapital, and Connecticut Innovations. The company has raised an initial financing round (primarily angel capital), but Borgman declined to give any more specifics.

The startup has a long way to go, of course—it’s still refining its revenue model—but one intriguing future has it competing with Netezza (now owned by IBM), EMC, Oracle, HP, and other data warehouse combatants of the business-intelligence world. “We won’t replace them today, but that’s the five, 10-year plan,” Borgman says.

Author: Gregory T. Huang

Greg is a veteran journalist who has covered a wide range of science, technology, and business. As former editor in chief, he overaw daily news, features, and events across Xconomy's national network. Before joining Xconomy, he was a features editor at New Scientist magazine, where he edited and wrote articles on physics, technology, and neuroscience. Previously he was senior writer at Technology Review, where he reported on emerging technologies, R&D, and advances in computing, robotics, and applied physics. His writing has also appeared in Wired, Nature, and The Atlantic Monthly’s website. He was named a New York Times professional fellow in 2003. Greg is the co-author of Guanxi (Simon & Schuster, 2006), about Microsoft in China and the global competition for talent and technology. Before becoming a journalist, he did research at MIT’s Artificial Intelligence Lab. He has published 20 papers in scientific journals and conferences and spoken on innovation at Adobe, Amazon, eBay, Google, HP, Microsoft, Yahoo, and other organizations. He has a Master’s and Ph.D. in electrical engineering and computer science from MIT, and a B.S. in electrical engineering from the University of Illinois, Urbana-Champaign.