technical. For starters, take Cloudera, a heavily-funded Silicon Valley startup that is also trying to bring Hadoop to the masses. Borgman says Hadapt is actually complementary to Cloudera: Cloudera focuses on tools and services to help ordinary IT staffs run Hadoop, he says, whereas Hadapt is more fundamentally “trying to make Hadoop better.”
But then it gets more directly competitive. Other systems like Hive, an open-source platform built on top of Hadoop, similarly lets users query big data, but because Hive was driven by Facebook, it isn’t suited for business intelligence applications, Borgman says. For certain types of queries, Hadapt is about 50 times faster, he says. Another system that works with Hadoop is called HBase, and Borgman claims his company’s technology is 600 times faster than that. (The details of why involve shifting workloads to faster computing nodes, and the fact that the data is replicated three times in the system.)
Hadapt is based on Yale professor (and Hadapt co-founder) Daniel Abadi’s research on merging Hadoop with databases. Yale PhD student Kamil Bajda-Pawlikowski is also a co-founder. The company, which officially started last July, has filed three patents around the technology and has seven full-time employees. Hadapt got its start through a summer program at the Yale Entrepreneurial Institute and has since moved to CTech, an incubator sponsored in part by Yale, LaunchCapital, and Connecticut Innovations. The company has raised an initial financing round (primarily angel capital), but Borgman declined to give any more specifics.
The startup has a long way to go, of course—it’s still refining its revenue model—but one intriguing future has it competing with Netezza (now owned by IBM), EMC, Oracle, HP, and other data warehouse combatants of the business-intelligence world. “We won’t replace them today, but that’s the five, 10-year plan,” Borgman says.