Former Google, Yahoo employees behind Hadoop startup

October 15, 2008, 11:02 AM —  IDG News Service — 

A team including former Google, Yahoo and Facebook employees is launching a startup that will provide professional support for Hadoop, an open-source computing platform that makes it easier to write programs that process large amounts of data.

Yahoo is among the companies that use Hadoop, which employs the Google-developed MapReduce framework, in their operations.

Now Cloudera's founders are betting that there is money to be made supporting other Hadoop installations, whether on a customer's own set of machines or Amazon's Elastic Compute Cloud (EC2).

"Think Red Hat for Hadoop, but that is just the beginning," co-founder Amr Awadallah, wrote on his blog this week. Awadallah was previously vice president of engineering on a BI (business intelligence) team at Yahoo charged with improving the user search experience and making more money off the search site.

Former Googler Christophe Bisciglia is also on board. Bisciglia was a main driver behind the Academic Cluster Computing Initiative, a Google-IBM project that has provided Hadoop-powered machine clusters for academic use.

In addition, Jeff Hammerbacher, previously manager of Facebook's data team, is a co-founder of Cloudera. "The [Facebook data] team made a lot of contributions to Hadoop under his stewardship, most important of which is Hive (a SQL structured data layer on top of Hadoop)," Awadallah wrote.

Other company founders include Mike Olson, former CEO of Sleepycat, a company known for the open-source Berkeley DB database engine. Oracle bought Sleepycat in 2006.

Cloudera won't immediately feel the expected effects of the struggling economy on venture capital spending, Awadallah said. "We are in the process of wrapping up our funding (we don't need any more cash at this point), and will soon announce our investors and technical advisors."

Other details about the company's plans, such as pricing models, were not available. Cloudera could not immediately be reached Wednesday for a follow-up interview. The company will be based in the San Francisco area, though a specific location was not listed at its Web site.

News of the startup's plans sparked generally positive reactions from industry observers.

"Given the current economic outlook it's great to see a new open source start-up rearing its head, and the list of founders indicates that this one has a good chance of survival," 451 Group analyst Matthew Aslett noted in a blog post Wednesday.

Redmonk analyst Stephen O'Grady weighed in via e-mail. "It's clear that demand for the services that Hadoop provides is only going up. Most enterprises, even large ones with substantial investments in IT, lack the scale-out skills common to eBay, Google, Yahoo, et al. Commercially available and supported Hadoop would be one attractive solution to that problem."

IDG News Service

I like it!
Post a comment
The content of this field is kept private and will not be shown publicly.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd>
  • Lines and paragraphs break automatically.
Free books

Build your tech library with our book giveaways.

Windows PowerShell 2.0 Unleashed
By Tyson Kopczynski, Pete Handley, Marco Shaw; Published by Sams

Windows PowerShell Unleashed will not only give you deep mastery over PowerShell but also a greater understanding of the features being introduced in PowerShell 2.0–and show you how to use it to solve your challenges in your production environment. Enter now!

 

Ubuntu Server Administration
By Michael Jang; Published by McGraw-Hill Osborne Media

Realize a dynamic, stable, and secure Ubuntu Server environment with expert guidance, tips, and techniques from a Linux professional. Ubuntu Server Administration covers every facet of system management -- from users and file systems to performance tuning and troubleshooting. Enter now!

Featured Sponsor

AISO founders envisioned a Web hosting company that was environmentally friendly. While the company employed energy-efficient innovations like solar panels, its infrastructure produced unacceptable power and cooling requirements. Find out how AISO leveraged AMD technology to overcome their challenge in this case study white paper.

In this whitepaper, Scalar explores the opportunity to change the landscape with respect to mission critical databases built around Oracle. Leveraging technologies such as Linux, high-end commodity processing power and Oracle RAC technology to architect, design, build and maintain database infrastructure that delivers maximum availability, reliability and performance at a fraction of traditional cost.

On a typical day, weather.com, the Web site for The Weather Channel in Atlanta, serves up between 15 million and 20 million page views. But in September 2004, when back-to-back hurricanes ransacked Florida, the peak traffic on one day more than tripled: over 70 million page views by more than 7 million unique visitors. Read the full success story now.

More Resources