Managing large volumes of enterprise data continues to challenge IT organizations as they deal with administration and storage of no longer just terabytes but now petabytes of data and costs increase accordingly. This massive size of data complicates the underlying issues of where and how to store it easily in low-cost hardware and manage the data efficiently. One attempt at a solution is Hadoop, an open source community-based project. It began as part of Yahoo and was led by Doug Cutting, who used the MapReduce concepts for large-scale distributed computing to create a distributed file system. Yahoo itself runs the largest deployment of Hadoop. Doug Cutting is not new to the open source world, being involved in the creation of Lucene, open source search technology among many other open source community projects.
The Hadoop Distributed File System (HDFS) enables scaling of data segments across servers. Through such replication across servers it achieves built-in fail-over capability that does not require a redundant array of independent disks (RAID). This technology is recognized across the industry, and many large software companies, including IBM, have announced intentions to support it. Now there is a need for a commercial, licensed version of Hadoop as organizations want more than just a file system, requiring an entire management system to ensure it can operate like other databases in production. This is where Cloudera comes in. In 2008 Doug Cutting saw an opportunity to build a software company around Hadoop that provides licensed and supported versions and also services and training. The company acquired venture financing and now has reference customers that include Bank of America and Samsung.
All Information Management articles are archived after 7 days. REGISTER NOW for unlimited access to all recently archived articles, as well as thousands of searchable stories. Registered Members also gain access to:
- Full access to information-management.com including all searchable archived content
- Exclusive E-Newsletters delivering the latest headlines to your inbox
- Access to White Papers, Web Seminars, and Blog Discussions
- Discounts to upcoming conferences & events
- Uninterrupted access to all sponsored content, and MORE!