Cloudera positions Hadoop as an enterprise data hub

Hadoop can now serve as the single source of data for an enterprise, Cloudera says

Taking note of how customers have been working with its Hadoop distribution, Cloudera has expanded the scope of its software so that it can serve as a hub for all of an organization's data, not just data undergoing Hadoop MapReduce analysis.

Some of Cloudera's enterprise customers have "started to use our platform in a new way, as the center of their data centers," said Mike Olson, Cloudera's chairman and chief strategy officer.

"We think this is a very big deal. It will change the way the industry thinks about data," Olson said.

Cloudera has released a new beta of its commercial distribution, Cloudera Enterprise, that provides tools for managing an organization's data, as well as tools from Cloudera and third parties for data analysis.

Olson announced the beta of Cloudera Enterprise 5 at the O'Reilly Strata-Hadoop World conference, being held this week in New York.

"It used to be that an organization had lots of balkanized data silos," Olson said. "The stuff that you used to run on a data warehouse because you had no choice, now you can run on the hub."

Putting the data in a Hadoop-based storage repository has many advantages, Olson argued. You can run different types of analytical workloads against the data in the hub. It can easily feed data to other systems, such as content management systems. It can work as an archiving system.

An enterprise data hub, Olson said, can store data as it is generated, even if the organization isn't sure how the data will be needed. Such data may be valuable later for machine learning analysis or other uses not considered.

An enterprise hub also puts security and governance mechanisms in place to safeguard the data. Cloudera has been working on these tools for several releases, Olson said.

"Our ambition is to draw more workloads in and make the hub more valuable over time," he said.

Part of Hadoop's newfound ability to act as a data hub comes from software additions in the latest version of the open-source software, Apache Hadoop 2, on which Cloudera Enterprise is built.

The inclusion of YARN (Yet Another Resource Manager), for instance, allows Hadoop to handle multiple analysis applications, not just those that run on the batch process-oriented MapReduce.

To facilitate the hub, Cloudera has also set up a management framework that third-party analysis applications can plug into. SAS, Revolution Analytics, Syncsort and other organizations have ported some of their software to the platform. Porting analysis software requires that the operations be executed in parallel, as data in Hadoop is typically distributed across multiple nodes, Olson said.

Cloudera Enterprise 5 also adds the ability to cache HDFS (Hadoop Distributed File System) contents in the working memory of a server, which can boost query response and data processing times.

The company's Navigator auditor tool now allows analysts and data modelers to search, explore, define and tag datasets. Users can add customized queries to Cloudera's Impala SQL engine. And Cloudera Enterprise 5 can work with the NFS (Network File System) nodes, which should make the process of injecting data into HDFS much easier, Olson said.

The software also now can take snapshots of the data, providing a backup if the original data is lost or destroyed.

Joab Jackson covers enterprise software and general technology breaking news for The IDG News Service. Follow Joab on Twitter at @Joab_Jackson. Joab's e-mail address is Joab_Jackson@idg.com

Join the Good Gear Guide newsletter!

Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection

Tags softwarecloudera

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Joab Jackson

IDG News Service
Show Comments

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Matthew Stivala

HP OfficeJet 250 Mobile Printer

The HP OfficeJet 250 Mobile Printer is a great device that fits perfectly into my fast paced and mobile lifestyle. My first impression of the printer itself was how incredibly compact and sleek the device was.

Armand Abogado

HP OfficeJet 250 Mobile Printer

Wireless printing from my iPhone was also a handy feature, the whole experience was quick and seamless with no setup requirements - accessed through the default iOS printing menu options.

Azadeh Williams

HP OfficeJet Pro 8730

A smarter way to print for busy small business owners, combining speedy printing with scanning and copying, making it easier to produce high quality documents and images at a touch of a button.

Andrew Grant

HP OfficeJet Pro 8730

I've had a multifunction printer in the office going on 10 years now. It was a neat bit of kit back in the day -- print, copy, scan, fax -- when printing over WiFi felt a bit like magic. It’s seen better days though and an upgrade’s well overdue. This HP OfficeJet Pro 8730 looks like it ticks all the same boxes: print, copy, scan, and fax. (Really? Does anyone fax anything any more? I guess it's good to know the facility’s there, just in case.) Printing over WiFi is more-or- less standard these days.

Ed Dawson

HP OfficeJet Pro 8730

As a freelance writer who is always on the go, I like my technology to be both efficient and effective so I can do my job well. The HP OfficeJet Pro 8730 Inkjet Printer ticks all the boxes in terms of form factor, performance and user interface.

Michael Hargreaves

Windows 10 for Business / Dell XPS 13

I’d happily recommend this touchscreen laptop and Windows 10 as a great way to get serious work done at a desk or on the road.

Featured Content

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?