Microsoft adds Hadoop support to SQL Server, data warehouse

Connectors that tie Hadoop to Microsoft's data warehousing stack will be available soon

Microsoft is responding to the "Big Data" movement by adding support for the open-source Hadoop framework for large-scale data processing to its SQL Server database and Parallel Data Warehouse platform.

The connectors will be available in CTP (community technology preview) form soon, according to a post this week on the official SQL Server Team blog.

Big Data refers to the ever-growing volumes of data being generated by enterprises, particularly from sensors and Web traffic.

"Our customers have been asking us to help store, manage, and analyze both structured and unstructured data -- in particular, data stored in Hadoop environments," Microsoft said in the blog post.

With the new connectors, customers will be able to interchange data between Hadoop environments, SQL Server and Parallel Data Warehouse, Microsoft said.

Hadoop, which is hosted at the Apache Software Foundation, was formed by Yahoo and is based partly on the MapReduce programming model developed by Google. An increasingly large commercial ecosystem has emerged around Hadoop, with companies such as Cloudera offering services and specialized distributions of the framework.

Microsoft's move makes sense, given that its data warehousing vendors such as EMC Greenplum and Teradata have already embraced Hadoop, said Forrester Research analyst James Kobielus.

More and more enterprises are running Hadoop clusters and they want to be able to send data from those systems downstream to their data warehouse systems, he added.

But no one vendor can claim to have a fully built-out Hadoop offering, which would include distributions, connectors to Hadoop-related projects such as the Cassandra data store, modeling tools and other components, he said.

There is "no doubt" that like other vendors, Microsoft has serious plans for Hadoop, but it hasn't made a long-term road map public, Kobielus added.

Microsoft is not embracing Hadoop at the expense of homegrown efforts, having recently released a MapReduce-based programming model, Project Daytona, for use on its Azure cloud platform.

Also this week, Microsoft announced that it has released a second Appliance Update for Parallel Data Warehouse. These updates combine new features for both hardware and software components.

The release includes new connectors for third-party BI (business intelligence) and data-integration tools from SAP, Informatica and Microstrategy.

In addition, a version of the PDW based on Dell hardware is now available, Microsoft said. Pricing starts at less than $US12,000 per terabyte.

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags Microsofthardware systems

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Chris Kanaracus

IDG News Service
Show Comments

Cool Tech

Toys for Boys

Family Friendly

Stocking Stuffer

SmartLens - Clip on Phone Camera Lens Set of 3

Learn more >

Christmas Gift Guide

Click for more ›

Brand Post

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Aysha Strobbe

Microsoft Office 365/HP Spectre x360

Microsoft Office continues to make a student’s life that little bit easier by offering reliable, easy to use, time-saving functionality, while continuing to develop new features that further enhance what is already a formidable collection of applications

Michael Hargreaves

Microsoft Office 365/Dell XPS 15 2-in-1

I’d recommend a Dell XPS 15 2-in-1 and the new Windows 10 to anyone who needs to get serious work done (before you kick back on your couch with your favourite Netflix show.)

Maryellen Rose George

Brother PT-P750W

It’s useful for office tasks as well as pragmatic labelling of equipment and storage – just don’t get too excited and label everything in sight!

Cathy Giles

Brother MFC-L8900CDW

The Brother MFC-L8900CDW is an absolute stand out. I struggle to fault it.

Luke Hill

MSI GT75 TITAN

I need power and lots of it. As a Front End Web developer anything less just won’t cut it which is why the MSI GT75 is an outstanding laptop for me. It’s a sleek and futuristic looking, high quality, beast that has a touch of sci-fi flare about it.

Emily Tyson

MSI GE63 Raider

If you’re looking to invest in your next work horse laptop for work or home use, you can’t go wrong with the MSI GE63.

Featured Content

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?