Facebook, other Web giants unite to scale MySQL

WebScaleSQL hopes to equip the open source MySQL database with high-performance features

Facebook has joined a number of other Internet services heavyweights, such as Google and LinkedIn, to better equip the MySQL relational database management system for large- scale work.

The new group, called WebScaleSQL, includes engineers from Facebook, Google, LinkedIn, and Twitter.

"Our goal in launching WebScaleSQL is to enable the scale-oriented members of the MySQL community to work more closely together in order to prioritize the aspects that are most important to us," wrote Facebook software engineer Steaphan Greene, in a blog post announcing the collaboration.

"We aim to create a more integrated system of knowledge-sharing to help companies leverage the great features already found in MySQL 5.6, while building and adding more features that are specific to deployments in large-scale environments," Greene wrote.

Facebook has one of the largest deployments of the open source MySQL, if not the single largest deployment. The database system houses the data of Facebook's 1.23 billion users.

Many other social networking companies have eschewed the use of relational databases such as MySQL altogether in favor of NoSQL databases such as Cassandra or Riak, which were built from scratch to host extremely large data sets spread across multiple servers.

Facebook instead uses MySQL along with the Memcached caching system to replicate the data around the globe across many servers.

WebScaleSQL is not alone in its effort to boost MySQL for low-latency global Web scale work.

Percona offers a version of MySQL for high performance use, called Percona Server.

The MariaDB and Drizzle forks of MySQL were created with scalability improvements in mind as well.

Even the company managing the MySQL code, Oracle, outfitted MySQL with a handler that makes quick Memcached-like calls directly to the data, rather than going through the database engine itself.

Oracle also offers a separate version of MySQL, called MySQL Cluster,for use on server clusters, though it differs from MySQL considerably and is not widely used outside of telecommunications and a few other specific industries.

The WebScaleSQL project insists that the code base for WebScaleSQL is not a fork of MySQL, a separate version incompatible with MySQL itself, but rather a branch optimized for large-scale usage.

The work is based on the latest production-ready version of MySQL, version 5.6. The group hopes Oracle will accept some of the changes into the next version of MySQL, version 5.7.

The project has already produced a number of tools to help in its cause. It has developed a set of stress tests and an automated framework for creating and reviewing code changes.

Several projects are already under way.

One project is an asynchronous MySQL client that won't block additional requests when it is currently handling one. Facebook created this fix and it is currently being reviewed by other WebScaleSQL engineers.

The group is also reviewing other Facebook MySQL augmentations such as a read-ahead mechanism that can speed full table scans by a factor of 10.

Joab Jackson covers enterprise software and general technology breaking news for The IDG News Service. Follow Joab on Twitter at @Joab_Jackson. Joab's e-mail address is Joab_Jackson@idg.com

Join the newsletter!

Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection

Tags open sourcedatabasesapplicationsGooglesoftwareOracleFacebook

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Joab Jackson

IDG News Service
Show Comments

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Ben Ramsden

Sharp PN-40TC1 Huddle Board

Brainstorming, innovation, problem solving, and negotiation have all become much more productive and valuable if people can easily collaborate in real time with minimal friction.

Sarah Ieroianni

Brother QL-820NWB Professional Label Printer

The print quality also does not disappoint, it’s clear, bold, doesn’t smudge and the text is perfectly sized.

Ratchada Dunn

Sharp PN-40TC1 Huddle Board

The Huddle Board’s built in program; Sharp Touch Viewing software allows us to easily manipulate and edit our documents (jpegs and PDFs) all at the same time on the dashboard.

George Khoury

Sharp PN-40TC1 Huddle Board

The biggest perks for me would be that it comes with easy to use and comprehensive programs that make the collaboration process a whole lot more intuitive and organic

David Coyle

Brother PocketJet PJ-773 A4 Portable Thermal Printer

I rate the printer as a 5 out of 5 stars as it has been able to fit seamlessly into my busy and mobile lifestyle.

Kurt Hegetschweiler

Brother PocketJet PJ-773 A4 Portable Thermal Printer

It’s perfect for mobile workers. Just take it out — it’s small enough to sit anywhere — turn it on, load a sheet of paper, and start printing.

Featured Content

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?