Supercomputer uses flash storage drives

San Diego Computing Center says flash memory will help analyze and solve data-mining problems faster
  • Agam Shah (IDG News Service)
  • — 03 September, 2009 05:35
San Diego Supercomputer Center has built a high-performance computer with solid-state drives

San Diego Supercomputer Center has built a high-performance computer with solid-state drives

The San Diego Supercomputer Center has built a high-performance computer with solid-state drives, which the center says could help solve science problems faster than systems with traditional hard drives.

The flash drive will provide faster data throughput, which should help the supercomputer analyze data an "order-of-magnitude faster" than hard drive-based supercomputers, said Allan Snavely, associate director at SDSC, in a statement. SDSC is a part of the University of California, San Diego.

"This means it can solve data-mining problems that are looking for the proverbial 'needle in the haystack' more than 10 times faster than could be done on even much larger supercomputers that still rely on older 'spinning disk' technology," Snavely said.

SDSC intends to use the HPC system -- called Dash -- to develop new cures for diseases and to understand the development of Earth.

Solid-state drives, or SSDs, store data on flash memory chips. Unlike hard drives, which store data on magnetic platters, SSDs have no moving parts, making them rugged and less vulnerable to failure. SSDs are also considered to be less power-hungry.

Flash memory provides faster data transfer times and better latency than hard drives, said Michael Norman, interim director of SDSC in the statement. New hardware like sensor networks and simulators are feeding lots of data to the supercomputer, and flash memory more quickly stores and analyzes that data.

Calling it the first HPC system to use flash memory technology, the system has already begun trial runs, SDSC said. It has 68 Appro International GreenBlade servers with dual-socket quad-core Intel Xeon 5500 series processor nodes offering up to 5.2 teraflops of performance at peak speeds. It has 48GB of memory per node, which gives users access to up to 768GB of memory over 16 nodes.

The system uses Intel's SATA solid-state drives, with four special I/O nodes serving up 1TB of flash memory to any other node. The university did not immediately respond to a query about the total available storage in the supercomputer.

SSDs could be better storage technology than hard drives as scientific research is time-sensitive, said Jim Handy, director at Objective Analysis, a semiconductor research firm. The quicker read and write times of SSDs compared to hard drives contribute to providing faster results, he said.

SSDs are also slowly making their way into larger server installations that do online transaction processing, like stock market trades and credit-card transactions, he said.

Many data centers also a employ a mix of SSDs and hard drives to store data, Handy said. Data that is frequently accessed is stored on SSDs for faster processing, while hard drives are used to store data that is less frequently needed.

"Hard drives are still the most cost-effective way of hanging on to data," Handy said. But for scientific research and financial services, the results are driven by speed, which makes SSDs makes worth the investment.

Agam Shah

IDG News Service
Topics: flash storage, hpc, SSD, supercomputers

Comments

1

Anonymous
Sun 06/09/2009 - 22:46

Just don't turn it into The Matrix.

2

Anonymous
Mon 07/09/2009 - 02:40

Uhhh .. yeah.

3

Anonymous
Mon 07/09/2009 - 17:16

Such insight.

"The quicker read and write times of SSDs compared to hard drives contribute to providing faster results, he said"

4

Anonymous
Tue 08/09/2009 - 02:55

Supercomputer uses Flash Drives

Yes, I am sure it runs much faster. But you will notice the lack of concern
about the replacement cost of the flash drives when they do become defective
or burn out.

Maybe it's just our tax dollars at work?

5

Anonymous
Tue 08/09/2009 - 06:51

Good job!

"Yes, I am sure it runs much faster. But you will notice the lack of concern
about the replacement cost of the flash drives when they do become defective
or burn out."
Of course there's a lack of concern. A) This is a supercomputer, it's already going to be costly. B) They are not using the disks (flash or regular) as swap space or the like (the system has plenty of RAM), so they are not going to thrash through huge numbers of write cycles. That is, the flash and whole supercomputer will likely become obsolete before it wears out. I should also point out here that mechanical disks fail too. C) Again, it's a supercomputer -- if they can gain system performance by putting faster storage onto it, they are probably going to come out ahead compared to the other way to speed up a system like this (throwing on more compute nodes).

"Maybe it's just our tax dollars at work?"
Better spending it on this then pissing it away on the military, "war on drugs", illegal spying programs, etc.

6

Anonymous
Tue 08/09/2009 - 08:03

5.2 (TF) can't really be considered a super computer.

Sorry but 5.2 Teraflops can't really be considered an HPC system. Triple that and you're just scratching at the bottom end of the top500 list.

7

magicram1
Tue 10/11/2009 - 17:37

flash drives

Yes, I am sure it runs much faster.
<a href="http://www.magicram.com/">SATA DOM, Rechargeable SRAM Card</a>, <a href="http://www.magicram.com/pc-card.html">SRAM PC Card, ATA Flash PC Card, SRAM Memory Card</a>, <a href="http://www.magicram.com/">Linear Flash Memory, ATA Flash Memory, Memory PC Cards</a>, <a href="http://www.magicram.com/">Embedded USB Flash Disk, IDE SSD, Solid State Disks</a>

Be the first to comment

*
*
This will be kept private.
*
*
Users posting comments agree to the Good Gear Guide comments policy.