Hyder: A Transactional Indexed Record Manager for Shared Flash Storage

Monday, April 18, 2011 - 3:31pm


Wednesday, May 11, 2011
11:00 AM – 12:00 PM
Computer Science Conference Room, Harold Frank Hall Rm. 1132

HOST: Divy Agrawal and Amr El Abbadi

SPEAKER: Philip A. Bernstein
Microsoft Research

Title: Hyder: A Transactional Indexed Record Manager for Shared Flash Storage

An enormous increase in the I/O rate to shared storage is made possible
by the availability of large flash storage chips and cheap high-speed
network switches. Hyder is a research project to develop a new
transactional indexed-record manager based on these technologies. It’s a
data-sharing system, where all compute servers have direct access to
shared flash storage and no direct-attached disk. Its main feature is
that it scales out without partitioning the database or application. It
is therefore well-suited to a data center environment, where scale-out
is especially important and where specialized flash hardware and
networking can be cost-effective. The software architecture that makes
this possible is radically different than classical transactional record
managers. It uses log-structured record storage, binary search trees,
and optimistic concurrency control. There is no locking, ARIES-style
logging, or B-trees. After a brief discussion of motivation, I will
spend most of the talk describing the architecture. This work is joint
with Colin Reid, also at Microsoft, and Sudipto Das at UCSB.

Phil Bernstein is a Principal Researcher in Microsoft Research. He
joined Microsoft in 1994 as a product architect and moved to Microsoft
Research in 1998. Over the past 30 years, he has been a product
architect at Digital Equipment Corp., a professor at Harvard University
and Wang Institute of Graduate Studies, and a VP Software at Sequoia
Systems. During that time, he has published over 150 papers on the
theory and implementation of database systems, and two books on
transaction processing. The second edition of his book Principles of
Transaction Processing, with Eric Newcomer, was published in 2009. He is
an ACM Fellow, a winner of the SIGMOD Innovations Award, and a member of
the National Academy of Engineering and Washington State Academy of