UW-Madison Logo

The ADvanced Systems Laboratory (ADSL)
Publication abstract

Zettabyte Reliability with Flexible End-to-end Data Integrity

Yupu Zhang, Daniel S. Myers, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau

Department of Computer Sciences, University of Wisconsin-Madison


We introduce flexible end-to-end data integrity for storage systems, which enables each component along the I/O path (e.g., memory, disk) to alter its protection scheme to meet the performance and reliability demands of the system. We apply this new concept to Zettabyte File System (ZFS) and build Zettabyte-Reliable ZFS (Z2FS). Z2FS provides dynamical tradeoffs between performance and protection and offers Zettabyte Reliability, which is one undetected corruption per Zettabyte of data read. We develop an analytical framework to evaluate reliability; the protection approaches in Z2FS are built upon the foundations of the framework. For comparison, we implement a straight-forward End-to-End ZFS (E2ZFS) with the same protection scheme for all components. Through analysis and experiment, we show that Z2FS is able to achieve better overall performance than E2ZFS, while still offering Zettabyte Reliability.

Full Paper: Postscript, PDF
Talk Slides: Powerpoint