18-746/15-746 Lectures and Readings (Spring 2009)
For some class meetings, readings will be assigned. Usually, these
readings will consist of relevant technical papers, articles or
instructor-prepared notes. Paper copies of assigned readings and
notes will be provided in class and online. However, please note that
online versions of the readings are only available when accessed from
a 128.2.* (CMU) IP address.
The readings listed should be read BEFORE class on the assigned
day.
- The Google File System. Sanjay Ghemawat, Howard Gobioff, Shun-Tak Leung. Appears in ACM Symposium on Operating Systems Principles (SOSP), 2003.
(pdf)
- Bigtable: A Distributed Storage System for Structured Data. Fay Chang, Jeffrey Dean, Sanjay Ghemawat, Wilson C. Hsieh, Deborah A. Wallach, Mike Burrows, Tushar Chandra, Andrew Fikes, Robert E. Gruber. Appears in USENIX Symposium on Operating Systems Design and Implementation (OSDI), 2006.
(pdf)
- Recommended optional reading:
- MapReduce: Simplified Data Processing on Large Clusters. Jeffrey Dean and Sanjay Ghemawat. Appears in USENIX Symposium on Operating Systems Design and Implementation (OSDI), 2004.
(pdf)
- Designing for disasters. Kimberly Keeton, Cipriano Santos, Dirk Beyer, Jeffrey Chase, John Wilkes. Appears in the Proceesings of the Third Usenix Conference of File and Storage Technologies (FAST'04).
(pdf)
- A framework for evaluating storage system security. Erik Riedel, Mahesh Kallahalla, and Ram Swaminathan. Appears in the Proceesings of the First Usenix Conference of File and Storage Technologies (FAST'02).
(pdf)
- Recommended optional reading:
Serverless Network File Systems (xFS). Thomas
E. Anderson, Michael D. Dahlin, Jeanna M. Neefe, David A. Patterson,
Drew S. Roselli, Randolph Y. Wang. Appears in the ACM Transactions on
Computer Systems, Vol. 14, No. 1. February 1996. (pdf)
- Read the project 3 description.
- GPFS: A Shared-Disk File System for Large Computing Clusters. Frank Schmuck and Roger Haskin. Appears in FAST, January 2002. (pdf)
- Scalable performance of the Panasas Parallel File System. Brent Welch, Marc Unangst, et al. Appears in FAST, February 2008. (pdf)
- Same readings as L14.
- Recommended optional reading:
Network Attached Storage Architecture. Garth A. Gibson and Rodney Van Meter. Appears in the Communications of the ACM, Vol. 43, No. 11, November 2000. (pdf)
- The Design and Implementation of the 4.4BSD Operating System (Marshall Kirk McKusick, Keith Bostic, Michael J. Karels, and John S. Quarterman, 1996)
- Chapter 9 (The Network Filesystem) (pdf)
- Recommended optional reading:
- Scale and Performance in a Distributed File System. John H. Howard, Michael L. Kazar, Sherri G. Menees, David A. Nichols, M. Satyanarayanan, Robert N. Sidebotham, Michael J. West. Appears in the ACM Transactions on Computer Systems, Vol. 6, No. 1, Pages 51-81. February 1988. (pdf)
- Optional reading:
- Optional reading: "NFS Version 3 Protocol Specification" (RFC 1813:
B. Callaghan, B. Pawlowski, P. Staubach, June 1995) (txt)
- RAID: High-Performance, Reliable Secondary Storage (Peter M. Chen,
Edward K. Lee, Garth A. Gibson, Randy H. Katz, and David
A. Patterson, 1994) (same as L12)
- RAID: High-Performance, Reliable Secondary Storage (Peter M. Chen,
Edward K. Lee, Garth A. Gibson, Randy H. Katz, and David
A. Patterson, 1994)(pdf)
- The SCSI Bus & IDE Interface: Protocols, Applications & Programming, 2nd ed. (Friedhelm Schmidt, 1999)
- Chapter 11 (SCSI Architecture) (pdf)
- Soft Updates: A Solution to the Metadata Update Problem. Gregory R. Ganger, Markall Kirk McKusick, Craig A.N. Soules, Yale N. Patt. ACM Transactions on Computer Systems. May 2000. (pdf)
- Practical File System Design with the Be File System (Dominic Giampaolo, 1999)
- Chapter 7 (Journaling) (pdf)
- The Design and Implementation of the 4.4BSD Operating System (Marshall Kirk McKusick, Keith Bostic, Michael J. Karels, and John S. Quarterman, 1996)
- Chapter 8 (Local filestores) (pdf)
- Embedded Inodes and Explicit Grouping: Exploiting Disk Bandwidth for Small Files. Gregory R. Ganger and M. Frans Kaashoek. Appears in the Proceedings of the Usenix Technical Conference. January, 1997. (pdf) (ps)
- Practical File System Design with the Be File System. Dominic Giampaolo. 1999.
- Chapter 2 (What is a file system?) (pdf)
- UNIX Internals: The New Frontiers. Uresh Vahalia. 1996.
- Chapter 8 (File system interface and framework) (pdf)
- Scheduling Algorithms for Modern Disk Drives. Bruce L. Worthington, Gregory R. Ganger, and Yale N. Patt. Appears in the Proceedings of the ACM Sigmetrics Conference. May, 1994. (ps)
- An Introduction to Disk Drive Modeling. Chris Ruemmler and John Wilkes, 1994. (pdf)
- Digital Large System Mass Storage Handbook. Paul Massiglia. 1986.
- Probability Refresher. Mor Harchol-Balter. 2000. (pdf)
- Computer Architecture: A Quantitative Approach, 3rd ed. John L. Hennessy and David A. Patterson. 2002. (pdf)
- Section 7.7: "I/O performance measures"
- Section 7.8: "A Little queuing theory"
- Section 7.9: "Benchmarks of storage performance and availability"
- MTBF Description, Kevin Dally. 1995. (txt)
This first meeting will be more than just organizational in nature.
We will discuss how the class is going to work and what will (and won't)
be covered.
See the 18-746 overview for a recap of the
general information.
We will also dive into the course by overviewing the area of storage
systems.