Distributed Systems for Practitioners/

...

/

Hadoop Distributed File System and Google File System

Hadoop Distributed File System and Google File System

Learn what GFS and HDFS are. Look into the requirements and the architecture of GFS.

We'll cover the following...

Google File System (GFS)S. Ghemawat, H. Gobioff, and S.-T. Leung, “The Google File System,” Symposium on Operating Systems Principles ’03, 2003. is a proprietary distributed file system developed by Google. It is also the inspiration for the Hadoop Distributed File System (HDFS), a distributed file system developed as an Apache project.

Note: The basic design principles are similar for these two systems, with some small differences.

The core requirements of distributed file systems are as follows:

Fault tolerance

The system should continue to function despite any node failures.

Scalability

The system should be able to scale to huge volumes of stored information. ...