Learn about big data and the Hadoop ecosystem, and explore streaming technologies. Gain the essential context to kick-start your big data journey confidently. Perfect for beginners.

Intro to Big Data, Hadoop, and Streaming-01.jpg

hadoop1.tar.gz

HDFS_NAMENODE_USER

HDFS_SECONDARYNAMENODE_USER

HDFS_DATANODE_USER

YARN_RESOURCEMANAGER_USER

YARN_NODEMANAGER_USER

Hadoop

Docker Compose

This course will help introduce new learners  to the field of big data, Hadoop ecosystem, and streaming. Perfect for beginners, this concise course will give you the context you need to start your big data journey on the right foot.

The No Nonsense Introduction To Big Data, Hadoop and Streaming

True or False: MapReduce makes programming distributed systems easier.

True or False: MapReduce makes programming distributed systems easier.

True or False: GFS and HDFS are two different names of the same implementation.

True or False: GFS and HDFS are two different names of the same implementation.

True or False: HDFS has a similar block size to other known file systems, like NTFS.

True or False: HDFS has a similar block size to other known file systems, like NTFS.

True or False: Distributed file systems are specialized to accommodate big files.


True or False: Distributed file systems are specialized to accommodate big files.

Nothing major, as there are replicas of those files.

What happens to the Hadoop files if a node fails?

What happens to the Hadoop files if a node fails?

Infinite, that's what scalability is about.

As much as is allowed by the cluster resource.

How much computation load can a typical Hadoop cluster handle?

How much computation load can a typical Hadoop cluster handle?

True or False: If a DataNode fails, we have no way to access its data.

True or False: If a DataNode fails, we have no way to access its data.

Bash scripting can trump MapReduce in terms of performance.

Bash scripting can trump MapReduce in terms of performance.

Test your understanding of the concepts learned in this section.

Before We Begin

Setting The Stage

The Hadoop Ecosystem

Streaming

Apache Spark

Conclusion

Quiz