Gain insights into data processing using Bash, sed, awk, and RegEx. Explore sorting, searching, replacing, and optimizing data tasks interactively with animated videos, projects, quizzes, and tasks.

tarballBash.tar.gz

code-job

spa-job

code-job-bash

2500+ students have taken this innovative project-based data learning course (includes video lectures). It demonstrates the use of Bash shell (Bash, sed and awk including RegEx) in processing textual data. It can help to learn to sort, search, match, replace, clean and optimize various aspects of data with Bash Shell. The target audience (students, researchers, scientists, journalists, data miners, developers) didn't have to go through any tough learning curve. This course also should have helped RedHat, SuSE and Ubuntu Linux learners and Data Science enthusiasts.  Regularly updated, new projects to come!

- Learn Bash commands interactively
- Projects with own stories and conclusive decisions
- Animated video lectures (for visual learners)
- Demonstrations
- Quizzes
- Learning tasks

Bloom's taxonomy (remember, understand, apply, analyze, evaluate and create) in developing your Linux skills. Learn Scientific Programming! scientificprogramming.io

Learn Data Science with Bash Shell

A typical need in the majority of distributed processing engines is the necessity to oversee resources. Hadoop YARN deals with such functions that are critical. The Hadoop world began with Map Reduce as the first data processing framework, but afterwards improved to include various project tasks. The majority of these projects have the same flow with regards to resource management. Basically, YARN abstracts a great deal of these projects and deals with the complex work for you. There are applications in the current Hadoop ecosystem that are composed in written format as YARN applications – as if each application converses with yarn and informs it what it needs to ensure the job is done. On the other hand, Yarn finds out what’s available and what to designate to a specific task.

https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/YARN.html

Course Introduction

Project 1: Analyzing the 'US News' University Ranking Data

Project 2: Facebook Data Mining

Project 3: Australian Cities Crime Statistics

Project 4: Shakespearean-era plays and poems data mining

Bash Tutorials

REGEX Tutorials

AWK Tutorials

SED, GREP and Find Tutorials

Beyond the Text Files! Enter into the Big Data Landscape - Concepts

Conclusion

YARN - Yet Another Resource Negotiator!