Gain insights into data processing using Bash, sed, awk, and RegEx. Explore sorting, searching, replacing, and optimizing data tasks interactively with animated videos, projects, quizzes, and tasks.

tarballBash.tar.gz

code-job

spa-job

code-job-bash

2500+ students have taken this innovative project-based data learning course (includes video lectures). It demonstrates the use of Bash shell (Bash, sed and awk including RegEx) in processing textual data. It can help to learn to sort, search, match, replace, clean and optimize various aspects of data with Bash Shell. The target audience (students, researchers, scientists, journalists, data miners, developers) didn't have to go through any tough learning curve. This course also should have helped RedHat, SuSE and Ubuntu Linux learners and Data Science enthusiasts.  Regularly updated, new projects to come!

- Learn Bash commands interactively
- Projects with own stories and conclusive decisions
- Animated video lectures (for visual learners)
- Demonstrations
- Quizzes
- Learning tasks

Bloom's taxonomy (remember, understand, apply, analyze, evaluate and create) in developing your Linux skills. Learn Scientific Programming! scientificprogramming.io

Learn Data Science with Bash Shell

**Stream EDitor (SED)** is an important text-processing utilities on GNU/Linux. It uses a simple programming language and is capable of solving complex text processing tasks with few lines of code. This easy, yet powerful utility makes GNU/Linux more interesting.

SED can be used in many different ways, such as:

+   Text substitution,
+    Selective printing of text files,
+    In-a-place editing of text files,
+    Non-interactive editing of text files, and many more.


This tutorial will give you **just enough** knowledge to read and understand this book, to be a master on the SED, GREP and Find command, you need to explore relevant literature referenced at end of this book.

**Sed works as follows:** it reads from the standard input, one line at a time. for each line, it executes a series of editing commands, then the line is written to `STDOUT`. 

An example which shows how it works : we use the `s` sommand. `s` means "substitute" or search and replace. The format is

~~~~~~
sed s/regular-expression/replacement text/{flags} 
~~~~~~



In the example below, we have used `g` as a flag, which means "replace all matches" (global replacement):

~~~~~~
$ cat datafile.txt
  I have a big data!
    
$ sed -e 's/big/small/g' -e 's/data/list/g' datafile.txt
  I have a small list!
  
~~~~~~

Let's try to learn what happened. 

**Step 1**, sed read in the line of the file and executed

~~~~~~
    s/big/data/g
~~~~~~

which produced the following text:

~~~~~
    I have a small data!
~~~~~

**Step 2**, then the second replacement command (`'s/data/list/g'`) was performed on the edited line and the result was:

~~~~~
    I have a small list!
~~~~~

Take it easy!



Course Introduction

Project 1: Analyzing the 'US News' University Ranking Data

Project 2: Facebook Data Mining

Project 3: Australian Cities Crime Statistics

Project 4: Shakespearean-era plays and poems data mining

Bash Tutorials

REGEX Tutorials

AWK Tutorials

SED, GREP and Find Tutorials

Beyond the Text Files! Enter into the Big Data Landscape - Concepts

Conclusion

Hello! SED - Stream Editor