Gain insights into data processing using Bash, sed, awk, and RegEx. Explore sorting, searching, replacing, and optimizing data tasks interactively with animated videos, projects, quizzes, and tasks.

tarballBash.tar.gz

code-job

spa-job

code-job-bash

2500+ students have taken this innovative project-based data learning course (includes video lectures). It demonstrates the use of Bash shell (Bash, sed and awk including RegEx) in processing textual data. It can help to learn to sort, search, match, replace, clean and optimize various aspects of data with Bash Shell. The target audience (students, researchers, scientists, journalists, data miners, developers) didn't have to go through any tough learning curve. This course also should have helped RedHat, SuSE and Ubuntu Linux learners and Data Science enthusiasts.  Regularly updated, new projects to come!

- Learn Bash commands interactively
- Projects with own stories and conclusive decisions
- Animated video lectures (for visual learners)
- Demonstrations
- Quizzes
- Learning tasks

Bloom's taxonomy (remember, understand, apply, analyze, evaluate and create) in developing your Linux skills. Learn Scientific Programming! scientificprogramming.io

Learn Data Science with Bash Shell

A variable is a temporary store for a piece of information. There are two actions we may perform for variables: first - setting a value for a variable, second - reading the value for a variable. To read the variable we place its name preceded by a `$` sign. To learn more, let's create a shell script that will backup the `home` directory into a zipped (`tar.gz`) file.

#!/bin/bash

 filename=homedirbackup_$(date +%Y%m%d).tar.gz
 tar -czf $filename /$home

Here the variable `filename` first accepts a file name that's being constucted off three strings `homedirbackup_`, current date, and `tar.gz` and then we use the variable to zip up our home dir. Note that when the variable gets called, it has a `$` infront of it. The `date` function with the given options will return today's date and built-in OS variable $HOME will give us the path to user's home directory.

**Bash variable types:**

In normal situations, we don't need to declare a variable type to use it. However, bash lets us declare integer, read only, array, associative array, and export type variables. For example, we can declare an integer (number) using `declare -i` we can read only a variable using `declare –r,` we use this when we want to assign a value to a variable that should not be allowed to change. Further more, Bash allows us to declare arrays with `-a` option or associative arrays with `-A` option (details given later in this chapter).



**Bash vairables can be local or global:**


A variable is a temporary store for a piece of information. There are two actions we may perform for variables: first - setting a value for a variable, second - reading the value for a variable. To read the variable we place its name preceded by a `＄` sign. To learn more, let's create a shell script that will backup the `home` directory into a zipped (`tar.gz`) file.

Here the variable `filename` first accepts a file name that's being constucted off three strings `homedirbackup_`, current date, and `tar.gz` and then we use the variable to zip up our home dir. Note that when the variable gets called, it has a `＄` infront of it. The `date` function with the given options will return today's date and built-in OS variable $HOME will give us the path to user's home directory.

**Bash variable types:**

In normal situations, we don't need to declare a variable type to use it. However, bash lets us declare integer, read only, array, associative array, and export type variables. For example, we can declare an integer (number) using `declare -i` we can read only a variable using `declare –r,` we use this when we want to assign a value to a variable that should not be allowed to change. Further more, Bash allows us to declare arrays with `-a` option or associative arrays with `-A` option (details given later in this chapter).



**Bash vairables can be local or global:**


Course Introduction

Project 1: Analyzing the 'US News' University Ranking Data

Project 2: Facebook Data Mining

Project 3: Australian Cities Crime Statistics

Project 4: Shakespearean-era plays and poems data mining

Bash Tutorials

REGEX Tutorials

AWK Tutorials

SED, GREP and Find Tutorials

Beyond the Text Files! Enter into the Big Data Landscape - Concepts

Conclusion

Bash variables and functions