Gain insights into data processing and concurrency in Elixir. Explore GenServer, GenStage, Flow, and Broadway to enhance performance, set up pipelines, and handle increased workloads efficiently.

Concurrent Data Processing in Elxir by The Pragmatic Programmer-01.png

myDokcer.tar.gz

ch1_1

ch_3

ch_3.1

ch1_1-task supervisor

ch_4.1

ch_5.1 RabbitMQ

Ch_5.2 RabbitMQ

Most engineers don’t think that concurrency is distinct from programming. Data processing includes transforming information in some way, like reporting, data aggregation, or analytics. On the other hand, concurrency involves significantly improving performance.

This course is designed to help you navigate the world of concurrency tools available in the Elixir ecosystem. You’ll explore popular modules and libraries like GenServer, GenStage, Flow, and Broadway. You’ll be able to ingest data, set up pipelines, and run concurrent processes with Elixir.

By the end of the course, you’ll have a wide range of new techniques to simplify your product, improve code performance, and make your application more resilient to increased workloads.

Concurrent Data Processing in Elixir

An asynchronous task runs in a parallel fashion.

An asynchronous task waits for another task being performed to be completed.

Which statement is true about asynchronous tasks?

Which statement is true about asynchronous tasks?

How many task(s) can perform operations in the synchronous mode?

How many task(s) can perform operations in the synchronous mode?

We are in a queue to get a movie ticket. We cannot get one until everybody in front of us gets one, and the same applies to the people queued behind us. Which mode is this situation an example of?

We are in a queue to get a movie ticket. We cannot get one until everybody in front of us gets one, and the same applies to the people queued behind us. Which mode is this situation an example of?

When using `await/1`, we expect a task to finish within a certain amount of time. What is the time amount value by default?

When using <code>await/1</code>, we expect a task to finish within a certain amount of time. What is the time amount value by default?

Which function returns `nil` if the task hasn’t been completed?

Which function returns <code>nil</code> if the task hasn’t been completed?

Which function allows us to check our results?

Which function allows us to check our results?

To stop a yield task, `Task.shutdown(task)` can be used. What is the second parameter in this function that immediately stops the task?

To stop a yield task, <code>Task.shutdown(task)</code> can be used. What is the second parameter in this function that immediately stops the task?

Let’s imagine we have 10 million users and want to send an email to all of them. Which of the following is the best option to use?

Let’s imagine we have 10 million users and want to send an email to all of them. Which of the following is the best option to use?

**(Select all that apply.)** How can the bad state of a task be avoided? 

(Select all that apply.) How can the bad state of a task be avoided?

 **(True or False)** When a process is restarted in Elixir, it replaces the old one using the same child specification.

(True or False) When a process is restarted in Elixir, it replaces the old one using the same child specification.

Getting Started

Easy Concurrency with the Task Module

Long-Running Processes Using GenServer

Data Processing Pipelines with GenStage

Process Collections with Flow

Data Ingestion Pipelines with Broadway

Concluding the Course

Quiz: Easy Concurrency with the Task Module