Gain insights into data processing and concurrency in Elixir. Explore GenServer, GenStage, Flow, and Broadway to enhance performance, set up pipelines, and handle increased workloads efficiently.

Concurrent Data Processing in Elxir by The Pragmatic Programmer-01.png

myDokcer.tar.gz

ch1_1

ch_3

ch_3.1

ch1_1-task supervisor

ch_4.1

ch_5.1 RabbitMQ

Ch_5.2 RabbitMQ

Most engineers don’t think that concurrency is distinct from programming. Data processing includes transforming information in some way, like reporting, data aggregation, or analytics. On the other hand, concurrency involves significantly improving performance.

This course is designed to help you navigate the world of concurrency tools available in the Elixir ecosystem. You’ll explore popular modules and libraries like GenServer, GenStage, Flow, and Broadway. You’ll be able to ingest data, set up pipelines, and run concurrent processes with Elixir.

By the end of the course, you’ll have a wide range of new techniques to simplify your product, improve code performance, and make your application more resilient to increased workloads.

Concurrent Data Processing in Elixir

It enables us to create non-interactive concurrent processes.

It enables us to create interactive concurrent processes.

It enables us to create interactive synchronous processes.

It enables us to create non-interactive synchronous processes.

Which statement is true about `GenServer`?


Which statement is true about <code>GenServer</code>?

Which callback function is triggered when a process starts?

Which callback function is triggered when a process starts?

After which of the following is `handle_continue/2` invoked?

After which of the following is <code>handle_continue/2</code> invoked?

It invokes the current process after a delay of 5 milliseconds periodically.

It terminates the current process after a delay of 5 milliseconds.

What does `Process.send_after(self(), :retry, 5000)` do?

What does <code>Process.send_after(self(), :retry, 5000)</code> do?

**(True or False)** A supervisor is a process that supervises other processes.

(True or False) A supervisor is a process that supervises other processes.

Which strategy restarts all child processes when one of them fails?

Which strategy restarts all child processes when one of them fails?

Which function gives us information about the number of processes currently running under the given supervisor?

Which function gives us information about the number of processes currently running under the given supervisor?

Running a high volume of concurrent jobs can potentially overwhelm our system, especially when the work requires a lot of system resources. How can we solve this?

Running a high volume of concurrent jobs can potentially overwhelm our system, especially when the work requires a lot of system resources. How can we solve this?

Getting Started

Easy Concurrency with the Task Module

Long-Running Processes Using GenServer

Data Processing Pipelines with GenStage

Process Collections with Flow

Data Ingestion Pipelines with Broadway

Concluding the Course

Quiz: Long-running Processes Using GenServer