Extended Efficient Layer Aggregation Networks (E-ELANs)

Why E-ELAN?

E-ELAN builds upon the ELAN (efficient longest available network) design strategy, which aims to design efficient networks. The primary motivation behind ELAN is to control the shortest longest gradient path, enabling deeper networks to learn and converge effectively. Analyzing the gradient path enables the weights of different layers to learn more diverse features, resulting in better predictions and reducing latency.

Based on this, ELAN authors came up with the conclusion listed below:

Limitations of ELAN

It is no longer possible to improve ELAN because it has reached a stable state, and adding more computational blocks may destroy this stable state and decrease ...