Masked Siamese Networks: Objective and Training

Similarity metric and predictions

To train the encoder, MSNs compute a distribution based on the similarity between a set of learnable prototypes $Q = \{q_1, q_2, ..., q_K\}$ (think of each prototype, $q_i$, as $d$-dimensional vectors, hence $Q$ is a $K\times d$ matrix) and each anchor, $z_i^m$ ...