Reweighing

What is reweighing?

Reweighing is a preprocessing bias mitigation method. The main goal is to assign greater weights to underrepresented samples, which modifies the model to consider them more meaningful. Because the number of minority samples is lower, combining them with bigger weights balances the result, making it equally important for all subgroups.

Example

Let’s see how it works with an example. Imagine we have two possible classes (admitted, rejected) and three groups. Due to different population sizes, many models might prefer to learn the correct behavior for majorities, which can result in discrimination against smaller subgroups.

First, we need to group training examples by a selected sensitive attribute. Let’s focus on the Space University admission problem. Our protected attribute is species, and the target is admission status. For each group, we count the number of observations with respect to the target class. We use two classes here, but there can be more; the procedure is exactly the same. Grouping results in a table like this: