The scalar weight w KL controls the emphasis the model puts on debiasing vs. the original prediction task.
this conclusion is mirrored in table 6, which shows the accuracy of a neural network trained to predict the sensitive attributes from the trained embeddings.