Loss Weighting in Multi-task Learning

Background The loss weights are uniform or manually tuned. GradNorm GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks Task imbalances impede proper…