Weird behaviour of identity loss #24
Description
I am training the syncnet on the voxceleb dataset and I see a weird behaviour where the model is overfitting on the identity loss. The sync loss seems to be working fine.
And the weights assigned to each loss is 1.0.
