Hi @clarkkev ,
To train Electric, use the same pre-training script and command as ELECTRA. Pass "electra_objective": false and "electric_objective": true to the hyperparameters. We plan to release pre-trained Electric models soon!
Is there still any plan to release pre-trained Electric models soon?
