Model overfitting when finetuned on smaller data

[diksham-flwls]

Hi
I am trying to finetune the model on a smaller dataset of 450 samples of greyhead renders that look like this

My training loss seems to be converging but the validation loss is diverging.
I am freezing everything but the final layers but otherwise using the exact same code as the repo.


When I plot the euclidean distance of the FC layer outputs I find that the distribution is pretty overlapping for matched (green) and unmatched pairs (red).

[silence-will20]

你好， 我正在尝试在一个较小的数据集上对模型进行微调，该数据集包含 450 个灰头渲染样本，如下所示

我的训练损失似乎正在收敛，但验证损失却在发散。 我冻结了除最后几层之外的所有内容，但其他部分使用的代码与代码库完全相同。 当我绘制全连接层输出的欧氏距离时，我发现匹配对（绿色）和不匹配对（红色）的分布相当重叠。

您好，请问这个问题您最后解决了吗