Hi, thank you very much for your code. But I have a doubt about the projection head. I think there should be two BN layers i.e. linear layer , BN , relu, linear layer, BN. I don't know if this should be the case, and how much impact the lack of BN layer has on the performance of the model. look forward to your reply. Thanks again.
Hi, thank you very much for your code. But I have a doubt about the projection head. I think there should be two BN layers i.e. linear layer , BN , relu, linear layer, BN. I don't know if this should be the case, and how much impact the lack of BN layer has on the performance of the model. look forward to your reply. Thanks again.