AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Fine-Tuning Pre-Trained Models: Exploring Parameters and Sub-Networks
Linear probe is a technique of trying the softmax layer and not fine-tuning the rest of the layers./nFine-tuning a subset of the pre-trained model's parameters can be effective./nIdentifying a sub-network within the pre-trained model can help fine-tune biases of the units./nA template pre-trained model can be filled with data using the batch approach.