Continual machine learning is not yet a clear concept to me. But, if I load the weights of a transformer like BERT and perform training for some epochs using a different dataset, am I doing continual learning?
Qamar Ul Islam
Dear Jayr Pereira
I suggest the following links, have a look:
1. https://mccormickml.com/2019/07/22/BERT-fine-tuning/
2. https://towardsdatascience.com/a-comprehensive-hands-on-guide-to-transfer-learning-with-real-world-applications-in-deep-learning-212bf3b2f27a
3. https://medium.com/mini-distill/effect-of-batch-size-on-training-dynamics-21c14f7a716e
4. https://pytorch.org/assets/deep-learning/Deep-Learning-with-PyTorch.pdf
Kind Regards
Qamar Ul Islam
0 votes
0 thanks
- Badges
- Science topic
- Similar topics
- Psychology
- Mental Processes
- Learning
More Jayr Pereira's questions See All
Similar questions and discussions