Can Small Language Models Learn, Unlearn, and Retain Noise Patterns?
Published in arXiv, 2024
Recommended citation: Scaria, N., Kennedy, S. J. J., & Subramani, D. N. Can Small Language Models Learn, Unlearn, and Retain Noise Patterns? arXiv. https://arxiv.org/abs/2407.00996
This paper investigates the ability of Small Language Models (1-3B parameters) to learn, retain, and eliminate different types of noise patterns during training and fine-tuning.