PALM: Point-in-time Adaptation for Financial Language Models
This paper proposes PALM (Point-in-time Adaptation for financial Language Models) as an alternative to annual pre-training of financial language models. It achieves adaptation by fitting low-rank adapters on permitted financial text without modifying any pre-trained weights.
Read original