Lora
![[논문리뷰] LoRA : Low-Rank Adaptation of Large Language Models + 코드](https://img1.daumcdn.net/thumb/R750x0/?scode=mtistory2&fname=https%3A%2F%2Fblog.kakaocdn.net%2Fdn%2FbM8S0C%2FbtsF41k0u8t%2FhwfTwJFunLlW2GP2fK7b00%2Fimg.png)
[논문리뷰] LoRA : Low-Rank Adaptation of Large Language Models + 코드
https://arxiv.org/abs/2106.09685 LoRA: Low-Rank Adaptation of Large Language Models An important paradigm of natural language processing consists of large-scale pre-training on general domain data and adaptation to particular tasks or domains. As we pre-train larger models, full fine-tuning, which retrains all model parameters, becomes le arxiv.org LoRA : Low-Rank Adaptation of Large Language Mo..