#79- LoRA and QLoRA.

Life with AI - A podcast by Filipe Lauar - Thursdays

Categories:

Hey guys, this is the first episode in a series of episodes about PEFT, Parameter Efficient Fine Tuning. In this episode I talk about LoRA and QLoRA, two widely used methods that allowed us to fine tune LLMs way faster and in a single GPU without losing performance. Video sobre QLoRA: ⁠https://www.youtube.com/watch?v=6l8GZDPbFn8⁠ LoRA paper: ⁠https://arxiv.org/pdf/2106.09685.pdf⁠ QLoRA paper: ⁠https://arxiv.org/pdf/2305.14314.pdf⁠ Instagram do podcast: https://www.instagram.com/podcast.lifewithai Linkedin do podcast: https://www.linkedin.com/company/life-with-ai