Adapters: the game changer for fine-tuning - Geoffrey Angus - The Data Scientist Show #084

The Data Scientist Show

Contenuto fornito da Daliana Liu. Tutti i contenuti dei podcast, inclusi episodi, grafica e descrizioni dei podcast, vengono caricati e forniti direttamente da Daliana Liu o dal partner della piattaforma podcast. Se ritieni che qualcuno stia utilizzando la tua opera protetta da copyright senza la tua autorizzazione, puoi seguire la procedura descritta qui https://it.player.fm/legal.

7M ago 52:45

MP3•Pagina principale dell'episodio

I interviewed Geoffery Angus, ML team lead @Predibase to talk about why adapter-based training is a game changer. We started with an overview of fine-tuning and then discussed five reasons why adapters are the future of LLMs. Later we also shared a demo and answered questions from the live audience. Try fine-tuning for free: https://pbase.ai/GetStarted Geoffrey’s LinkedIn:https://www.linkedin.com/in/geoffreyangus Daliana's Twitter: ⁠https://twitter.com/DalianaLiu⁠ Daliana’s LinkedIn: ⁠https://www.linkedin.com/in/dalianaliu/⁠

Daliana's Twitter: ⁠https://twitter.com/DalianaLiu⁠

Daliana’s LinkedIn: ⁠https://www.linkedin.com/in/dalianaliu/

Geoffrey’s LinkedIn: https://www.linkedin.com/in/geoffreyangus

Try finetuning for free: https://pbase.ai/GetStarted

(00:00:00) Intro

(00:01:19) What is Fine-tuning?

(00:08:18) Utilizing Adapters for Finetuning Enhancement

(00:09:50) 5 reasons why adapters are the future of LLMs

(00:26:34) Common Mistakes in Adapters Usage

(00:28:34) Training Your Own Adapter

(00:32:23) Behind the Scenes of the Adapter Training Process

(00:37:51) Config File Guidance for Fine-Tuning

(00:39:41) Debugging Strategies for Suboptimal Fine-Tuning Results

(00:42:23) User Queries: Creating a LoRa Adapter and Future Support

(00:51:06) Key Takeaways and Recap

90 episodi

#Tech #Daliana Liu