Vai offline con l'app Player FM !
[QA] Do LLMs dream of elephants (when told not to)? Latent concept association and associative memory in transformers
Manage episode 425855573 series 3524393
Large Language Models can easily manipulate fact retrieval by changing contexts, behaving like associative memory models. Transformers use self-attention and value matrix for memory tasks.
https://arxiv.org/abs//2406.18400
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1252 episodi
Manage episode 425855573 series 3524393
Large Language Models can easily manipulate fact retrieval by changing contexts, behaving like associative memory models. Transformers use self-attention and value matrix for memory tasks.
https://arxiv.org/abs//2406.18400
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1252 episodi
Tutti gli episodi
×Benvenuto su Player FM!
Player FM ricerca sul web podcast di alta qualità che tu possa goderti adesso. È la migliore app di podcast e funziona su Android, iPhone e web. Registrati per sincronizzare le iscrizioni su tutti i tuoi dispositivi.