There's a chance that LoRA finetunes work so well that it dramatically alters the finetuning vs. retrieval + few-shot prompting power dynamic in favor of the former for many applications. PEFT (Parameter Efficient Finetuning, LoRA included) are emerging techniques that make it… https://t.co/uPXSJJ684P
— Andrej Karpathy (@karpathy) Apr 20, 2023
from Twitter https://twitter.com/karpathy
April 20, 2023 at 12:07PM
via IFTTT
No comments:
Post a Comment