The meta provided code for fine-tuning llama models using lora + fsdp works really well, minor adjustments to tokenizing might be needed depending on your datasets but I would just use their code https://t.co/hO0Kfq6bzC
— anton (@abacaj) Oct 27, 2023
from Twitter https://twitter.com/abacaj
October 27, 2023 at 12:47PM
via IFTTT
No comments:
Post a Comment