What we'll see in 2024: • Models become a commodity; instruction data & reward functions are the moat • Model-generated data (RLAIF, REST^EM) increasingly outperforms human annotations • Model API costs plunge; we mostly finetune for legal, privacy, task performance reasons
— Eugene Yan (@eugeneyan) Jan 3, 2024
from Twitter https://twitter.com/eugeneyan
January 03, 2024 at 01:18AM
via IFTTT
No comments:
Post a Comment