Google presents: Stealing Part of a Production Language Model - Extracts the projection matrix of OpenAI’s ada and babbage LMs for <$20 - Confirms that their hidden dim is 1024 and 2048, respectively - Also recovers the exact hidden dim size of gpt-3.5-turbo… https://t.co/XiDzNGesZd https://t.co/8MxEC7BSEa
— Aran Komatsuzaki (@arankomatsuzaki) Mar 12, 2024
from Twitter https://twitter.com/arankomatsuzaki
March 12, 2024 at 02:23AM
via IFTTT
No comments:
Post a Comment