Possible tip on prompting Llama-2. Try special tokens from llama's generation code (<<SYS>>, <</SYS>>, [INST], [/INST]). Answers seem better w/ them. LangSmith trace w/o tokens linked (also, image left): https://t.co/2pMnVZqyNy w/ tokens (right): https://t.co/s4HYgw3NIX https://t.co/1VQ0G9Vh0e
— Lance Martin (@RLanceMartin) Jul 20, 2023
from Twitter https://twitter.com/RLanceMartin
July 19, 2023 at 09:10PM
via IFTTT
No comments:
Post a Comment