llmlingua - This really interesting lib from Microsoft can π°πΌπΊπ½πΏπ²ππ your prompt massively. π Reducing up to 20% of the prompt's original length (5x reduction), leading to massively reduced cost and latency. π₯ speed up LLMs' inference and enhance LLM's perceive of key… https://t.co/5CSbIew8ti https://t.co/IL1kr7G0Yg
— Rohan Paul (@rohanpaul_ai) May 9, 2024
from Twitter https://twitter.com/rohanpaul_ai
May 09, 2024 at 11:07AM
via IFTTT
No comments:
Post a Comment