In DSPy 2.5.31 I added… 🥁 async inference mode 🔥 We’ve heard a lot of you wanted async support for deploying your programs, and now here it is! TL;DR: async_program = dspy.asyncify(your_program) result = await async_program(…) https://t.co/V0Lv5MxiCZ
— Cyrus (The Prompt Doctor 🪄) (@cyrusofeden) Nov 17, 2024
from Twitter https://twitter.com/cyrusofeden
November 17, 2024 at 02:45PM
via IFTTT
No comments:
Post a Comment