Fuck it, 685B parameter, DeepSeek V3 0324 running locally on M3 Ultra, fully private 🔥 Powered by llama.cpp & dynamic quants from @UnslothAI ⚡ Step 1: brew install llama.cpp Step 2: llama-cli -hf unsloth/DeepSeek-V3-0324-GGUF:Q2_K_XL That's it! 🤗 Honestly a bit surreal to https://t.co/SPWiLsjQJb
— Vaibhav (VB) Srivastav (@reach_vb) Mar 30, 2025
from Twitter https://twitter.com/reach_vb
March 30, 2025 at 05:27PM
via IFTTT
No comments:
Post a Comment