How to Run Llama 3 70B on a Home Server
If you want to run Llama 3 70B on a home server and actually reach it from your phone or laptop when you’re not home, the short version is: it’s doable, but you need real hardware and a tunnel that doesn’t depend on port forwarding. I spent the better part of a weekend getting this … Read more