minus-squarekiku123@feddit.detoTechnology@beehaw.org•Advice - Getting started with LLMslinkfedilinkarrow-up3·6 months agoI agree. My 3070 runs the 8B Llama3 model in about 250ms, especially for short responses. linkfedilink
I agree. My 3070 runs the 8B Llama3 model in about 250ms, especially for short responses.