sabreW4K3@lazysoci.al to Linux@lemmy.ml · 6 months agoJolla's Sailfish OS is moving to a subscription model, new phone (and a privacy-focused AI device) coming soon - Liliputingliliputing.comexternal-linkmessage-square36fedilinkarrow-up1109arrow-down111
arrow-up198arrow-down1external-linkJolla's Sailfish OS is moving to a subscription model, new phone (and a privacy-focused AI device) coming soon - Liliputingliliputing.comsabreW4K3@lazysoci.al to Linux@lemmy.ml · 6 months agomessage-square36fedilink
minus-squareDiabolo96@lemmy.dbzer0.comlinkfedilinkarrow-up9arrow-down1·edit-26 months agoThe ai box is 700$ ? Who’s gonna buy it? Anyway, If you anyone want to run local llm on their own phone then try 4bit quantized phi-3.
minus-squareDiabolo96@lemmy.dbzer0.comlinkfedilinkarrow-up2·edit-26 months agohttps://l.opnxng.com/r/LocalLLaMA/comments/1ce4300/phi3_works_under_laylalite_on_android/ Or https://llm.mlc.ai/docs/get_started/quick_start.html
The ai box is 700$ ? Who’s gonna buy it? Anyway, If you anyone want to run local llm on their own phone then try 4bit quantized phi-3.
With what app? How?
https://l.opnxng.com/r/LocalLLaMA/comments/1ce4300/phi3_works_under_laylalite_on_android/
Or
https://llm.mlc.ai/docs/get_started/quick_start.html