capybeby@sh.itjust.works to Lemmy Shitpost@lemmy.world · 10 days agoYes that is definitely what I was going for, thank yoush.itjust.worksimagemessage-square26fedilinkarrow-up1364arrow-down13
arrow-up1361arrow-down1imageYes that is definitely what I was going for, thank yoush.itjust.workscapybeby@sh.itjust.works to Lemmy Shitpost@lemmy.world · 10 days agomessage-square26fedilink
minus-squareayyy@sh.itjust.workslinkfedilinkarrow-up2·9 days agoApple’s autocorrect is based on GPT, of chatGPT fame, but it’s the GPT2 model which came out around 2015. Back then it ran on supercomputers, now it fits in your pocket. ChatGPT uses the GPT4 model which requires really big supercomputers for now.
minus-squaregmtom@lemmy.worldlinkfedilinkarrow-up3·9 days agoThat’s to train it. Even the most modern version of AIs like deepseek or get can run on a raspberry pi.
minus-squareayyy@sh.itjust.workslinkfedilinkarrow-up2·9 days agoOnly if you distill it to the point of uselessness (well, even more useless). Otherwise you wouldn’t have headlines like this.
minus-squaregmtom@lemmy.worldlinkfedilinkarrow-up1·9 days agoNo? I litterally run a local deepseek model on a raspberry pi to use as an alexa-like personal assistant.
minus-squareayyy@sh.itjust.workslinkfedilinkarrow-up1·9 days agoYea I guess it works fine for anything that doesn’t require a real context window.
Apple’s autocorrect is based on GPT, of chatGPT fame, but it’s the GPT2 model which came out around 2015. Back then it ran on supercomputers, now it fits in your pocket. ChatGPT uses the GPT4 model which requires really big supercomputers for now.
That’s to train it. Even the most modern version of AIs like deepseek or get can run on a raspberry pi.
Only if you distill it to the point of uselessness (well, even more useless). Otherwise you wouldn’t have headlines like this.
No? I litterally run a local deepseek model on a raspberry pi to use as an alexa-like personal assistant.
Yea I guess it works fine for anything that doesn’t require a real context window.