ThefuzzyFurryComrade@pawb.socialM to Fuck AI@lemmy.world · 3 months agoOn Exceptionspawb.socialimagemessage-square264linkfedilinkarrow-up1507arrow-down179file-text
arrow-up1428arrow-down1imageOn Exceptionspawb.socialThefuzzyFurryComrade@pawb.socialM to Fuck AI@lemmy.world · 3 months agomessage-square264linkfedilinkfile-text
minus-squarewizardbeard@lemmy.dbzer0.comlinkfedilinkEnglisharrow-up3·3 months agoQuerying the LLM is not where the dangerous energy costs have ever been. It’s the cost of training the model in the first place.
minus-squarepixxelkick@lemmy.worldlinkfedilinkarrow-up2arrow-down1·3 months agoThe training costs effectively enter a “divide by infinity” argument given enough time. While they continue to train models at this time, eventually you hit a point where a given model can be used in perpetuity. Costs to train go down, whereas the usability of that model stretches on to effectively infinity. So you hit a point where you have a one time energy cost to make the model, and an infinite timescale to use it on.
minus-squareAuth@lemmy.worldlinkfedilinkEnglisharrow-up2·3 months agoCosts to train are going up exponentially. In a few years corps are going to want a return on the investment and they’re going to squeeze consumers.
minus-squarepetrol_sniff_king@lemmy.blahaj.zonelinkfedilinkarrow-up1·3 months ago eventually you hit a point where a given model can be used in perpetuity. I can’t wait for this to happen. Any day now, surely.
Querying the LLM is not where the dangerous energy costs have ever been. It’s the cost of training the model in the first place.
The training costs effectively enter a “divide by infinity” argument given enough time.
While they continue to train models at this time, eventually you hit a point where a given model can be used in perpetuity.
Costs to train go down, whereas the usability of that model stretches on to effectively infinity.
So you hit a point where you have a one time energy cost to make the model, and an infinite timescale to use it on.
Costs to train are going up exponentially. In a few years corps are going to want a return on the investment and they’re going to squeeze consumers.
I can’t wait for this to happen. Any day now, surely.