kremata@alien.topB to Self-Hosted Main@selfhosted.forumEnglish · 11 months agoAs of today what would be the best AI to self-host on Linuxmessage-squaremessage-square11fedilinkarrow-up15arrow-down11file-text
arrow-up14arrow-down1message-squareAs of today what would be the best AI to self-host on Linuxkremata@alien.topB to Self-Hosted Main@selfhosted.forumEnglish · 11 months agomessage-square11fedilinkfile-text
minus-squareRedditSlayer2020@alien.topBlinkfedilinkEnglisharrow-up2·11 months agoNone, don’t host it yourself. You will need a ton of ram and a really powerfull PC. Additionally your electricity bill will go up significantly
minus-squareHoustonBOFH@alien.topBlinkfedilinkEnglisharrow-up3·11 months agoYou do know this is selfhosted, right? People tell us that what we do is “not a good idea” all the time.
minus-squareRedditSlayer2020@alien.topBlinkfedilinkEnglisharrow-up1·11 months agoIm all for selfhosting but LLMs is just stupid. But go for it you do you and evite the ride ♥
minus-squarejuanfdo82465@alien.topBlinkfedilinkEnglisharrow-up1·11 months agoAgree people be selfhosting to save money in subscriptions but then spend a 4090 and tons of energy to use an LLM from time to time
None, don’t host it yourself.
You will need a ton of ram and a really powerfull PC. Additionally your electricity bill will go up significantly
You do know this is selfhosted, right? People tell us that what we do is “not a good idea” all the time.
Im all for selfhosting but LLMs is just stupid. But go for it you do you and evite the ride ♥
Agree people be selfhosting to save money in subscriptions but then spend a 4090 and tons of energy to use an LLM from time to time