I will also second OpenWebUI. They’ve also recently made a lot of improvements to the system. I have a workflow for an emergency system using indexed offline zim files and exposing the index using FastAPI, then accessing it from OWI. Basically, I can run a small parameter model with the knowledge of Wikipedia or medical indexes. Perfect to run off a phone or small device in emergency situations with no power or internet.
Sounds like an issue with your network or routes. By design, WG is faster.
Please get some rest. You’re oddly irritable and delusional and it can’t be healthy.
You make weird assumptions seemingly based on outdated ideas. I’ll let you be, perhaps you need some rest.
You are misunderstanding the tech. That’s not how this works, models are trained often, did you think this was done only a few years ago? The fact that you called them bots says everything.
You’re just hating to hate on something, without understanding the technology. The efficiency I’m referring to is the MoE architecture that only got popular within the last year. There are still new architectures being developed, not that you care about this topic but would prefer to blindly hate on what’s spewed from outdated and biased news sources.
As with almost all technology, AI tech is evolving into different architectures that aren’t wasteful at all. There are now powerful models we can run that don’t even require a GPU, which is where most of that power was needed.
The one wrong thing with your take is the lack of vision as to how technology changes and evolves over time. We had computers the size of rooms to run processes that our mobile phones can now run hundreds of times more efficiently and powerfully.
Your other points are valid, people don’t realize how AI will change the world. They don’t realize how soon people will stop thinking for themselves in a lot of ways. We already see how critical thinking drops with lots of AI usage, and big tech is only thinking of how to replace their staff with it and keep consumers engaged with it.
Roxanne from the Goofy Movie for sure
Good point. I have used the Fladder app to download content!
I download all my content to my laptop/phone and then just run a server from there, either using jellyfin, vlc, or casting software to my firestick.
But since it’s a month long, it’s a decent amount of content. I mean, you’re already planning on buying ram so you could spin up a virtual server for like 15 bucks or less and just use that for a month.
Also since you’re bringing this pc, it doesn’t have to be crazy. I’d just use Windows or any OS you have and serve my content on the network using Jellyfin or VLC. Since it’s jellyfin you can use their clients and avoid transcending, and should be set on a mini pc.
You got this!