I’m having trouble finding a proper starting point for self hosting, so I am curious on any resources you’d recommend, or even some build lists / pre-built devices.
What I want to do:
Important
- Host some applications like TinyTinyRSS, Jellyfin, GitLab, and Nextcloud which I’d want to be accessible in my home network
- Use the computer as a NAS to back data up and have it easily accessible on my desktop and laptop
- Have a piHole
Optional
- Access my hosted applications from outside of my network
- Use tools like Radarr to automatically download things from torrent lists
- Use it as a seedbox
The reason the last three are optional is because for that I’d have to expose the computer to the outside network, which has a whole bunch of benefits, but also a whole bunch of risks I am likely neither capable of nor comfortable with working around, so unless there’s an easy fix (number 3 might be able to be handled via a VPN?) they’re a problem for future me. For anything further I think I can just go from here once those requirements develop
I have already skimmed through some articles, watched some build guides for both NAS and home servers and honestly I just don’t know what I need, both in information, hardware, and software.
- Should I separate the NAS and Home Server, get a separate device for the piHole, or just have all three in one?
- What hardware would be suitable for this?
- Should I buy something off the shelf like a mini PC (for instance an Intel NUC) or one of these fancy prebuilt NAS devices where you just need to plug in some drives or build my own?
- Would it be smarter to go with a Linux distro as the OS, for instance Debian, or should I use something like Unraid or TrueNAS which from what I can gather make setup more convenient and even handle docker images for you?
I am somewhat comfortable with Linux and the command line and have a budget of about 1000€, but if I can get away with less that would be great, and I can also stretch higher if needed for my requirements. I am also very new to self hosting and my networking knowledge is not non-existent, but limited.
I’m just a bit lost and would love some beginner-oriented resources or direct advice, thank you!
I quite liked this website for when I was starting out. Learned a bunch of what was needed and recommended. Author is also host on the podcast show called Selfhosted, truly a great resource for learning too!
That site is lovely, thank you!
I usually recommend beginners to start with a consumer plastic router and a regular PC as server.
A consumer router with 16 MB of flash and 128 MB of RAM running OpenWRT will be able to do pretty much everything you need from a router including port forwarding, DNS, DDNS, adblocking (like pihole), traffic shaping etc. They can usually be found super cheap and with even better specs (flash and RAM).
A regular PC will use off the shelf components that are cheap to buy used and easy to replace. It also lets you use regular 3.5" hdds as well as 2.5" hdds, ssds, nvmes and anything in between, and it doesn’t use USB for that, which is unreliable and prone to a million issues.
Again you don’t need super specs for the PC either, the smallest NVME you can find for the system drive and 8 GB of RAM plus a gen 6 Intel CPU will get you started and you can probably get this used for $50.
Use the PC for storage (NAS) and for hosting services, the router for network management, DNS and adblocking. If you know any Linux use it. If you don’t, install a ready-made tool and use that.
Buying USB enclosures and mini-pcs limits your options and ties you to cramped, unreliable and proprietary hardware.
Maybe the first question is what your budget is, both regarding money and time. For example, you could buy a pre-configured NAS from Synology or QNAP, which requires less technical skills but more money, or a home-made solution reusing used components (but fresh disks for reliability). Depending on your electricity costs, you may want to choose a low-power solution or something which you power off when not used. For storage, maybe a three-disk RAID5 is a good compromise. For backups, plain S3 cloud storage encrypted via restic is a good idea.
As I mentioned in the post, my money budget is around 1000€ as a target, but it extends both up and down. I can stretch if needed, but if that’s comically overkill then I’d be happy to go lower. Time budget… not too high, but also not super low. I can certainly spend a day or two setting everything up. Electricity costs are certainly a factor, power prices here were some of the highest globally, even before the extreme increases lately.
Also thanks for the tip of the S3 backup, it’s probably a good idea to have an extra copy of important data off-site, yeah.
Make a plan. Think about how much storage you need, whether you need redundancy and backups, and what server applications you need to run.
Here you also need to consider how much time you want to spend on maintenance. Premade solutions like Synology are set and forget. Using NAS operating systems mean having to do regular updates. Using just Linux is also an option if you want full control and are confortabile with the command line, but it’s more work.
Then step 2 is getting the hardware.
My recommended route, if you want to spend the least amount of money, is to get a 2nd hand PC, preferably not pre-built (dells and hps have proprietary parts like power supplies). A 4 core cpu from the last 10 years should be fine, and 16gb of RAM is more than enough for most applications. SFFs or MiniPCs might be ok for nvme SSDs only, but if you want hard drives, get one that has enough HDD bays. Depending on what you find, you might need to replace a few things, like the power supply or case.
Servers are good and reliable and have nice features, like network management, redundant NICs, redundant power supplies, but are usually pretty noisy.
I can share you a bit my journey and setups so maybe you can take a better decision.
About point 1:
In vultr with the second smallest shared CPU (1vCPU, 2GB RAM) several of my services have been running fine for years now:
invidious, squid proxy, TODO app (vikunja), bookmarks (grimoire), key-value storage (kinto), git forge (forgejo) with CI/CD (forgejo actions), freshrss, archival (archive-box), GPS tracker (traccar), notes (trilium), authentication (authelia), monitoring (munin).
The thing is since I’m the only one using them usually only one or two services receive considerable usage, and I’m kind of patient so if something takes 1 minute instead of 10 seconds I’m fine with it. This is rare to happen, maybe only forgejo actions or the archival.In my main pc I was hosting some stuff too: immich, jellyfin, syncthing, and duplicati.
Just recently bought this minipc https://aoostar.com/products/aoostar-r7-2-bay-nas-amd-ryzen-7-5700u-mini-pc8c-16t-up-to-4-3ghz-with-w11-pro-ddr4-16gb-ram-512gb-nvme-ssd
(Although I bought it from amazon so I didn’t had to handle the import.)Haven’t moved anything off of the VPS, but I think this will be enough for a lot of stuff I have because of the specs of the VPS.
The ones I’ve moved are the ones from my main PC.
Transcoding for jellyfin is not an issue since I already preprocessed my library to the formats my devices accept, so only immich could cause issues when uploading my photos.Right now the VPS is around 0.3 CPU, 1.1/1.92GB RAM, 2.26/4.8GB swap.
The minipc is around 2.0CPU (most likely because duplicati is running right now), 3/16GB RAM, no swap.There are several options for minipc even with potential to upgrade ram and storage like the one I bought.
Here’s a spreadsheet I found with very good data on different options so you can easily compare them and find something that matches your needs https://docs.google.com/spreadsheets/d/1SWqLJ6tGmYHzqGaa4RZs54iw7C1uLcTU_rLTRHTOzaA/edit
(Here’s the original post where I found it https://www.reddit.com/r/MiniPCs/comments/1afzkt5/2024_general_mini_pc_guide_usa/ )For storage I don’t have any comments since I’m still using a 512GB nvme and a 1TB external HDD, the minipc is basically my start setup for having a NAS which I plan to fill with drives when I find any in sale (I even bought it without ram and storage since I had spare ones).
But I do have some huge files around, they are in https://www.idrive.com/s3-storage-e2/
Using rclone I can easily have it mounted like any other drive and there’s no need to worry of being on the cloud since rclone has an encrypt option.
Of course this is a temporary solution since it’s cheaper to buy a drive for the long term (I also use it for my backups tho)About point 2:
If you go the route of using only linux sshfs is very easy to use, I can easily connect from the files app or mount it via fstab. And for permissions you can easily manage everything with a new user and ACLs.
If you need to access it from windows I think your best bet will be to use samba, I think there are several services for this, I was using OpenMediaVault since it was the only one compatible with ARM when I was using a raspberry pi, but when you install it it takes over all your net interfaces and disables wifi, so you have to connect via ethernet to re-enable it.
About point 3:
In the VPS I also had pihole and searxng, but I had to move those to a separate instance since if I had something eating up the resources browsing internet was a pain hehe.
Probably my most critical services will remain in the VPS (like pihole, searxng, authelia, squid proxy, GPS tracker) since I don’t have to worry about my power or internet going down or something that might prevent me from fixing stuff or from my minipc being overloaded with tasks that browsing the internet comes to a crawl (specially since I also ran stuff like whispercpp and llamacpp which basically makes the CPU unusable for a bit :P ).
About point 4:
To access everything I use tailscale and I was able to close all my ports while still being able to easily access everything in my main or mini pc without changing anything in my router.
If you need to give access to someone I’d advice for you to share your pihole node and the machine running the service.
And in their account a split DNS can be setup to only let them handle your domains by your pihole, everything else can still be with their own DNS.If this is not possible and you need your service open on the internet I’d suggest having a VPS with a reverse proxy running tailscale so it can communicate with your service when it receive the requests while still not opening your lan to the internet.
Another option is tailscale funnel, but I think you’re bound to the domain they give you. I haven’t tried it so you’d need to confirm.You don’t need to expose radarr/sonarr to the internet. Only your torrent client needs external access which would be routed through a VPN that offers port forwarding like AirVPN.
For hardware, I’m a big proponent of DIY. A NAS is very expensive and limiting since it has a fixed amount of bays. It’s much more econonomial to buy a case that can hold a ton of drives like the Fractal Design Define series and then run your own hardware. I’d suggest 32GB of RAM, a modern i5 CPU with QuickSync (for Jellyfin), and a motherboard that has as many SATA ports as you can get. Check PCPartPicker to compare features and prices.
To run everything, you might look into using Proxmox and then running all your stuff off that in VMs or containers.
I’d probably keep PiHole separate since you only need a RPi3 and you don’t want your whole network to go down if you restart the server. The rest can be run off the server.
Starting with a consumer NAS is a good spot, they come with a lot of upfront features that are designed to be easier to use for someone who isn’t already familiar with them. I have a synology and it did all the things you describe without issue (other than struggling with transcoding video in real time) and eventually graduated the heavier tasks like media and proper VM hosting to external secondhand mini PCs while still using the NAS as a network drive to store the data. The NAS itself includes docker and an easy to use repository browser that I use for things like pinhole or WLAN controller software, it has an onboard torrent client (which can use RSS and regex to automate downloads), and it has some other light hosting services, which it’s quite capable of. Starting with “just” the NAS and adding external devices as your use case shifts is always an option. Keep in mind that the best way of upgrading a NAS’ storage is leaving a bay open and upgrading disks one by one without having it do a “hard” rebuild from parity data, so 4 bays at least is a good starting point.
If you want to start with just an off the shelf NAS as an all in one device I would recommend making sure it either has or can take additional RAM (no such thing as too much), an NVME cache (more optional but nice) and an intel processor (quicksync transcoding, though the low end cpus will definitely still struggle with trying to turn 4K into 1080 for a stream). I’d be willing to bet most of the consumer NAS devices will all support docker at this point and have similar built in feature sets. Some of the newer models will support onboard 2.5gbe which is nice but probably unnecessary for a single user or family.
External access would be more of a job for your router/firewall which would use PAT to forward connections to your internal network, so that’s outside the scope of your NAS unless you’re building a true all in one box that acts as the central hub of your entire home network.
deleted by creator
+1 for Proxmox, has been a fun experience as there are plenty of resources and helper scripts to get you off the ground, jellyfin was the first thing I migrated from my PC, hardware encoding may give you a bit of a tussle but nothing unsolveable. Also note Proxmox is Debian under the hood, so you may find it easy to work with. I looked into unraid, it seems great if all you’re doing for the most part is storage, if you want Linux containers and virtual machines, proxmox js your bet.
I got a small 4 bay 2U server from a friend on the cheap, 1000$ should get you relatively nice new or slightly older used hardware. Even just a PC with a nice amount of drive bays will get you started. And drives are cheap, a raid 1 setup was one of the things I did.
In the end I’ll likely get a separate NAS rack server just to segregate functions, but as of now I simply have a Proxmox LXC mounted to my NAS drives and runs samba to expose them.
Tailscale is a nice set and forget solution for VPN access, I ended up going the route of getting an SSL certified domain and beefing up my firewall a bit. The bit I’ve messed with it it certainly has a learning curve greater than openvpn, but is much more hardened and versatile.
As for pihole, I’ve found AdGuard Home to be just about a suitable replacement, and can be installed along openwrt, though I have a bit of an unconventional router with 512MB of RAM so YMMV
Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I’ve seen in this thread:
Fewer Letters More Letters DNS Domain Name Service/System Git Popular version control system, primarily for code LXC Linux Containers NAS Network-Attached Storage NVMe Non-Volatile Memory Express interface for mass storage PCIe Peripheral Component Interconnect Express PiHole Network-wide ad-blocker (DNS sinkhole) Plex Brand of media server package RAID Redundant Array of Independent Disks for mass storage SATA Serial AT Attachment interface for mass storage SBC Single-Board Computer SSD Solid State Drive mass storage SSL Secure Sockets Layer, for transparent encryption VPN Virtual Private Network VPS Virtual Private Server (opposed to shared hosting)
[Thread #799 for this sub, first seen 11th Jun 2024, 19:25] [FAQ] [Full list] [Contact] [Source code]
for NAS I recommend samba behind a wireguard vpn