What’s the best affordable pre-built mini server available in Europe? I’m looking for a reliable and compact option that won’t break the bank
Edit: something that are not arm based
Edit 2: I’m looking to set up a system that can run Jellyfin, Ollama, and a few other small services. By ‘pre-built’, I mean I want to buy a device that already has the necessary hardware and installation, so all I need to do is install the operating system and I’m good to go
You need to first explain what you want the server for, because that will give us an idea of your CPU and storage requirements.
I’m looking to set up a system that can run Jellyfin, Ollama, and a few other small services.
Ollama is a big thing, do you want it to be fast? You will need a GPU, how large is the model you will be running be? 7/8B with CPU not as fast but no problem. 13B slow with CPU but possible
I am satisfied if it can run a 7/8B relatively fast
Edit: something that are not arm based
You want pre-built to run ollama, that’s at least gonna cost you an arm, maybe even a leg.
It depends on the model you run. Mistral, Gemma, or Phi are great for a majority of devices, even with CPU or integrated graphics inference.
Define “pre-built”?
What will you be using it for?
I’m still testing the CWWK X86 P5 but so far it seems like a near-perfect solution for personal use and the price can’t be best.
deleted by creator
I want to run Jellyfin, ollama (local AI), and some other small services.
Define pre-built.
How big is your media library?
Ollama will probably benefit from a more powerful processor like a Ryzen 7000/8000 series.
Can’t comment on NPUs and TOPs and all that. Still completely at a loss as to what is or is not marketing nonsense when it comes to AI. But the new Ryzen CPUs are supposed to have more of those, if you can wait.
By ‘pre-built’, I mean I want to buy a device that already has the necessary hardware and installation, so all I need to do is install the operating system and I’m good to go. Storage capacity between 1 and 8 terabytes
I want to buy a device that already has the necessary hardware
Does that include disks? That’s going to limit your options considerably.
The one I recommended does not come with RAM or storage but those are both very easy to install and you can choose what size. It also comes with 2xSATA/power connectors. You could get 2x8TB 2.5" SSDs but I’d probably go with 4x2TB NVMe, that would give you 8TB RAW or 6TB with a parity disk.
I have no problem with installing RAM and storage. Whats it called.
Check out used tiny/mini/micro desktops on eBay. Loads of info here: https://www.servethehome.com/introducing-project-tinyminimicro-home-lab-revolution/
Only downside is going to be no GPU for the AI workload. Maybe some of the later AMD APUs could cut it. If not, all three major manufacturers have SFF variants that are pretty much the same hardware in a little bigger case. Those will accept smaller off the shelf GPUs.
Prebuilt like a traditional server? I personally use an orange pi and it’s pretty good. Just make sure to use the open source arm OS.
I’m not sure if they’re still affordable but I ended up getting both a morefine and a beelink, one with the n100 Intel CPU and the other with the n305. They handle everything I’ve thrown at them, and come with out of the box quicksync transcoding for Jellyfin/Plex. Handles 4K transcode like a champ. Couple that with 2.5g Ethernet and they sip power. Though they might have gone up in price since I bought mine.
I have a beelink running jellyfin and it’s fine.
It has the n100.
2 bay nas with a Ryzen7 and up to 32GB ram.
Thanks i will take a look at that.
There is also a cheaper option with an N100
I love my NUCs but haven’t really paid attention to what has happened since Intel sold that line to ASUS.
Thanks i will take a look at the NUC.
You can try the Minisforum MS-01. Relatively compact, inexpensive, with a lot of options for expandability as well as relatively powerful Intel CPUs with QuickSync for LLM and transcode. Here is a nice overview of the device.
Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I’ve seen in this thread:
Fewer Letters More Letters NUC Next Unit of Computing brand of Intel small computers NVMe Non-Volatile Memory Express interface for mass storage Plex Brand of media server package SSD Solid State Drive mass storage
[Thread #785 for this sub, first seen 5th Jun 2024, 13:55] [FAQ] [Full list] [Contact] [Source code]
what are you gonna use it for?
something that are not arm based I’m looking to set up a system that can run Jellyfin, Ollama, and a few other small services. By ‘pre-built’, I mean I want to buy a device that already has the necessary hardware and installation, so all I need to do is install the operating system and I’m good to go
I see people mentioning small office desktops, and they are good, but I will warn you that they use proprietary parts so upgrading and repairing them can be difficult. Also jellyfin.org has some good info under the hardware acceleration section for what to use.
Raspberry PI
A used mini computer, like a lenovo thinkcentre, hp prodesk mini, and dell optiplex micro.
Dunno about affordable but you can usually find some decently priced 1L Dell Optiplex micro systems. I’ve got one running under my desk 24/7. Great Linux support.