Hello, I want to standardize my home servers and reduce them to 3 Proxmox computers. 2x a Tiny server and a slightly more powerful one for AI (ollama/open webui and deepseek-r1-70b, CPU based only, no GPU).
For the more powerful server, I am wavering between 2 processors:
i9-10940X vs. i9-14900KS.
I can’t speak to AI performance, but given you’re stated goal of lower idle power consumption, I’d go with the 14900K, not the KS as you have listed.
Reason being the $250 price difference between the two, when the KS is just a slightly higher binning of the K with an additional 200MHz on the boost clocks. With that higher boost being something you’re unlikely to practically see without a substantial and robust cooling system, I don’t think it’s worth the extra money.
The reason I’d go with the K over the 10940X is the lower limit on it’s power consumption. The E cores are very efficient and can down clock substantially meaning it idles at really low power. The 10940X doesn’t have that benefit.
Beyond that, I’d say look at IPC, per thread, per max sustainable clock of each core, to get a general out look on performance.
Note: all of the above assumes we’re working within your listed options. My actual recommendation would be an AMD 7800x3d or 9800x3d.
Thank you! The AMD-Route sounds also promising, but I’m not sure about there idle power consumption. they say that intle is bettle in idle mode.
But i’m not sure if proxmox can handle the E-cores properly.
Might be a bit late on this, but ProxMox doesn’t really handle assigning threads to the e/p cores. That’s handled by the kernel and as long you’re running kernel version 6.1 or greater you should be good on that front.
If you really need to, you can also pin specific VMs to specific cores. So that if you’ve got something that always needs the performance it can always run on the p-cores and things that aren’t as demanding can always run on e-cores.
That said, especially if you’re over provisioning, it’s probably better to let the scheduler in the kernel handle thread assignments.
“They say”, but they’re right. Ryzen chips do have worse idle power usage, but you’re talking about 10w or so, at most.
And uh, if you were looking at an X-series CPU, I can’t see how that 10w is a dealbreaker, because you were already looking at a shockingly inefficient chip.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !selfhosted@lemmy.world
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don’t control.
Rules:
Be civil: we’re here to support and learn from one another. Insults won’t be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it’s not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don’t duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.
Resources:
selfh.st Newsletter and index of selfhosted software and apps
I can’t speak to AI performance, but given you’re stated goal of lower idle power consumption, I’d go with the 14900K, not the KS as you have listed.
Reason being the $250 price difference between the two, when the KS is just a slightly higher binning of the K with an additional 200MHz on the boost clocks. With that higher boost being something you’re unlikely to practically see without a substantial and robust cooling system, I don’t think it’s worth the extra money.
The reason I’d go with the K over the 10940X is the lower limit on it’s power consumption. The E cores are very efficient and can down clock substantially meaning it idles at really low power. The 10940X doesn’t have that benefit.
Beyond that, I’d say look at IPC, per thread, per max sustainable clock of each core, to get a general out look on performance.
Note: all of the above assumes we’re working within your listed options. My actual recommendation would be an AMD 7800x3d or 9800x3d.
Thank you! The AMD-Route sounds also promising, but I’m not sure about there idle power consumption. they say that intle is bettle in idle mode. But i’m not sure if proxmox can handle the E-cores properly.
Might be a bit late on this, but ProxMox doesn’t really handle assigning threads to the e/p cores. That’s handled by the kernel and as long you’re running kernel version 6.1 or greater you should be good on that front.
If you really need to, you can also pin specific VMs to specific cores. So that if you’ve got something that always needs the performance it can always run on the p-cores and things that aren’t as demanding can always run on e-cores.
That said, especially if you’re over provisioning, it’s probably better to let the scheduler in the kernel handle thread assignments.
“They say”, but they’re right. Ryzen chips do have worse idle power usage, but you’re talking about 10w or so, at most.
And uh, if you were looking at an X-series CPU, I can’t see how that 10w is a dealbreaker, because you were already looking at a shockingly inefficient chip.