I guess the question is, what do you plan to run?
Are you just running it as a file server or do you want to run containers and VMs as well?
I got myself a secondhand i7-920 HTPC and converted that to a server - but I'm also running it as a VM lab.
VMs not likely, but I already run several containers of RPi. Maybe I'll do some actual web dev stuff, even.