Don't mind me. Just running remote apps from a Windows Desktop and a Linux desktop while also testing Granite 4.0 in the background, all on the same GPUs. #vgpu

Congrats :)

Whey can't proxmox just kill all services to accomplish fencing? It takes like 10 minutes for a single server to boot into the OS. I think even the kernel watchdog can do a reset without a full system reboot.

That's not terrible but over about the 960gb starts to get out of my price range. I need a fairly large array for IOPS and redundancy so would be nice but can't fork over the dough.

Also reminds me I want to consider getting switches with redundant hot-swap PSUs

I think it's one of those things you have to get right the first time, otherwise you're stuck in the hell of "i can't touch the network because the entire cluster will hard crash and take 25 minutes to come back online and God I hope no disks were corrupted" My UPSs are getting kind of old and sometimes brown-outs don't trip fast enough, I had an issue where a quick power loss tripped up my main switch and looking at the logs 3/5 nodes lost quorum and the whole cluster hard crashed and hardware reset. I lost 3 VMs in the process I had to restore from backup. Took almost 2 hours to recover at 3 am XD

Yeah unixsurplus too. But the deals have been LACKING. SPD only sells individual units. Hoping to get a bulk discount by buying like 40 units

We all have limited time and priorities. It will come, it's still important to explain this nuance to people. If I had been told what I know now I probably would have never switched to proxmox. People see what they want to see and leave out the massive blocking complexities that require specialization in the domain. We can't all specialize in everything.

I just need to find a large box of decent brand (or enterprise) ssds over 500gb for a reasonable price. Surprisingly difficult to find.

I'm just holding out so I don't have to implement nip04 into noscrypt

What does it look like? Currently my SAN has a single 10g link which is my single point of failure, and I have not found a way to handle fallback to the 4gb lacp group it also has.

To be, nothing is better than having spare parts on hand. Had a fuel bowl leak out of knowhere. Check my toolbox. Ope there one is. 15 minute job. Ordering more spare gaskets and lids now.

I partially agree, but coming from Windows networking, linux networking sucks ass out of the box and the basic RTFM. Unless you learn to become a wizard (and I havent) having a balance of performance, HA, and hardware pricing, Windows just works out of the box. That and there is no reason for a hard crash when a single node loses quorum. I'm currently learning about STONITH, but that seems unreasonable when a link goes down due to a packet drop or a STP temporary lockout. Which means yeah, you SHOULD have physically redundant connections for a cluster network... Okay so another set of nics, and another switch, and another 40 ethernet patch cables... I already have 2 48 port switches almost at capacity.

Though you might like it!

I really liked a 2 node HA SAN setup with iSCSI and virtual IPs. Windows had SMB multichannel as a backhaul for HA storage quorum. SMB has fantastic performance with Windows using link aggregation, and load balancing so you can easily use a mix of 10g fiber and 1g. Linux cannot do this at all. LCAP blows in comparison. Iscsi multipath is better, but still. And I'm not sure if anyone has priced out 10gb switches lately...

Preferably like 3 more of me.

Something and i discussed a little while ago

Yeah me too, but hey I'm not complaining! I have a usb-ps2 adapter but never tried it so not sure how well it would work if I ever needed it.

tehe

You're gonna make me pick it up aren't you XD

Running a node on AWS is not running a node