he won't. if anything, openai is falling behind recently. the trend won't change easily. it is like the old time Netscape.

only works if the users are evenly distributed around the globe (which is likely more of less the case). if the user concentrates in on century, the token rate will be terrible.

i hope someone do a 100b 1-bit parameter model. that should fit into most 16GB graphics cards. local AI democratized.

i am guessing, without any proof, that, when one breaker fails the server lose it all, or loose two GPUs, depending on whether one connected to the cpu side failed.

GPUs aren't electrically isolated from the motherboard though. An entire computer is a single unified power domain.

The only place where there's isolation is stuff like USB ports to avoid dangerous ground loop currents.

That said I believe the PSU itself provides full isolation and won't backfeed so using two on separate circuits should (maybe?) be safe. Although if one circuit tripped the other PSU would immediately be way over capacity. Hopefully that doesn't cause an extended brownout before the second one disables itself.

9070XT provide roughly same inference performance at double the power, half the cost, as RTX PRO 4500. So this one is optimized for total BOM cost.

they could had gone with the Max-Q version RTX PRO 6000 and only require 120V circuit. 10% performance hit, but half the power.

fundamentally, looks like they are shipping consumer off-the-shelf hardwares in a custom box.

Yeah, the other big benefit is that the Max-Q's have blowers that exhaust the hot air out of the box, the workstation cards would each blow their exhaust straight into the intake of the card behind it. The last card in that chain would be cooking, as the air has already been heated up by 1800W, essentially a hair dryer on high.

Or could be the server edition 6000s that just have a heatsink and rely on the case to drive air through them, those are 600W cards.

for all past years, I have been told wayland is the future. but the decade long dragged out rolling out did not made much sense to me. neither did I investigate why. until today, I found out how difficult to force a 1920x1200 resolution over remote desktop. it is plain feature degradation.

people ask why do you need it. I have a 3440x1440 physical monitor on the server, I need to remove login with a 1920x1200 laptop. I want full screen at laptop's native resolution. Windows can do this decade ago.

the reality is no where to get the fuel. hydrogen stations are shutting down not building up.

China tests crewed spacecraft abort and rocket recovery in major lunar milestone

it is bizarre that a notepad app can have remote code execution. how much unnecessary function did MS add to get to this point?

Things started to go downhill when it stopped being a .exe in System32 and started being distributed through the MS Store. They've escalated from spell check and tabs to full rich text formatting (remember WordPad?) and Copilot. But this vulnerability stems from links in Markdown documents, so I guess they're well on their way to embedding most of a web browser as they rediscover all the security implications.