Re: [AMBER] Alternatives to NVIDIA GPUs

From: James Kress via AMBER <amber.ambermd.org>
Date: Fri, 28 Feb 2025 16:00:33 -0500

Thanks Ross,

 

What other manufacturers offer devices similar to GeForce cards that can be
used in for AMBER?

 

I've attached a grok3 AI discussion about "What are the cuda compatible
alternative to NVIDIA GPUs?"

 

What do we do as we move forward?

 

Jim

 

James Kress Ph.D., President

The KressWorksR Foundation

An IRS Approved 501 (c)(3) Charitable, Nonprofit Corporation

"Engineering The Cure" C

(248) 573-5499

 

Learn More and Donate At:

Website: <http://www.kressworks.org/> http://www.kressworks.org

 

Confidentiality Notice | This e-mail message, including any attachments, is
for the sole use of the intended recipient(s) and may contain confidential
or proprietary information. Any unauthorized review, use, disclosure or
distribution is prohibited. If you are not the intended recipient,
immediately contact the sender by reply e-mail and destroy all copies of the
original message.

 

 

 

 

From: Ross Walker <rosscwalker.gmail.com> On Behalf Of Ross Walker
Sent: Friday, February 28, 2025 1:19 PM
To: jimkress_58.kressworks.org; AMBER Mailing List <amber.ambermd.org>
Subject: Re: [AMBER] Alternatives to NVIDIA GPUs

 

Hi Jim,

 

Yes unfortunately this is the future that myself and others warned about for
many years but nobody at the time would back us up - and indeed some people
actively attacked us for pointing out that this future was coming. :-(

 

NVIDIA are very aggressively going after vendors that even mention geforce
in servers or anything related to AI or simulation workloads on their
websites. They essentially ban them from selling any Tesla based hardware
and kick them out of all of the supply channels if they don't comply.
Probably illegal but it seems that nobody is willing to take on NVIDIA in
the courts. NVIDIA has also made it impractical to put Geforce cards in
servers by making them physically too large to fit. There have been a couple
of projects to address this. Both Gigabyte and MSI made blower versions of
the RTX4090 for a few weeks and then all of a sudden all traces of them
vanished including from the manufacturers websites. One can speculate why.

 

You can still get blower models but only from Chinese manufacturers, which I
assume are grey importing regular cards and then replacing the cooling
system etc. It's almost impossible to import these into the US however.

 

https://videocardz.com/newz/more-geforce-rtx-4090-ai-blower-cards-spotted-in
-china-while-the-price-keeps-going-up

 

So this is the unfortunate world we live in these days. Card manufacturers
are threatened with supply cancellation if they make server compatible cards
and vendors are 'coerced' into not offering GeForce solutions.

 

Now that said Exxact, Advanced HPC etc will sell Geforce solutions in
workstations with a maximum of 2 x 4090 or 2 x 5080/5090 in a single
workstation but one cannot go any denser than that. So the options these
days are:

 

1) Get workstations with 1 or 2 x Geforce cards in them and put them in
shelves in a rack.

2) Buy a 5U x 8 way server chassis with no GPUs and install up to 4 x
4090/5090 yourself - however this may need adapters / modification to the
power connectors since standard geforce cards now use different power
connectors to servers.

3) Find a way to import blower versions of the Geforce cards from China.

4) Settle for paying 3x extra per card and go with the 4500ADA, 5000ADA,
6000ADA etc quadro cards - these are still sold, for now, in server configs
and 2 slot blower format. It's expensive compared to the Geforce cards but
at least it's not the 10 to 15X that the Tesla cards cost.

 

All the best

Ross





On Feb 27, 2025, at 22:21, James Kress via AMBER <amber.ambermd.org
<mailto:amber.ambermd.org> > wrote:

 

I have already mentioned the discussions with AdvancedHPC. I have also
received off list coments like " I"m trying to get some GPU machines for my
lab and running into the same problem.. Vendors will not provide a system
configured w/ what I want. I've been told by SuperMicro that 4090 and 5090
are not certified for the motherboard but they have certified all the
"server" grade nvidia cards."

Jim Kress
James Kress Ph.D., President
The KressWorksR Foundation
An IRS Approved 501 (c)(3) Charitable, Nonprofit Corporation
"ENGINEERING THE CURE" C
(248) 573-5499

Learn More and Donate At:
Website:
https://urldefense.com/v3/__http://www.kressworks.org__;!!Mih3wA!Fq7FxbgZ1T7
029UGH-5TrLZi-eexMp-EpdkyMTNOMZL9qDYGfSJ1s7vjB7zRvWQonPPkgqmpTts$
<https://urldefense.com/v3/__http:/www.kressworks.org__;!!Mih3wA!Fq7FxbgZ1T7
029UGH-5TrLZi-eexMp-EpdkyMTNOMZL9qDYGfSJ1s7vjB7zRvWQonPPkgqmpTts$>

Confidentiality Notice | This e-mail message, including any attachments, is
for the sole use of the intended recipient(s) and may contain confidential
or proprietary information. Any unauthorized review, use, disclosure or
distribution is prohibited. If you are not the intended recipient,
immediately contact the sender by reply e-mail and destroy all copies of the
original message.



-----Original Message-----
From: Jones de Andrade via AMBER <amber.ambermd.org
<mailto:amber.ambermd.org> >
Sent: Friday, February 28, 2025 12:19 AM
To: AMBER Mailing List <amber.ambermd.org <mailto:amber.ambermd.org> >
Subject: Re: [AMBER] Alternatives to NVIDIA GPUs

Hi Jim, how are you?

Sorry for being somewhat "side Topic", but could you clarify and/or direct
me and any other uninformed maillist readers on what are those decisions and
how do they have such effects?

Thanks a lot,

Jones

Em 27 de fevereiro de 2025 19:04:16 BRT, James Kress via AMBER
<amber.ambermd.org <mailto:amber.ambermd.org> > escreveu:



Given NVIDIA's deliberate design decisions to eliminate the use of it

latest GPUs (e.g. 4090 and 5090) in servers commonly used by small to medium
research groups, what are alternatives we can use for AMBER?




One example of this is AdvancedHPC who has indicated to us they will not be

doing servers with RTX 4090 or 5090 GPUs,




Jim


_______________________________________________
AMBER mailing list
AMBER.ambermd.org <mailto:AMBER.ambermd.org>
https://urldefense.com/v3/__http://lists.ambermd.org/mailman/listinfo/amber_
_;!!Mih3wA!Fq7FxbgZ1T7029UGH-5TrLZi-eexMp-EpdkyMTNOMZL9qDYGfSJ1s7vjB7zRvWQon
PPkUaqAGLo$
<https://urldefense.com/v3/__http:/lists.ambermd.org/mailman/listinfo/amber_
_;!!Mih3wA!Fq7FxbgZ1T7029UGH-5TrLZi-eexMp-EpdkyMTNOMZL9qDYGfSJ1s7vjB7zRvWQon
PPkUaqAGLo$>

_______________________________________________
AMBER mailing list
AMBER.ambermd.org <mailto:AMBER.ambermd.org>
https://urldefense.com/v3/__http://lists.ambermd.org/mailman/listinfo/amber_
_;!!Mih3wA!Fq7FxbgZ1T7029UGH-5TrLZi-eexMp-EpdkyMTNOMZL9qDYGfSJ1s7vjB7zRvWQon
PPkUaqAGLo$
<https://urldefense.com/v3/__http:/lists.ambermd.org/mailman/listinfo/amber_
_;!!Mih3wA!Fq7FxbgZ1T7029UGH-5TrLZi-eexMp-EpdkyMTNOMZL9qDYGfSJ1s7vjB7zRvWQon
PPkUaqAGLo$>


_______________________________________________
AMBER mailing list
AMBER.ambermd.org <mailto:AMBER.ambermd.org>
https://urldefense.com/v3/__http://lists.ambermd.org/mailman/listinfo/amber_
_;!!Mih3wA!Fq7FxbgZ1T7029UGH-5TrLZi-eexMp-EpdkyMTNOMZL9qDYGfSJ1s7vjB7zRvWQon
PPkUaqAGLo$
<https://urldefense.com/v3/__http:/lists.ambermd.org/mailman/listinfo/amber_
_;!!Mih3wA!Fq7FxbgZ1T7029UGH-5TrLZi-eexMp-EpdkyMTNOMZL9qDYGfSJ1s7vjB7zRvWQon
PPkUaqAGLo$>

 



_______________________________________________
AMBER mailing list
AMBER.ambermd.org
http://lists.ambermd.org/mailman/listinfo/amber

Received on Fri Feb 28 2025 - 13:30:02 PST
Custom Search