Hi Jim,
Nobody really. I've been waiting over a decade now for someone to simply make a true cuda compiler for other hardware but everybody seems to want to reinvent the wheel, e.g. AMD ROCM/HIP, Intel OneAPI etc.
There is AMD port available for Amber 24 that you could try but your mileage may vary and I'm not sure how well it works with the AMD gaming cards.
As for other hardware, someone would need to volunteer (or sponsor) porting the code.
So, as of today NVIDIA has a monopoly, nobody really seems to want to put the effort in to upset the apple cart so there really are no good cost effective options anymore. It was nice while it lasted...
All the best
Ross
> On Feb 28, 2025, at 13:00, <jimkress_58.kressworks.org> <jimkress_58.kressworks.org> wrote:
>
> Thanks Ross,
>
> What other manufacturers offer devices similar to GeForce cards that can be used in for AMBER?
>
> I’ve attached a grok3 AI discussion about “What are the cuda compatible alternative to NVIDIA GPUs?”
>
> What do we do as we move forward?
>
> Jim
>
> James Kress Ph.D., President
> The KressWorks® Foundation
> An IRS Approved 501 (c)(3) Charitable, Nonprofit Corporation
> “Engineering The Cure” ©
> (248) 573-5499
>
> Learn More and Donate At:
> Website: http://www.kressworks.org <http://www.kressworks.org/>
>
> Confidentiality Notice | This e-mail message, including any attachments, is for the sole use of the intended recipient(s) and may contain confidential or proprietary information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, immediately contact the sender by reply e-mail and destroy all copies of the original message.
>
>
>
>
> From: Ross Walker <rosscwalker.gmail.com <mailto:rosscwalker.gmail.com>> On Behalf Of Ross Walker
> Sent: Friday, February 28, 2025 1:19 PM
> To: jimkress_58.kressworks.org <mailto:jimkress_58.kressworks.org>; AMBER Mailing List <amber.ambermd.org <mailto:amber.ambermd.org>>
> Subject: Re: [AMBER] Alternatives to NVIDIA GPUs
>
> Hi Jim,
>
> Yes unfortunately this is the future that myself and others warned about for many years but nobody at the time would back us up - and indeed some people actively attacked us for pointing out that this future was coming. :-(
>
> NVIDIA are very aggressively going after vendors that even mention geforce in servers or anything related to AI or simulation workloads on their websites. They essentially ban them from selling any Tesla based hardware and kick them out of all of the supply channels if they don't comply. Probably illegal but it seems that nobody is willing to take on NVIDIA in the courts. NVIDIA has also made it impractical to put Geforce cards in servers by making them physically too large to fit. There have been a couple of projects to address this. Both Gigabyte and MSI made blower versions of the RTX4090 for a few weeks and then all of a sudden all traces of them vanished including from the manufacturers websites. One can speculate why.
>
> You can still get blower models but only from Chinese manufacturers, which I assume are grey importing regular cards and then replacing the cooling system etc. It's almost impossible to import these into the US however.
>
> https://videocardz.com/newz/more-geforce-rtx-4090-ai-blower-cards-spotted-in-china-while-the-price-keeps-going-up
>
> So this is the unfortunate world we live in these days. Card manufacturers are threatened with supply cancellation if they make server compatible cards and vendors are 'coerced' into not offering GeForce solutions.
>
> Now that said Exxact, Advanced HPC etc will sell Geforce solutions in workstations with a maximum of 2 x 4090 or 2 x 5080/5090 in a single workstation but one cannot go any denser than that. So the options these days are:
>
> 1) Get workstations with 1 or 2 x Geforce cards in them and put them in shelves in a rack.
> 2) Buy a 5U x 8 way server chassis with no GPUs and install up to 4 x 4090/5090 yourself - however this may need adapters / modification to the power connectors since standard geforce cards now use different power connectors to servers.
> 3) Find a way to import blower versions of the Geforce cards from China.
> 4) Settle for paying 3x extra per card and go with the 4500ADA, 5000ADA, 6000ADA etc quadro cards - these are still sold, for now, in server configs and 2 slot blower format. It's expensive compared to the Geforce cards but at least it's not the 10 to 15X that the Tesla cards cost.
>
> All the best
> Ross
>
>
>> On Feb 27, 2025, at 22:21, James Kress via AMBER <amber.ambermd.org <mailto:amber.ambermd.org>> wrote:
>>
>> I have already mentioned the discussions with AdvancedHPC. I have also
>> received off list coments like " I"m trying to get some GPU machines for my
>> lab and running into the same problem.. Vendors will not provide a system
>> configured w/ what I want. I've been told by SuperMicro that 4090 and 5090
>> are not certified for the motherboard but they have certified all the
>> "server" grade nvidia cards."
>>
>> Jim Kress
>> James Kress Ph.D., President
>> The KressWorksR Foundation
>> An IRS Approved 501 (c)(3) Charitable, Nonprofit Corporation
>> "ENGINEERING THE CURE" C
>> (248) 573-5499
>>
>> Learn More and Donate At:
>> Website: https://urldefense.com/v3/__http://www.kressworks.org__;!!Mih3wA!Fq7FxbgZ1T7029UGH-5TrLZi-eexMp-EpdkyMTNOMZL9qDYGfSJ1s7vjB7zRvWQonPPkgqmpTts$ <https://urldefense.com/v3/__http:/www.kressworks.org__;!!Mih3wA!Fq7FxbgZ1T7029UGH-5TrLZi-eexMp-EpdkyMTNOMZL9qDYGfSJ1s7vjB7zRvWQonPPkgqmpTts$>
>>
>> Confidentiality Notice | This e-mail message, including any attachments, is
>> for the sole use of the intended recipient(s) and may contain confidential
>> or proprietary information. Any unauthorized review, use, disclosure or
>> distribution is prohibited. If you are not the intended recipient,
>> immediately contact the sender by reply e-mail and destroy all copies of the
>> original message.
>>
>>
>>
>> -----Original Message-----
>> From: Jones de Andrade via AMBER <amber.ambermd.org <mailto:amber.ambermd.org>>
>> Sent: Friday, February 28, 2025 12:19 AM
>> To: AMBER Mailing List <amber.ambermd.org <mailto:amber.ambermd.org>>
>> Subject: Re: [AMBER] Alternatives to NVIDIA GPUs
>>
>> Hi Jim, how are you?
>>
>> Sorry for being somewhat "side Topic", but could you clarify and/or direct
>> me and any other uninformed maillist readers on what are those decisions and
>> how do they have such effects?
>>
>> Thanks a lot,
>>
>> Jones
>>
>> Em 27 de fevereiro de 2025 19:04:16 BRT, James Kress via AMBER
>> <amber.ambermd.org <mailto:amber.ambermd.org>> escreveu:
>>
>>> Given NVIDIA's deliberate design decisions to eliminate the use of it
>> latest GPUs (e.g. 4090 and 5090) in servers commonly used by small to medium
>> research groups, what are alternatives we can use for AMBER?
>>
>>>
>>> One example of this is AdvancedHPC who has indicated to us they will not be
>> doing servers with RTX 4090 or 5090 GPUs,
>>
>>>
>>> Jim
>>>
>>>
>>> _______________________________________________
>>> AMBER mailing list
>>> AMBER.ambermd.org <mailto:AMBER.ambermd.org>
>>> https://urldefense.com/v3/__http://lists.ambermd.org/mailman/listinfo/amber__;!!Mih3wA!Fq7FxbgZ1T7029UGH-5TrLZi-eexMp-EpdkyMTNOMZL9qDYGfSJ1s7vjB7zRvWQonPPkUaqAGLo$ <https://urldefense.com/v3/__http:/lists.ambermd.org/mailman/listinfo/amber__;!!Mih3wA!Fq7FxbgZ1T7029UGH-5TrLZi-eexMp-EpdkyMTNOMZL9qDYGfSJ1s7vjB7zRvWQonPPkUaqAGLo$>_______________________________________________
>> AMBER mailing list
>> AMBER.ambermd.org <mailto:AMBER.ambermd.org>
>> https://urldefense.com/v3/__http://lists.ambermd.org/mailman/listinfo/amber__;!!Mih3wA!Fq7FxbgZ1T7029UGH-5TrLZi-eexMp-EpdkyMTNOMZL9qDYGfSJ1s7vjB7zRvWQonPPkUaqAGLo$ <https://urldefense.com/v3/__http:/lists.ambermd.org/mailman/listinfo/amber__;!!Mih3wA!Fq7FxbgZ1T7029UGH-5TrLZi-eexMp-EpdkyMTNOMZL9qDYGfSJ1s7vjB7zRvWQonPPkUaqAGLo$>
>>
>>
>> _______________________________________________
>> AMBER mailing list
>> AMBER.ambermd.org <mailto:AMBER.ambermd.org>
>> https://urldefense.com/v3/__http://lists.ambermd.org/mailman/listinfo/amber__;!!Mih3wA!Fq7FxbgZ1T7029UGH-5TrLZi-eexMp-EpdkyMTNOMZL9qDYGfSJ1s7vjB7zRvWQonPPkUaqAGLo$ <https://urldefense.com/v3/__http:/lists.ambermd.org/mailman/listinfo/amber__;!!Mih3wA!Fq7FxbgZ1T7029UGH-5TrLZi-eexMp-EpdkyMTNOMZL9qDYGfSJ1s7vjB7zRvWQonPPkUaqAGLo$>
>
> <cuda_alternative_GPUs.txt>
_______________________________________________
AMBER mailing list
AMBER.ambermd.org
http://lists.ambermd.org/mailman/listinfo/amber
Received on Fri Feb 28 2025 - 14:00:02 PST
