Automotive A100 SXM2 for FSD? (NVIDIA DRIVE A100)

[Leiko]

On paper you can expect around 150TFlops in TF32 (18bit)
A100 SXM4 40G card has TF32 155TFlops


// The drive card has more rops over tesla A100 models, which should increase its performance processing images in int8 over normal A100 cards.
(Like resnet50 which typically runs with int8 precision -- non-image processing wise it might be bit slower than 40Gig SXM4 card)

This would be good comparison for AI workloads
View attachment 39905
(you can potentially expect int8, int4 and binary tops to be some 15-30% faster on the drive card -- i don't see them meaning quite a lot over 12bit precision)

where did you find the correct ROPs count ? The one on gpu database is wrong (the number of SMs is also wrong there)

 

[CyklonDX]

I must've read it wrong / clearly shows 128 rops and 192 tmu's.


must've mistaken it in my memory with this one here

'Enhanced' Nvidia A100 GPUs appear in China's second-hand market — new cards surpass sanctioned counterparts with 7,936 CUDA cores and 96GB HBM2 memory

These A100 cards come with 15% more CUDA cores and 20% more HBM2 than the 'normal' A100 PCIe.

www.tomshardware.com

// its even weaker than i remembered. *(i've got that gpu-z screen from some chinese site - don't have remember where anymore)

 

[Leiko]

I must've read it wrong / clearly shows 128 rops and 192 tmu's.
View attachment 40186

must've mistaken it in my memory with this one here

'Enhanced' Nvidia A100 GPUs appear in China's second-hand market — new cards surpass sanctioned counterparts with 7,936 CUDA cores and 96GB HBM2 memory

These A100 cards come with 15% more CUDA cores and 20% more HBM2 than the 'normal' A100 PCIe.

www.tomshardware.com

// its even weaker than i remembered. *(i've got that gpu-z screen from some chinese site - don't have remember where anymore)

I'm pretty sure you were correct about it being better for int8 than regular A100