where did you find the correct ROPs count ? The one on gpu database is wrong (the number of SMs is also wrong there)
Automotive A100 SXM2 for FSD? (NVIDIA DRIVE A100)
- Thread starter Underscore
- Start date
Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
I must've read it wrong / clearly shows 128 rops and 192 tmu's.
must've mistaken it in my memory with this one here
www.tomshardware.com
// its even weaker than i remembered. *(i've got that gpu-z screen from some chinese site - don't have remember where anymore)
must've mistaken it in my memory with this one here
'Enhanced' Nvidia A100 GPUs appear in China's second-hand market — new cards surpass sanctioned counterparts with 7,936 CUDA cores and 96GB HBM2 memory
These A100 cards come with 15% more CUDA cores and 20% more HBM2 than the 'normal' A100 PCIe.
www.tomshardware.com
// its even weaker than i remembered. *(i've got that gpu-z screen from some chinese site - don't have remember where anymore)
Last edited:
I'm pretty sure you were correct about it being better for int8 than regular A100I must've read it wrong / clearly shows 128 rops and 192 tmu's.
View attachment 40186
must've mistaken it in my memory with this one here
'Enhanced' Nvidia A100 GPUs appear in China's second-hand market — new cards surpass sanctioned counterparts with 7,936 CUDA cores and 96GB HBM2 memory
These A100 cards come with 15% more CUDA cores and 20% more HBM2 than the 'normal' A100 PCIe.
// its even weaker than i remembered. *(i've got that gpu-z screen from some chinese site - don't have remember where anymore)
There is one very effective way of watercooling in winter time, that is 'tap water with restriction'. For example with restriction figures no more than 15 litres per hour of waste core temperature is less than 50℃
Code:
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 565.57.01 Driver Version: 565.57.01 CUDA Version: 12.7 |
|-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA DRIVE-PG199-PROD Off | 00000000:02:00.0 Off | 0 |
| N/A 48C P0 399W / N/A | 14623MiB / 32768MiB | 100% Default |
| | | Disabled |
+-----------------------------------------+------------------------+----------------------+
+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| 0 N/A N/A 7623 C ./gst 14610MiB |
+-----------------------------------------------------------------------------------------+No. Power limiting is not working fo this card (at least through nvidia-smi interface)
Code:
[pingyuin@ml ~]$ nvidia-smi -i 0 -pl 300
Changing power management limit is not supported in current scope for GPU: 00000000:02:00.0.
All done.
[pingyuin@ml ~]$ sudo nvidia-smi -i 0 -q -d MEMORY,UTILIZATION,POWER,CLOCK,COMPUTE
==============NVSMI LOG==============
Timestamp : Mon Dec 30 13:03:21 2024
Driver Version : 565.57.01
CUDA Version : 12.7
Attached GPUs : 1
GPU 00000000:02:00.0
FB Memory Usage
Total : 32768 MiB
Reserved : 462 MiB
Used : 14627 MiB
Free : 17681 MiB
BAR1 Memory Usage
Total : 16384 MiB
Used : 5 MiB
Free : 16379 MiB
Conf Compute Protected Memory Usage
Total : 0 MiB
Used : 0 MiB
Free : 0 MiB
Compute Mode : Default
Utilization
Gpu : 100 %
Memory : 100 %
Encoder : 0 %
Decoder : 0 %
JPEG : 0 %
OFA : 0 %
GPU Utilization Samples
Duration : 14.02 sec
Number of Samples : 71
Max : 100 %
Min : 91 %
Avg : 99 %
Memory Utilization Samples
Duration : 14.02 sec
Number of Samples : 71
Max : 100 %
Min : 33 %
Avg : 85 %
ENC Utilization Samples
Duration : 14.02 sec
Number of Samples : 71
Max : 0 %
Min : 0 %
Avg : 0 %
DEC Utilization Samples
Duration : 14.02 sec
Number of Samples : 71
Max : 0 %
Min : 0 %
Avg : 0 %
JPG Utilization Samples
Duration : 14.02 sec
Number of Samples : 71
Max : 0 %
Min : 0 %
Avg : 0 %
OFA Utilization Samples
Duration : 14.02 sec
Number of Samples : 71
Max : 0 %
Min : 0 %
Avg : 0 %
GPU Power Readings
Power Draw : 408.05 W
Current Power Limit : N/A
Requested Power Limit : N/A
Default Power Limit : N/A
Min Power Limit : N/A
Max Power Limit : N/A
Power Samples
Duration : Not Found
Number of Samples : Not Found
Max : Not Found
Min : Not Found
Avg : Not Found
GPU Memory Power Readings
Power Draw : N/A
Module Power Readings
Power Draw : N/A
Current Power Limit : N/A
Requested Power Limit : N/A
Default Power Limit : N/A
Min Power Limit : N/A
Max Power Limit : N/A
Clocks
Graphics : 1260 MHz
SM : 1260 MHz
Memory : 1404 MHz
Video : 1140 MHz
Applications Clocks
Graphics : 1260 MHz
Memory : 1404 MHz
Default Applications Clocks
Graphics : 1260 MHz
Memory : 1404 MHz
Deferred Clocks
Memory : N/A
Max Clocks
Graphics : 1275 MHz
SM : 1275 MHz
Memory : 1404 MHz
Video : 1155 MHz
Max Customer Boost Clocks
Graphics : 1260 MHz
SM Clock Samples
Duration : Not Found
Number of Samples : Not Found
Max : Not Found
Min : Not Found
Avg : Not Found
Memory Clock Samples
Duration : Not Found
Number of Samples : Not Found
Max : Not Found
Min : Not Found
Avg : Not Found
Clock Policy
Auto Boost : N/A
Auto Boost Default : N/AThat’s an SXM2 waterblock (I have some of those too). But earlier posts indicated that sxm2 heatsinks would need to be modified by filing out the screw holes since the hole spacing was 4mm wider on the A100 Drive. Did you have the same experience? Did you have to do that modification?
mind sharing the PCIe adapter board you used too?
mind sharing the PCIe adapter board you used too?
Code:
from pynvml import *
nvmlInit()
device = nvmlDeviceGetHandleByIndex(0)
nvmlDeviceSetGpuLockedClocks(device,10,135)
nvmlDeviceSetMemClkVfOffset(device,0)
nvmlDeviceSetGpcClkVfOffset(device,0)
nvmlDeviceSetPowerManagementLimit(device,300000)
Interesting I was referencing this older post earlier in the thread. https://forums.servethehome.com/ind...sd-nvidia-drive-a100.43196/page-2#post-439472 where he needed to file out the holes on his SXM2 heatsink (I also have this same heatsink) to mount to his A100 Drive unit.
I wonder why you didn’t need to modify anything where he did? The heatsink frame doesn’t look any different between yours and his.
I wonder why you didn’t need to modify anything where he did? The heatsink frame doesn’t look any different between yours and his.
There are 2 variants of this heatsink. The normal SXM2 and what they call NVV100, which I can't find anything about. The NVV100 is the right size (36mm instead of the 32mm for SMX2). You can see the two options here.
Oh wow. That clears it up. I bought four of the NVV100 Bykski blocks to use on my AOM-SXMV setup with 4x V100s but I ended up sticking with the 3U air coolers instead since they’re more than adequate. I didn’t even realize they were a different size since I never attempted to mount them. I just assumed they’d fit since they had V100 in the name. I’m guessing the NVV100-NVLink-X might be for the SXM3 V100?
pic comparing the 3U SXM2 air cooler (left) to the NVV100 waterblock (right).
I guess I have the right heatsinks already if I ever want to use these lol
pic comparing the 3U SXM2 air cooler (left) to the NVV100 waterblock (right).
I guess I have the right heatsinks already if I ever want to use these lol
Last edited:
I hear mercedes benz has it.
*it lists here a lot of chinese brands, and ai brands (but most known would be mercedes, volvo, hyundai.)
// tesla was using amd once upon time - but no clue if its still the case. *(there were hints of tesla investing into mi300's a while ago for their self-driving systems but who knows really it may be for spacex as it makes more sense there with their fp64 pipe - elon likely has hands in all cookie jars.)
Last edited: