Learning cuda from scratch

[Abhishek Kumar]

To better understand the gpu-based libraries like caffe/tensorflow which run on nvidia-gpus I am planning to learn cuda-processing over python or c++. It would help me in integrating different custom layers with the standard-libraries.
Please recommend some good books and share their experiences with cuda in the process of learning it.

Regards,
Abhishek

 

[Patrick]

Hi Abhishek,

Personally, I am looking more at the higher-level frameworks rather than going down into learning CUDA. There is only so much time in the day.

I have had these two books recommended to me:

• CUDA for Engineers: An Introduction to High-Performance Parallel Computing: 9780134177410: Computer Science Books @ Amazon.com
  
• Programming Massively Parallel Processors, Third Edition: A Hands-on Approach: David B. Kirk, Wen-mei W. Hwu: 9780128119860: Amazon.com: Books

But as a fair warning, I have not had the chance to read them myself.

I did do the Xeon Phi programming course at Colfax a few months ago. That was great. If they offer something similar in CUDA, that may be worth looking into.