RPi 5: still no NPU?

[newabc]

The Raspberry Pi 5 was released.
link: Raspberry Pi 5 – Raspberry Pi

But it looks like the Raspberry Pi specific Broadcom BCM2712 hasn't came with an NPU.
It seems the features from NPU are not important in the North American and Western Europe users.

Its competitor, Rockchip, low end rk3566 has a 0.8TOPS NPU and semi flagship rk3588's NPU is 6 TOPS.

Of cause, RPi series hardware usually has a great RPi OS with a very long time length maintenance.

 

[BoredSysadmin]

 

[newabc]

Did a google search. Its result make me guess that probably Broadcom doesn't have a small and low price SoC product with CPU+GPU+(NPU/TPU) which fits the SBC market, even Broadcom designed 2 TPUs together with Google.

 

[unwind-protect]

Its competitor, Rockchip, low end rk3566 has a 0.8TOPS NPU and semi flagship rk3588's NPU is 6 TOPS.

What AI frameworks have drivers to take advantage of it?

 

[newabc]

What AI frameworks have drivers to take advantage of it?

Using Rockchip SoCs to make AI boards is on the market quite a while, like ASUS' Tinker Edge R(which has 1st gen RKNN). 2nd gen is on the market, too.

Drivers: GitHub - rockchip-linux/rknpu2
Userguide: https://github.com/rockchip-linux/r...kchip_RKNPU_User_Guide_RKNN_API_V1.4.0_EN.pdf
OpenCV: Working with Neural Processing Units (NPUs) using OpenCV

Searching "Rockchip NPU applications" will get some, like:

(1) Using Rockchip's 1st and 2nd gen RKNN with scikit-learn models:

Rockchip NPUs and deploying scikit-learn models on them - Martin's website/blog thingy

clehaxze.tw

(2) A discussion on Reddit(link)
https://www.reddit.com/r/OrangePI/comments/12b3jmj
(3) someone makes a small box to sell to America, but pricy:
Transformers models github:

GitHub - usefulsensors/useful-transformers: Efficient Inference of Transformer models

Efficient Inference of Transformer models. Contribute to usefulsensors/useful-transformers development by creating an account on GitHub.

github.com

But the products from "useful-sensors" are expensive comparing to OrangePi5

AI in a Box

Your own offline, private, open source LLM for conversations and more

www.crowdsupply.com

 

[newabc]

But the American and Western Europe markets are not important as China on edge computing with AI. So usually we saw the cell phones with NPU in America, but not the edge applications of AI.