Back to News
Advertisement
Advertisement

⚡ Community Insights

Discussion Sentiment

50% Positive

Analyzed from 97 words in the discussion.

Trending Topics

#implement#own#kernels#openvino#operators#control#author#here#feel#free

Discussion (3 Comments)Read Original on HackerNews

hsfzxjy13 minutes ago
Author here. Feel free to ask any questions :)
Gigachadabout 2 hours ago
What is this useful for?
hsfzxjyabout 1 hour ago
The main use is enabling developers to write their own NPU kernels according to their respective need, instead of picking workaround from what Intel provides in OpenVINO. I think the project would benefit three scenarios:

1. Implement uncommon NN operators.

2. Implement a high-precision (FP32, etc.) version of existing OpenVINO operators for numerically sensitive usage.

3. Implement a mega kernel that fuse several small kernels together to reduce SHAVE invocations, and potentially improve performance.

But most importantly, it gives you more control over the hardware you own. That control IMO should have been yours from day one you bought the machine.