Common AI Inference API
Atriva supports pluggable AI inference backends.
Goals
- Hardware-agnostic execution
- Consistent APIs
- Optimized performance per device
Currently supported:
- OpenVINO
Platform supported soon:
- Rockchip
- Jetson
- MemryX
More runtimes will be added over time.