rockchip-npu-notes
gregordinary
Hardware reference and research notes for the RK3588 NPU and its regcmd interface
- Datatypes. The integer types are int4, int8 and int16, and the float types are fp16, bf16 and tf32. Each has a native matmul [HW sweep]. int16's int32 output saturates, so a matmul that needs int64-exact results over full-range int16 operands is computed as four int8 matmuls.
- On-chip requant. The DPU's output converter performs the requant of an int32 accumulator, with an integer multiplier and a shift. Its BS stage multiplies per output channel, which applies TFLite's per-axis scales on chip [HW sweep]. An int8 convolution therefore writes int8 with no host requant.










