Report Freq in additional benchmarks

PiperOrigin-RevId: 272021416
17 files changed
tree: e24c8f7d460366ae390913739423c781fe10cf5e
  1. bench/
  2. include/
  3. scripts/
  4. src/
  5. test/
  6. tools/
  7. CONTRIBUTING.md
  8. LICENSE
  9. preamble.js.lds
  10. README.md
README.md

XNNPACK

XNNPACK is a highly optimized library of floating-point neural network inference operators for ARM, WebAssembly, and x86 (SSE2 level) platforms. XNNPACK is not intended for direct use by deep learning practitioners researchers; instead it provides low-level performance primitives for accelerating high-level machine learning frameworks, such as MediaPipe, TensorFlow Lite, and TensorFlow.js.

Supported Architectures

  • ARM on Android, Linux, and iOS
  • ARM64 on Android, Linux, and iOS
  • WebAssembly MVP
  • WebAssembly SIMD (experimental)
  • x86 and x86-64 (up to SSE2 only) on Android, Linux, and Mac

Operator Coverage

XNNPACK implements the following neural network operators:

  • 2D Convolution (including grouped and depthwise)
  • 2D Deconvolution (AKA Transposed Convolution)
  • 2D Average Pooling
  • 2D Max Pooling
  • 2D ArgMax Pooling (Max Pooling + indices)
  • 2D Unpooling
  • Add (tensors of same shape)
  • Global Average Pooling
  • Channel Shuffle
  • Clamp (includes ReLU and ReLU6)
  • HardSwish
  • PReLU

All operators in XNNPACK support NHWC layout, but additionally allow custom stride along the Channel dimension. Thus, operators can consume a subset of channels in the input tensor, and produce a subset of channels in the output tensor, providing a zero-cost Channel Split and Channel Concatenation operations.

Acknowledgements

XNNPACK is a based on QNNPACK library. However, unlike QNNPACK, XNNPACK focuses entirely on floating-point operators, and its API is no longer compatible with QNNPACK.