Compatibility with TF.js WAsm build

- Use the same Emscripten toolchain identifier as TF.js
- Set :XNNPACK visibility to public

PiperOrigin-RevId: 272713655
2 files changed
tree: 35636b9c949772d784c7b754ab92fa66290f7b87
  1. bench/
  2. include/
  3. scripts/
  4. src/
  5. test/
  6. third_party/
  7. tools/
  8. .bazelrc
  9. BUILD
  10. build_defs.bzl
  11. CONTRIBUTING.md
  12. emscripten.bzl
  13. LICENSE
  14. preamble.js.lds
  15. README.md
  16. WORKSPACE
README.md

XNNPACK

XNNPACK is a highly optimized library of floating-point neural network inference operators for ARM, WebAssembly, and x86 (SSE2 level) platforms. XNNPACK is not intended for direct use by deep learning practitioners researchers; instead it provides low-level performance primitives for accelerating high-level machine learning frameworks, such as MediaPipe, TensorFlow Lite, and TensorFlow.js.

Supported Architectures

  • ARM64 on Android
  • ARM on Android
  • WebAssembly MVP
  • WebAssembly SIMD (experimental)
  • x86 and x86-64 (up to SSE2 only) on Android and Linux

Operator Coverage

XNNPACK implements the following neural network operators:

  • 2D Convolution (including grouped and depthwise)
  • 2D Deconvolution (AKA Transposed Convolution)
  • 2D Average Pooling
  • 2D Max Pooling
  • 2D ArgMax Pooling (Max Pooling + indices)
  • 2D Unpooling
  • Add (tensors of same shape)
  • Global Average Pooling
  • Channel Shuffle
  • Clamp (includes ReLU and ReLU6)
  • HardSwish
  • PReLU

All operators in XNNPACK support NHWC layout, but additionally allow custom stride along the Channel dimension. Thus, operators can consume a subset of channels in the input tensor, and produce a subset of channels in the output tensor, providing a zero-cost Channel Split and Channel Concatenation operations.

Publications

Acknowledgements

XNNPACK is a based on QNNPACK library. However, unlike QNNPACK, XNNPACK focuses entirely on floating-point operators, and its API is no longer compatible with QNNPACK.