Przemyslaw Szczepaniak | d222d00 | 2018-10-15 11:44:03 +0100 | [diff] [blame] | 1 | Copyright 2017 The Android Open Source Project |
| 2 | |
| 3 | Licensed under the Apache License, Version 2.0 (the "License"); |
| 4 | you may not use this file except in compliance with the License. |
| 5 | You may obtain a copy of the License at |
| 6 | |
| 7 | http://www.apache.org/licenses/LICENSE-2.0 |
| 8 | |
| 9 | Unless required by applicable law or agreed to in writing, software |
| 10 | distributed under the License is distributed on an "AS IS" BASIS, |
| 11 | WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| 12 | See the License for the specific language governing permissions and |
| 13 | limitations under the License. |
| 14 | ------------------------------------------------------------------ |
| 15 | |
| 16 | This directory contains files for the Android MLTS (Machine Learning |
| 17 | Test Suite). MLTS allows to evaluate NNAPI acceleration latency and accuracy |
| 18 | on an Android device, using few selected ML models and datesets. |
| 19 | |
| 20 | Models and datasets used description and licensing can be found in |
| 21 | platform/test/mlts/models/README.txt file. |
| 22 | |
| 23 | Usage: |
| 24 | * Connect a target device to your workstation, make sure it's |
| 25 | reachable through adb. Export target device ANDROID_SERIAL |
| 26 | environment variable if more than one device is connected. |
| 27 | * cd into android top-level source directory |
| 28 | > source build/envsetup.sh |
| 29 | > lunch aosp_arm-userdebug # Or aosp_arm64-userdebug if available. |
| 30 | > ./test/mlts/benchmark/build_and_run_benchmark.sh |
| 31 | * At the end of a benchmark run, its results will be |
| 32 | presented as html page, passed to xdg-open. |
| 33 | |
| 34 | Changelog: |
| 35 | v0.1, 2018-10-15. Initial release with MobileNet(u8/f32)/TTS/ASR models. |
| 36 | |