Only clear system_shared_libs when building for bionic am: 74985fccfb am: 293b5a5bc8 am: c4df296ad5 am: 7621d7701f

Original change: https://android-review.googlesource.com/c/platform/external/arm-optimized-routines/+/1968802

Change-Id: I9174171f2ae0726057235d73e2a173a7aa2a04c6