Make linkerconfig_diff_test faster am: a8df5054bd am: 6dc2c1dda6

Original change: https://android-review.googlesource.com/c/platform/system/linkerconfig/+/1961206

Change-Id: Id7d8d6e7b52993f0039d6e2be711813776f1c434