leanback: fix flaky tests

Dont wait activity isDestroyed() in afterTest.
And remove member mActivity from test class.

Bug: 36701683
Test: run DetailsFragmentTest multiple times on emulator
Change-Id: I0e0e037f6e85f86a1157a7640b864661cc074e4f
16 files changed