Unregister user listener when observers are inactive

Bug: 152340536
Test: atest KeyguardClockSwitchTest
Change-Id: I9a0cde64d5b9e94acd8c1b2bb0ac773fe82080b7
1 file changed