Reset prefetch cache expansion after initial prefetch

Fixes: 33038996
Test: @SmallTests still passing

Prevents large initial prefetch from permanently expanding the
recycler's cache.

Change-Id: Ie76c73055d6aa071cd0ea31712d7b538b0954821
3 files changed