I believe your understanding is correct.
I don't know if there is a diagnostic / debug log, but the prefetcher effect is cumulative and would explain your results.
My understanding is that you should turn off the prefetcher for performance testing (and repeatability). Prefetch is only going to make your app faster when it is ultimately turned on.