Yes, the mentioned checkbox in the prefs is about on demand scans only.
Currently, the history of each shield shows 1000 most recent issues found by that shield. We probably will allow configuring that limit some day, but we have more important things in our to do list right now.
Regards
Mity