Totally depends on what you are downloading and the source, if either aren't totally kosher then perhaps you should. At the very least you should scan them before you run them, depending on what they are.
You could add a download manager to your system that could be used for both Firefox and Opera and have that call the ashQuick.exe to scan the download when complete, that is what I do. So no need to remember to scan it later...