No the Outlook/Exchange isn't checked by default (it wasn't for me) unless you have MS Outlook (not express) installed. So for most people they will see 6 of 7 providers running.
Perhaps I should rephrase that after a standard (non-custom) installation the Outlook/Exchange shouldn't be running. If you are doing a custom install you can uncheck the option.
If however, for whatever reason it is running after installation and you don't have MS Outlook, Terminate the Outlook/Exchange provider and answer Yes to the question (persist the changes, etc.).
All elements will be in the installation, just not running, even if you uncheck the option, so in the future if you use MS Outlook you can start it with no re-download/install, etc.