Should always be prefixed/suffixed with 'in your opinion.'
In my opinion as long as IE is so tightly integrated into the Operating System, has BHOs and uses activeX, there will be a risk, which is potentially greater than other browser (Chrome, Firefox, Opera). If you manage to exploit the IE browser you could have in effect exploited the OS.
I gave up on IE many years ago, but I'm forced to continue to update it because it is integrated into the OS you have to keep it up to date and get all the associated security updates for it.
Now the other browsers I mentioned are independent of the OS, not fully integrated and if you choose to abandon that browser for another, you don't have to keep getting updates for it for the life of your computer.
Hopefully the day will come when IE isn't integrated into the OS, then if you like it you can use it and switch browsers as things change and not be forced to continue with the updating of a browser you no longer use.