No problem with irfanview here, see image, clicked yes and poof, gone, removed from explorer files location but remains in the Irfanview window. Close irfanview, no problem, all working as expected.
What version are you using for avast and for Irfanview?
I'm using Irfanview 3.97.