You can't from the task manager, if it were that easy malware could do it.
You can temporarily disable from the avast tray icon, right click menu.
The greater issue is RAM usage, on my system it is very light.
What are you doing on your system at that time ?