Lowering the priority of that process would actually slow things down. This is because this process is scanning files as they're accessed, synchronously.
It might be a better idea to limit the number of programs you scan, e.g. exclude some of your folders from on-access scanning. Also, aren't you running stuff like the MS Office FastFind? Because this program accesses all files on your disk, triggering (unnecessary) heavy scans by avast...