I have been using Avast Free for a little over 20 years, long before it had a firewall. At that time I used a paid firewall solution until it was bought out (I had a lifetime license). By that point I used the standard Windows Firewall, I just stuck with this when Avast Free introduced a firewall component.
So it is entirely feasible to uninstall the avast firewall component and use the windows but seems a shame given you are using the Avast Premium product.
The Avast has two main network settings Private and Public. I don't know which you are using, possibly Public, which is much more strict. If so try changing the setting to Private/Home and see if that resolves this.
I'm sorry I can't be of more practical help as I'm not using Avast Premium or the Avast Firewall component.