Author Topic: Permanently get rid of URL.db file  (Read 11184 times)

0 Members and 1 Guest are viewing this topic.

REDACTED

  • Guest
Permanently get rid of URL.db file
« on: December 08, 2016, 10:08:14 AM »
Hello all!

Some of my friends who use Google Maps on a regular (and a bit abusive ) basis (few hours a day) complained of performance issues.
I found out that Avast collects all URLs into URL.db and at startup it loads this file into memory. Since every zooming and panning you do on Maps will be transformed into a unique URL, the user generates thousands of URLs a day. Thus the URL.db file is huuuuge. In just a couple of months it grew to over 500 MB, but there were cases of 1.8 GB sized files, too. This resulted into intense HDD and RAM usage. Even where there is enough RAM, HDD will be used for reading in the contents of the file.
Deleting the file is just a temporary fix.
What is the definite fix for this?
Thanks!

PS: I want to disable only the (sub)component that is guilty.

Offline DavidR

  • Avast Überevangelist
  • Certainly Bot
  • *****
  • Posts: 89033
  • No support PMs thanks
Re: Permanently get rid of URL.db file
« Reply #1 on: December 08, 2016, 12:08:22 PM »
OK I have just found it in my XP Pro system
C:\Documents and Settings\All Users\Application Data\AVAST Software\Avast\URL.db
Or C:\ProgramData\AVAST Software\Avast\URL.db in later OSes

But it is no where near the size yours is. Mine is a little over 38MB, even so that is relatively large, it was created on 1 December 2015 and last modified today. On my win7 netbook which isn't so heavily used it is only 8.4MB and on my Win10 laptop it is only just over 6MB (but this is only 10 days old).

I'm not sure exactly what this is used for, at first I thought it could be related to checking DNS locations to confirm them. But why they could grow to that size is not good housekeeping.

So there certainly appears to be a problem.
Windows 10 Home 64bit/ Acer Aspire F15/ Intel Core i5 7200U 2.5GHz, 8GB DDR4 memory, 256GB SSD, 1TB HDD/ avast! free 24.3.6108 (build 24.3.8975.762) UI 1.0.801/ Firefox, uBlock Origin, uMatrix/ MailWasher Pro/ Avast! Mobile Security

Offline Alikhan

  • Avast Evangelist
  • Super Poster
  • ***
  • Posts: 2220
Re: Permanently get rid of URL.db file
« Reply #2 on: December 08, 2016, 12:30:02 PM »
I've just had a look at mines and it's currently at 28mb.

Mines was created on the 15th November when I formatted Windows and installed Avast again. It was last modified today.
Windows 10 Home 64-bit • Avast Free (latest stable version) •  Malwarebytes 4 Premium (On-Demand) • Windows Firewall Control • Google Chrome • LastPass • CCleaner • O&O ShutUp10 •

Offline novakja

  • Avast team
  • Jr. Member
  • *
  • Posts: 49
Re: Permanently get rid of URL.db file
« Reply #3 on: December 08, 2016, 12:48:47 PM »
Hello,
thank you very much for reporting such possible regression. We will investigate further. In the meantime, could I ask you, csabi98, for sending us support package (and posting the file ID here)?

Offline RejZoR

  • Polymorphic Sheep
  • Serious Graphoman
  • *****
  • Posts: 9406
  • We are supersheep, resistance is futile!
    • RejZoR's Flock of Sheep
Re: Permanently get rid of URL.db file
« Reply #4 on: December 08, 2016, 12:50:17 PM »
Would be nice to know the purpose of storing URL's. For CyberCapture maybe?
Visit my webpage Angry Sheep Blog


Offline novakja

  • Avast team
  • Jr. Member
  • *
  • Posts: 49
Re: Permanently get rid of URL.db file
« Reply #6 on: December 20, 2016, 06:11:28 PM »
@csabi98:
I tried to reproduce the behavior using custom web (and google maps) crawler. After letting it run for several days, the url.db did grow, but only up to few MB, so I am not able to reproduce the behavior you described. Anyway, it would really help us, if you could upload the big url.db file (and stadard avast support package) to our FTP for further analysis (once it grows in size again). Don't forget to post the File ID here so we can find it. Thank you in advance!

Offline Radon

  • Newbie
  • *
  • Posts: 8
Re: Permanently get rid of URL.db file
« Reply #7 on: December 21, 2018, 09:22:00 AM »
I have the same Problem...
My URL.db File is 7.11 Gigabyte.

And in the last days the Avast Service takes extreme long to start (more than 30 Minutes).

Is there already know an solution for this Problem ?
Or Knows anybody a way to stop this file from growing to such a extreme size ?

Offline bob3160

  • Avast Überevangelist
  • Probably Bot
  • *****
  • Posts: 48552
  • 64 Years of Happiness
    • bob3160 Protecting Yourself, Your Computer and, Your Identity
Re: Permanently get rid of URL.db file
« Reply #8 on: December 21, 2018, 01:48:40 PM »
I have the same Problem...
My URL.db File is 7.11 Gigabyte.

And in the last days the Avast Service takes extreme long to start (more than 30 Minutes).

Is there already know an solution for this Problem ?
Or Knows anybody a way to stop this file from growing to such a extreme size ?
Follow the request from Avast and send in the file.
https://forum.avast.com/index.php?topic=193999.msg1355342#msg1355342
Free Security Seminar: https://bit.ly/bobg2023  -  Important: http://www.organdonor.gov/ -- My Web Site: http://bob3160.strikingly.com/ - Win 11 Pro v22H2 64bit, 16 Gig Ram, 1TB SSD, Avast Free 23.5.6066, How to Successfully Install Avast http://goo.gl/VLXdeRepair & Clean Install https://goo.gl/t7aJGq -- My Online Activity https://bit.ly/BobGInternet

Offline rocksteady

  • Super Poster
  • ***
  • Posts: 1541
Re: Permanently get rid of URL.db file
« Reply #9 on: December 21, 2018, 03:10:21 PM »
I noticed the start of this thread was way back in 2016, so are Avast still looking at it?
I have checked both my XP and Win10 machines. XP has 3 files of which URL.db is just 9.90Mb.
Win10 machine has more and bigger files. See attachment.

Offline Radon

  • Newbie
  • *
  • Posts: 8
Re: Permanently get rid of URL.db file
« Reply #10 on: December 21, 2018, 04:02:02 PM »
I have the same Problem...
My URL.db File is 7.11 Gigabyte.

And in the last days the Avast Service takes extreme long to start (more than 30 Minutes).

Is there already know an solution for this Problem ?
Or Knows anybody a way to stop this file from growing to such a extreme size ?
Follow the request from Avast and send in the file.
https://forum.avast.com/index.php?topic=193999.msg1355342#msg1355342

Are you sure that I should upload a 7 Gigabyte file to this FTP ?

Offline DavidR

  • Avast Überevangelist
  • Certainly Bot
  • *****
  • Posts: 89033
  • No support PMs thanks
Re: Permanently get rid of URL.db file
« Reply #11 on: December 21, 2018, 04:40:11 PM »
I have the same Problem...
My URL.db File is 7.11 Gigabyte.

And in the last days the Avast Service takes extreme long to start (more than 30 Minutes).

Is there already know an solution for this Problem ?
Or Knows anybody a way to stop this file from growing to such a extreme size ?
Follow the request from Avast and send in the file.
https://forum.avast.com/index.php?topic=193999.msg1355342#msg1355342

Are you sure that I should upload a 7 Gigabyte file to this FTP ?

Whilst it is large, I would have thought this would have zipped down by quite a bit. 

See what it compresses down to and report its size.  Ultimately it is up to you on the size you are prepared to upload, internet connection speed or any data limits by your ISP, etc.

Also in the request from 'novakja' Reply #6 you run and also upload the standard support package.
-  Generate a support package https://www.avast.com/en-gb/faq.php?article=AVKB33#artTitle.
Windows 10 Home 64bit/ Acer Aspire F15/ Intel Core i5 7200U 2.5GHz, 8GB DDR4 memory, 256GB SSD, 1TB HDD/ avast! free 24.3.6108 (build 24.3.8975.762) UI 1.0.801/ Firefox, uBlock Origin, uMatrix/ MailWasher Pro/ Avast! Mobile Security

Offline Radon

  • Newbie
  • *
  • Posts: 8
Re: Permanently get rid of URL.db file
« Reply #12 on: January 04, 2019, 12:43:22 PM »
Whilst it is large, I would have thought this would have zipped down by quite a bit. 

See what it compresses down to and report its size.  Ultimately it is up to you on the size you are prepared to upload, internet connection speed or any data limits by your ISP, etc.

Also in the request from 'novakja' Reply #6 you run and also upload the standard support package.
-  Generate a support package https://www.avast.com/en-gb/faq.php?article=AVKB33#artTitle.

The File is to Big, it cant be compressed with zip.
I tried it with winRAR, but the File is still 3.3 GB in maimum compressed format.

The only remaining option would be to try the Support Package tool.

Offline DavidR

  • Avast Überevangelist
  • Certainly Bot
  • *****
  • Posts: 89033
  • No support PMs thanks
Re: Permanently get rid of URL.db file
« Reply #13 on: January 04, 2019, 03:15:07 PM »
Hopefully the Support package could help the Avast Team
Windows 10 Home 64bit/ Acer Aspire F15/ Intel Core i5 7200U 2.5GHz, 8GB DDR4 memory, 256GB SSD, 1TB HDD/ avast! free 24.3.6108 (build 24.3.8975.762) UI 1.0.801/ Firefox, uBlock Origin, uMatrix/ MailWasher Pro/ Avast! Mobile Security

Offline Radon

  • Newbie
  • *
  • Posts: 8
Re: Permanently get rid of URL.db file
« Reply #14 on: February 21, 2019, 01:35:41 PM »
I have now opened the file myself in a sqlite editor, and executed:

Code: [Select]
SELECT COUNT(*), URL FROM URLs GROUP BY URL HAVING count(*)>2 ORDER BY 1 ASC, URL;
That showed the reason for the huge size...

In the results I saw 2 entries are very often in this File:

Code: [Select]
5245153 http://192.168.0.1:49000/upnp/control/WANIPConn1
30229249 http://192.168.0.1:49000/upnp/control/WANCommonIFC1

That means the major reason for this big size, is that avast stores millions of scanns from upnp connections to my router.

The question now is, how i could stop Avast from dooing this ?