eeeh, 42000 e-mail from addresses |
Post Reply |
Author | |
MarvinFS
Guest Group |
Post Options
Thanks(0)
Posted: 15 April 2003 at 7:24am |
Roberto, I've got fresh antispam txt file with 42000 FROM: adresses (wildcards, etc) Clicking SAVE settings button was my mistake! :) Spamfilter is now in at a deadlock! :) (site of txt file was about a 1 Mb) size of ini file is now about 300k and still growing! :) it parsed settings about 15 minutes already.
|
|
LogSat
Admin Group Joined: 25 January 2005 Location: United States Status: Offline Points: 4104 |
Post Options
Thanks(0)
|
Never tested it with that many :-) Can you email us the file so we can reproduce it here? Could be that size is not an issue, but rather that an entry within that file is causing it to deadlock. Roberto Franceschetti |
|
MarvinFS
Guest Group |
Post Options
Thanks(0)
|
it was due to a size! :) it took about an hour to cmplete parsing! :) last entry in ini is now under number: cool! :) now, sendign you the file. another question could you measure if such a big number of addrsses will cause significant delays in mail checking? please answer here, i think it will be interesting for all.
|
|
LogSat
Admin Group Joined: 25 January 2005 Location: United States Status: Offline Points: 4104 |
Post Options
Thanks(0)
|
Part of why I asked for the file was to see how performance was affected. We have not particurarly optimized the exclusion lookup routines for speed as we did not expect that high number. Roberto F. |
|
LogSat
Admin Group Joined: 25 January 2005 Location: United States Status: Offline Points: 4104 |
Post Options
Thanks(0)
|
Tested your file, and definetly SpamFilter is not optimized for that number of exclusions. We're currently entering them in the SpamFilter.ini file, and that is not the right place to put them... We'll be then moving them as well in a separate file, as we recently did for other local black/white lists. This should definetly improve performance. I'll send you a beta release if you wish to test it out if you wish within a day or so. Roberto |
|
LogSat
Admin Group Joined: 25 January 2005 Location: United States Status: Offline Points: 4104 |
Post Options
Thanks(0)
|
Well, you're right, it was pretty slow importing the list and placing it in the ini file... We are placing the FROM and TO email blacklists in separate files. Preliminary testing shows a huge improvement in the import speed. The lookups in the list seemed to be already very efficient, so we made no changes there. We'll be releasing the new build within a few days.
Roberto Franceschetti
LogSat Software |
|
Post Reply | |
Tweet
|
Forum Jump | Forum Permissions You cannot post new topics in this forum You cannot reply to topics in this forum You cannot delete your posts in this forum You cannot edit your posts in this forum You cannot create polls in this forum You cannot vote in polls in this forum |
This page was generated in 0.168 seconds.