Spam Filter ISP Support Forum

  New Posts New Posts RSS Feed - message size and checking speed
  FAQ FAQ  Forum Search   Register Register  Login Login

message size and checking speed

 Post Reply Post Reply
Author
MarvinFS View Drop Down
Guest Group
Guest Group
Post Options Post Options   Thanks (0) Thanks(0)   Quote MarvinFS Quote  Post ReplyReply Direct Link To This Post Topic: message size and checking speed
    Posted: 15 May 2003 at 12:37pm

Roberto, i'm curious what to do with big size messages?
i found out that raw message size is in direct proportion with the speed of checking against blacklists...  for example i had 20 simults incoming connections with 84k message it took about 5+ minutes on my 2.5Ghz P4 CPU to parse it...

As u know i have 2 regexps in FROM: b/l and 2 in TO: b/l, also my FROM: b/l is 1.6 megs with overall 61000 entries, so.... any suggestions... or may be u have plans to optimize regexps performance somehow? may be the size of messages is the cause of those lockups?

Back to Top
LogSat View Drop Down
Admin Group
Admin Group
Avatar

Joined: 25 January 2005
Location: United States
Status: Offline
Points: 4104
Post Options Post Options   Thanks (0) Thanks(0)   Quote LogSat Quote  Post ReplyReply Direct Link To This Post Posted: 15 May 2003 at 10:24pm

Message size should only matter if you also have huge keyword lists. If your keyword file is 10KB-20KB, it can take 5-10 seconds to scan for hundreds-thousands of keywords in a single email. Multiply that by the concurrent connections and the wait time will add up.

How large is your keyword file?

For the regexps, we tried to optimize the searches by using regex searches only for the line in your lists that has a regex expression. Any other text that is not regex will be searched using regular text search, which is much faster. To be honest we have not done much testing on local lists that are as big as yours, we'll do so shortly.

Roberto
LogSat Software

Back to Top
 Post Reply Post Reply
  Share Topic   

Forum Jump Forum Permissions View Drop Down



This page was generated in 0.078 seconds.