Spam Filter ISP Support Forum

  New Posts New Posts RSS Feed - Maximum Message Size for Spamfilter Check?
  FAQ FAQ  Forum Search   Register Register  Login Login

Maximum Message Size for Spamfilter Check?

 Post Reply Post Reply
Author
mikek View Drop Down
Senior Member
Senior Member
Avatar

Joined: 22 February 2005
Location: Switzerland
Status: Offline
Points: 133
Post Options Post Options   Thanks (0) Thanks(0)   Quote mikek Quote  Post ReplyReply Direct Link To This Post Topic: Maximum Message Size for Spamfilter Check?
    Posted: 10 October 2007 at 3:10am
I know there is an MaxMsgSizeForKeywordScan option, but is there also a MaximumMsgSizeForQuarantine or MaximumMsgSizeForSpamFiltering?

I my opinion, checking for Spam in Mails > 2 MB could be disabled (until Spammers start sending such big mails...)

The problem I'm having is I work with a MySQL Database and there you have to set the "Max Packet Size" to accomodate the largest INSERT into the quarantine that will be possible.

Now, with the "emtpy mail with attachments" filter, sometimes very large false positives can't get quarantined because I don't want to set my "Max Packet Size" to 30 MB or more just for these few mails and waste a lot of memory for all other operations.

Other thoughts or suggestions or do we have a feature request already? :-)
Back to Top
LogSat View Drop Down
Admin Group
Admin Group
Avatar

Joined: 25 January 2005
Location: United States
Status: Offline
Points: 4104
Post Options Post Options   Thanks (0) Thanks(0)   Quote LogSat Quote  Post ReplyReply Direct Link To This Post Posted: 10 October 2007 at 6:18pm
mikek,

This may be a very valid issue you brought up.

Are you looking for SpamFilter to:
(1) block what it thinks is a spam email larger than 2MB, but not enter it in the quarantine, or..
(2) if an email larger than 2MB arrives that SpamFilter thinks is spam, whitelist it and deliver it, since if it's over 2MB most likely it won't be spam as a spammer won't bother to send sch large emails?
Roberto Franceschetti

LogSat Software

Spam Filter ISP
Back to Top
mikek View Drop Down
Senior Member
Senior Member
Avatar

Joined: 22 February 2005
Location: Switzerland
Status: Offline
Points: 133
Post Options Post Options   Thanks (0) Thanks(0)   Quote mikek Quote  Post ReplyReply Direct Link To This Post Posted: 11 October 2007 at 4:26am
I would see a feature like a MaximumMsgSizeForSpamFiltering option. If the e-mail is larger than the configured value, only the anti-virus check will be done, but otherwise the mail is forwarded unfiltered.

When we see spammers sending larger mails in the future, the option value can be increased, knowing that the Max Packet Size for MySQL has to be increased to at least that value as well.
Back to Top
LogSat View Drop Down
Admin Group
Admin Group
Avatar

Joined: 25 January 2005
Location: United States
Status: Offline
Points: 4104
Post Options Post Options   Thanks (0) Thanks(0)   Quote LogSat Quote  Post ReplyReply Direct Link To This Post Posted: 22 October 2007 at 10:21pm
FYI - We're currently beta testing internally a new build of SpamFilter with the following additions:


// New to VersionNumber = '3.5.4.728';
{TODO -cNew : Added header 'X-SF-Originating-IP' in emails to additionally log the peer IP address}
{TODO -cNew : Added option MaxMsgSizeForSpamFiltering in SpamFilter.ini file to whitelist emails that are larger than a specific size}
{TODO -cNew : Added option ForwardAllSPAMtoEmailAddress in SpamFilter.ini file to forward all spam emails to an alternate email address}

Roberto Franceschetti

LogSat Software

Spam Filter ISP
Back to Top
mikek View Drop Down
Senior Member
Senior Member
Avatar

Joined: 22 February 2005
Location: Switzerland
Status: Offline
Points: 133
Post Options Post Options   Thanks (0) Thanks(0)   Quote mikek Quote  Post ReplyReply Direct Link To This Post Posted: 24 October 2007 at 5:21am
Cool, can't wait to get a hold of this new version (I even gave the new option it's name, I'm so proud of myself Smile)


Edited by mikek - 24 October 2007 at 5:27am
Back to Top
Thermo View Drop Down
Newbie
Newbie


Joined: 10 July 2006
Location: Canada
Status: Offline
Points: 25
Post Options Post Options   Thanks (0) Thanks(0)   Quote Thermo Quote  Post ReplyReply Direct Link To This Post Posted: 24 October 2007 at 5:01pm
The default setting is MaxMsgSizeForSpamFiltering=768 is this 768KB? To disable it do we leave it blank like this?

MaxMsgSizeForSpamFiltering=
Back to Top
LogSat View Drop Down
Admin Group
Admin Group
Avatar

Joined: 25 January 2005
Location: United States
Status: Offline
Points: 4104
Post Options Post Options   Thanks (0) Thanks(0)   Quote LogSat Quote  Post ReplyReply Direct Link To This Post Posted: 24 October 2007 at 5:04pm
mikek, your "baby" is ready for pickup Smile

We uploaded build 728 in the registered user area.
As a side-note, by default the value will be:

MaxMsgSizeForSpamFiltering=768

The above entry will be automatically created in the SpamFilter.ini file any time the "Save Settings" button is pressed. The 768 is KB.
If you have any input on that default value (too high, too low), we'd sure like to hear about it.
Roberto Franceschetti

LogSat Software

Spam Filter ISP
Back to Top
LogSat View Drop Down
Admin Group
Admin Group
Avatar

Joined: 25 January 2005
Location: United States
Status: Offline
Points: 4104
Post Options Post Options   Thanks (0) Thanks(0)   Quote LogSat Quote  Post ReplyReply Direct Link To This Post Posted: 24 October 2007 at 5:08pm
Thermo,

You have a valid point. We need to have an option to disable it, and we do not currently. For now, setting it to something like 1000000 (the value indicates KB, so this would be =1GB) should essentially render it ineffective and practically disable it.
Roberto Franceschetti

LogSat Software

Spam Filter ISP
Back to Top
mikek View Drop Down
Senior Member
Senior Member
Avatar

Joined: 22 February 2005
Location: Switzerland
Status: Offline
Points: 133
Post Options Post Options   Thanks (0) Thanks(0)   Quote mikek Quote  Post ReplyReply Direct Link To This Post Posted: 25 October 2007 at 2:44am
Hi Roberto,

Great job! Installed and testing...
Back to Top
Desperado View Drop Down
Senior Member
Senior Member
Avatar

Joined: 27 January 2005
Location: United States
Status: Offline
Points: 1143
Post Options Post Options   Thanks (0) Thanks(0)   Quote Desperado Quote  Post ReplyReply Direct Link To This Post Posted: 25 October 2007 at 12:03pm
Roberto, Et Al,
 
This new setting is fantastic!  Saves a lot of False Positives and saves CPU on my server.  The default size ... I have a "Spam Trap" address that is tag only and I sorted 19,457 by size.  1 was 190K, 10 fell in between 100K and 190K.  The rest are very small.  We are using a setting of 200K now and are awaiting the long term results but this setting looks VERY good right now.
The Desperado
Dan Seligmann.
Work: http://www.mags.net
Personal: http://www.desperado.com

Back to Top
LogSat View Drop Down
Admin Group
Admin Group
Avatar

Joined: 25 January 2005
Location: United States
Status: Offline
Points: 4104
Post Options Post Options   Thanks (0) Thanks(0)   Quote LogSat Quote  Post ReplyReply Direct Link To This Post Posted: 25 October 2007 at 2:38pm
mikek is the one to thank, it was his idea :-) !! and a mighty good one too... we're kicking ourselves for not having thought of it on our own!
Roberto Franceschetti

LogSat Software

Spam Filter ISP
Back to Top
 Post Reply Post Reply
  Share Topic   

Forum Jump Forum Permissions View Drop Down



This page was generated in 0.215 seconds.