Spam Filter ISP Support Forum

  New Posts New Posts RSS Feed - feature request - Thinking out loud...
  FAQ FAQ  Forum Search   Register Register  Login Login

feature request - Thinking out loud...

 Post Reply Post Reply
Author
Ric Marques View Drop Down
Guest Group
Guest Group
Post Options Post Options   Thanks (0) Thanks(0)   Quote Ric Marques Quote  Post ReplyReply Direct Link To This Post Topic: feature request - Thinking out loud...
    Posted: 19 March 2004 at 1:18pm

I have an idea for those of us that are NOT an ISP or large corporation - using spamfilter within our business to reduce costs of dealing with spam, that Logsat may be able to develop to help identify the false negatives slipping by.

Create an option to send all messages that SpamFilter determines to be VALID to a database (as well as delivering them to the intended recipient) so that we can sort through them with a browser interface and manually tag messages as spam (so that the bayesian filter can learn from it's mistakes, like it does now with false positives that are delivered from quarantine) or as not spam.  After a short period of time, the bayesian filter will become so much more efficient, the option could probably be turned off, reducing server overhead.

I understand this wouldn't work for most larger companies or ISP's... the sheer volume of messages would be unwieldy... but for those of us with traffic not exceeding 10K messages a day - it would be functional.

Whatdyathink?

Ric

Back to Top
aj View Drop Down
Guest Group
Guest Group
Post Options Post Options   Thanks (0) Thanks(0)   Quote aj Quote  Post ReplyReply Direct Link To This Post Posted: 21 March 2004 at 11:37am
Back to Top
ASB View Drop Down
Guest Group
Guest Group
Post Options Post Options   Thanks (0) Thanks(0)   Quote ASB Quote  Post ReplyReply Direct Link To This Post Posted: 21 March 2004 at 5:58pm
I'd definitely like to add support for such a feature.
Back to Top
LogSat View Drop Down
Admin Group
Admin Group
Avatar

Joined: 25 January 2005
Location: United States
Status: Offline
Points: 4104
Post Options Post Options   Thanks (0) Thanks(0)   Quote LogSat Quote  Post ReplyReply Direct Link To This Post Posted: 24 March 2004 at 11:48pm

Ric,

We've been examining various options on how to proceed with this. The greatest hurdle is that in order for the statistical filter to work correctly, the emails being examined must be *exactly* as they have been received. The problem lies in the fact that most users use either Outlook or Outlook Express. These apps, especially the 1st, GREATLY modify the email content, sometimes completely changing the source. If these clients were used to forward the email to a "de-spam" engine, the statistical analysis of these emails would be completely erraneous, and will cause unpredictable results.

The biggest issue is being able to store the original source of the email, to then "de-spam" it if users or admins tag it somehow as false positive. We're evaluating several options and hopefully soon will have something ready.

Roberto F.
LogSat Software

Back to Top
ASB View Drop Down
Guest Group
Guest Group
Post Options Post Options   Thanks (0) Thanks(0)   Quote ASB Quote  Post ReplyReply Direct Link To This Post Posted: 25 March 2004 at 12:29am

I think that what Ric is proposing/suggesting is that the messages that are deemed good, get placed in a different quarantine database *prior* to being passed on to the mail server.

This would allow an admin to go back into that database and stamp the message as one that should have been unfit.   No interaction would be needed with anyone's email client.

Back to Top
Ric Marques View Drop Down
Guest Group
Guest Group
Post Options Post Options   Thanks (0) Thanks(0)   Quote Ric Marques Quote  Post ReplyReply Direct Link To This Post Posted: 25 March 2004 at 12:03pm

Roberto -

"the emails being examined must be *exactly* as they have been received"

That's why I suggested copying all messages that are being sent to the MTA into a database at the same time. The messages will be original, unmodified.  I, as the systems admin, can then develop a web-based interface to sort and select those messages that are SPAM and tag them, and delete the valid messages.  SpamFilter can then see those tagged messages and make the necessary changes in the corpus file so that they'll be more likely to be caught as SPAM by the bayes filter when they come around again.

Again, I understand that this won't work for large ISP's.. but for a relatively small company like mine, it would be great.

-Ric

Back to Top
LogSat View Drop Down
Admin Group
Admin Group
Avatar

Joined: 25 January 2005
Location: United States
Status: Offline
Points: 4104
Post Options Post Options   Thanks (0) Thanks(0)   Quote LogSat Quote  Post ReplyReply Direct Link To This Post Posted: 25 March 2004 at 10:56pm

That was indeed one of our options, but we're trying to improve that a bit to reduce the hit on the database server.

Roberto F.
LogSat Software

Back to Top
LogSat View Drop Down
Admin Group
Admin Group
Avatar

Joined: 25 January 2005
Location: United States
Status: Offline
Points: 4104
Post Options Post Options   Thanks (0) Thanks(0)   Quote LogSat Quote  Post ReplyReply Direct Link To This Post Posted: 25 March 2004 at 11:05pm

Hi Ric,

Answered at http://www.logsat.com/spamfilter/forums/showmessage.asp?messageID=3340. We'll figure a way to do this!

Roberto F.
LogSat Software

Back to Top
fabravo View Drop Down
Guest Group
Guest Group
Post Options Post Options   Thanks (0) Thanks(0)   Quote fabravo Quote  Post ReplyReply Direct Link To This Post Posted: 29 March 2004 at 10:28am
I, like Ric, am not an ISP. Actually Ric and I are in the same business where we get a lot of 'good' mail from people we don't know.

Our mail server also looks for SPAM and catches a lot that gets through SF. Those mail come to me. I did read through the thread, but it seems to me that if I could 'bouce' those messages back to SF via a special address that it knows anything that comes to it is SPAM, it would be useful. I don't know if it is possible because of other mail headers that get put on by the mail server. Maybe you can set it up so that we can tell SF what the headers for our mail server are and what to ignore?

The last thing I need is another queue to go through, esp. one that has EVERY e-mail that comes in and gets passed along.

Like I said, don't know if it is possible, but seems like it would be easier than another queue.

\frank
Back to Top
 Post Reply Post Reply
  Share Topic   

Forum Jump Forum Permissions View Drop Down



This page was generated in 0.082 seconds.