corpus.db cannot be loaded
Printed From: LogSat Software
Category: Spam Filter ISP
Forum Name: Spam Filter ISP Support
Forum Description: General support for Spam Filter ISP
URL: https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=6608
Printed Date: 05 February 2025 at 5:51pm
Topic: corpus.db cannot be loaded
Posted By: hdokes
Subject: corpus.db cannot be loaded
Date Posted: 31 January 2009 at 2:51pm
|
Greetings, We are having a message that shows up every 60 seconds in the activity log stating: "corpus.db connot be loaded, waiting 60 seconds" Doesn't seem to effect the operation of the filter or software. Email passes in and out with no issues. At this stage it's just annoying but have to believe it is inhibiting some functionality of the service. Can you shed any light on this? Thanks |
Replies:
Posted By: LogSat
Date Posted: 31 January 2009 at 4:44pm
|
hdokes,
Can you please stop SpamFilter, delete (or rename) the SpamFilter/corpus directory, and then restart SpamFilter? That should clear and reset the corpus statistical database for the bayesian filter in case it was corrputed. ------------- Roberto Franceschetti http://www.logsat.com" rel="nofollow - LogSat Software http://www.logsat.com/sfi-spam-filter.asp" rel="nofollow - Spam Filter ISP |
Posted By: hdokes
Date Posted: 31 January 2009 at 6:24pm
Thanks a bunch Roberto. That did the trick. Recreated the directory and all is well.  We are a paid customer for spamfilter and it has always been my daughter that has worked with you. She has always had good things to say about you and the support you provide. I am the owner of the ISP that she worked at and have taken over her duties on the mail server as she has gone back to school to get am MBA... I do have some questions regarding the software however I will spend some time on the site here to get as many answers as I can and then I'll follow up with you. We recently lost a substantial customer because we could never get to a point that we either didn't have false positives on their email or they were getting to many spams per day with spamfilter. They went to a competitor and after 3 months claim they don't receive any spam and do not have any false positives or lost emails. I would like to understand what is the difference between what the spamfilter product and competing products out there as this is not the first time we have had to deal with this issue. I do know the competitor is using Baracuda for spam filtering. |
Posted By: LogSat
Date Posted: 31 January 2009 at 11:34pm
|
hdokes,
...it is impossible to have a situation where a company blocks 100% of the spam and yet allows 100% of legitimate emails to go thru. Even if there was a human rather than a computer monitoring all emails, they would make a mistake every now and then. We are very familiar with the Barracuda, and I'm afraid I doubt your old customer is being 100% honest with you  ------------- Roberto Franceschetti http://www.logsat.com" rel="nofollow - LogSat Software http://www.logsat.com/sfi-spam-filter.asp" rel="nofollow - Spam Filter ISP |
Posted By: hdokes
Date Posted: 01 February 2009 at 12:16am
|
Believe me Roberto, I've been in this business for 10 plus years, as an owner, and I am completely in your camp. Problem is... I picked up this customer several years ago and they moved to my ISP for mail and broadband services and their complaints started early regarding the spam they were receiving. They were with an entirely different provider before then and said the same thing... they never received as much spam as they were with our system from the previous provider and never had issues of false positives. Now... having seen nearly everything under the sun regarding spam issues from an age of no spam to 80% plus spam now... and being involved with setting spamfilter up on our systems from the very beginning... I too don't believe that it's possible... but they are not the only ones complaining about this and I don't have enough experience with these other systems to know if they actually are better or not. As we provide outsourced IT services to our customers as well... and this particular customer that decided to go elsewhere for their email still is an IT customer of ours and I have full access to their account with my competitor who is now providing their email services. I have been set up as a designated administrator. I intend to set up an email account and broadcast the address out there and find out what gets through and what doesn't. I will let you know how that goes. Thanks Roberto. |
Posted By: LogSat
Date Posted: 02 February 2009 at 6:41pm
|
It takes several months before a new email address is distributed amongst the various spammers. If possible, you could try to advertise two email addresses, one for each software/domain, so that the comparison will be more "fair".
------------- Roberto Franceschetti http://www.logsat.com" rel="nofollow - LogSat Software http://www.logsat.com/sfi-spam-filter.asp" rel="nofollow - Spam Filter ISP |
Posted By: hdokes
Date Posted: 03 February 2009 at 9:49am
|
Good idea Roberto. I will do that. Side note. I am having issues with filtering when the to and from have the same address. I have the filter set however I and my customers are being besieged with spam coming through that have the to and from addresses the same. Any thoughts? |
Posted By: LogSat
Date Posted: 03 February 2009 at 9:40pm
|
Please do note that SpamFilter acts upon the "real" email address specified in the email. This is often referred to as the "Envelope" address, or the "Return-Path" address. It is the email address that is provided by the sender's server in the "MAIL FROM" SMTP command.
SpamFilter logs this address in the following header: X-SF-RX-Return-Path: <some_email_address@here.com> And it also should appear in the "standard" header: Return-Path: <some_email_address@here.com> The "From:" header is used by email clients to display any email address the sender wants, it's not the real address were email bounces are sent to. SpamFilter thus ignores any addresses specified in the "From" headers. If spam emails are still coming thru even though, and the actual sender is indeed the same address as the recipient as can be verified with the above information, can you please also check the email headers to see if the email was whitelisted by any of your other filters? You can do that by looking for the header: X-SF-WhiteListedReason=*some reason will go here* If an email is whitelisted, it will bypass all filtering rules. This said, if you are still having problems with these emails not being blocked, if you can please zip and email us the following: • Your SpamFilter.ini file • Your \SpamFilter\Domains directory tree structure • Your SpamFilter’s activity logfile for a day these emails were received • The to/from email addresses for 2-3 emails that were incorrectly allowed thru We will try to debug your logs to see what is happening. If the zipped file is over 5MB in size, please upload it to our FTP site, for which I'll send you the login info via a PM. ------------- Roberto Franceschetti http://www.logsat.com" rel="nofollow - LogSat Software http://www.logsat.com/sfi-spam-filter.asp" rel="nofollow - Spam Filter ISP |
Posted By: hdokes
Date Posted: 12 March 2009 at 10:53am
|
Hello Roberto, My apologeze for not following up sooner. I did find that the email address in question was white listed and I pulled it out. So far... no other issues. Thank you. |