Print Page | Close Window

Unable to add email to quarantine -to many updates

Printed From: LogSat Software
Category: Spam Filter ISP
Forum Name: Spam Filter ISP Support
Forum Description: General support for Spam Filter ISP
URL: https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=6551
Printed Date: 05 February 2025 at 6:02pm


Topic: Unable to add email to quarantine -to many updates
Posted By: morten44
Subject: Unable to add email to quarantine -to many updates
Date Posted: 09 September 2008 at 10:38am
Hi
We have some issues that spamfilter block a mail and for some reason it is not sent to the spamfilter. See example below:
______________________________________________

09/08/08 22:36:32:734 -- (7812) Received MAIL FROM: <mary_knudsen@hotmail.com>
09/08/08 22:36:32:921 -- (7812) Received RCPT TO: asger@e-advice.dk
09/08/08 22:36:32:968 -- (7812) Resolving 65.54.246.212 - bay0-omc3-s12.bay0.hotmail.com
09/08/08 22:36:32:968 -- (7812) found SPF record for hotmail.com: v=spf1 include:spf-a.hotmail.com include:spf-b.hotmail.com include:spf-c.hotmail.com include:spf-d.hotmail.com ~all
09/08/08 22:36:32:968 -- (7812) found SPF record for spf-a.hotmail.com: v=spf1 ip4:209.240.192.0/19 ip4:65.52.0.0/14 ip4:131.107.0.0/16 ip4:157.54.0.0/15 ip4:157.56.0.0/14 ip4:157.60.0.0/16 ip4:167.220.0.0/16 ip4:204.79.135.0/24 ip4:204.79.188.0/24 ip4:204.79.252.0/24 ip4:207.46.0.0/16 ip4:199.2.137.0/24 ~all
09/08/08 22:36:32:968 -- (7812) SPF query result: pass
09/08/08 22:36:32:968 -- (7812) - SPF analysis for spf-a.hotmail.com done: - pass
09/08/08 22:36:32:968 -- (7812) SPF query result: pass
09/08/08 22:36:32:968 -- (7812) - SPF analysis for hotmail.com done: - pass
09/08/08 22:36:32:968 -- (7812) Mail from: mary_knudsen@hotmail.com
09/08/08 22:36:33:453 -- (7812) - MAPS search done...
09/08/08 22:36:33:453 -- (7812) RCPT TO: asger@e-advice.dk accepted
09/08/08 22:36:34:390 -- (7812) Detected blank email with specified attachment
09/08/08 22:36:34:390 -- (7812) Starting quarantine procedures
09/08/08 22:36:35:125 -- (7812) Created thread (5516) to add email to quarantine
09/08/08 22:36:35:125 -- (7812) Starting bayesian procedures
09/08/08 22:36:35:140 -- (5516) Adding to Quarantine file:Qrtn50CD19FE-B03B-4E44-8FF2-8AD8EBB78C72.tmp
09/08/08 22:36:35:140 -- (5516) Error - Unable to add email to quarantine - too many updates pending - archival queued
______________________________________________

I know that the mail was blocked as there where no text but only attached documents, but now the user can not logon to his spambox and find the mail.
I have checked the spamfilter quarantine and i still get mail all the time quarantined, so I am not sure why i get this error. In my log file I see several examples during the day.

Some days ago the quarantine database stopped working and came up with a message file:///C:%5CDOCUME%7E1%5CMorten%5CLOCALS%7E1%5CTemp%5Cmsohtmlclip1%5C01%5Cclip_colorschememapping.xml - I edited php.ini from "max_connection=100 to 500" and that resolved the issue. Not sure if this is related.
We are running version 4.0.1.783 (registered version)
SpamfilterScv.e seems to hang in task manager as well for some reason

Any idea where to look?

Kind Regards
Morten


Replies:
Posted By: LogSat
Date Posted: 09 September 2008 at 10:01pm
Morten,

The log entry above:

09/08/08 22:36:35:140 -- (5516) Error - Unable to add email to quarantine - too many updates pending - archival queued

indicates a very specific situation.

Each time SpamFilter receives a spam email, a new thread is created within SpamFilter that is in charge of storing the email in the quarantine database. This multi-thread mechanism allows SpamFilter to continue processing incoming spam emails without having to wait for the emails to be stored in the database, greatly increasing performance.

This is just fine as long as the database is able to keep up with the flow of incoming emails. If however your database server is not able to accept new archival requests as fast as new emails are received, we will have a situation where the threads created to store emails in the database will grow continuously as they cannot keep up with the flow of emails.

To avoid running out of memory, SpamFilter will only create and queue as many quarantine threads as the maximum number of incoming connections SpamFilter will accept. This means that if at any time there are more quarantine archival threads than the maximum number of incoming connections in SpamFilter, in this case SpamFilter will take the spam archival threads that "overflow" and will queue them to disk.

SpamFilter attempts to process this disk queue every few minutes, and if the database is available and the number of archival threads are below the above threshold, the queue will be archived.

If you see this problem too often, that does indicate performance issues with the database server. A possible workaround is to try increasing the maximum number of concurrent incoming connections SpamFilter will accept, as that will directly correlate to higher archival connections, but if you do this please do monitor your database server to ensure it does not get overloaded.


-------------
Roberto Franceschetti

http://www.logsat.com" rel="nofollow - LogSat Software

http://www.logsat.com/sfi-spam-filter.asp" rel="nofollow - Spam Filter ISP

Posted By: morten44
Date Posted: 10 September 2008 at 4:42pm
Hi Thanks for your very detalied answer. I do understand what you are trying to say.
There is some strange problem that I can not figure out of.
We run MySQL quarantine database, size is at all time about 1GB. It delete files after 6 days.
 
There are two other things that happens:
When Spamfilter.exe is running alone it seems to be working fine.
When spamfiltercvs.exe also appair on the menu, it normally means problem.
Starts to freeze and I can not close it. Not eaven from task manager. Have to stop the Spamfilter windows service to get by this problem remotely from another server via MMC snapin.
 
The other thing is that when i browse into the spamfilter folder and want to open quarantine folder, the server freezes and the only way to get on is to stop the service again.
I then thought it was a Windows Explorer problem that caused this and i tried to enter the same library in command propt. the same thing happens. The folder "quarantine" is about 800MB in size.
 
Does any of this sounds familuar for you or not.
what is spamfiltercvs.exe and why/when does it start
 
Kind Regards
Morten

Posted By: LogSat
Date Posted: 10 September 2008 at 4:53pm
Morten,

 A common cause of problems is running SpamFilter’s service, and then also opening another instance of the “Standalone” SpamFilter application. If you are running two instances of SpamFilter, both installed in the same directory, this is bound to cause issues as they are both accessing the same resources, and when you’re terminating the standalone application this may cause the service application to become unresponsive.

I’m including a section of our manual, which explains how SpamFilter can be executed:

SpamFilter Service / Console Application

SpamFilter can run in two different ways.
•    As a Windows service (the most common - SpamFilterSvc.exe).
•    As a standalone application using SpamFilter.exe. This is mostly used for troubleshooting and testing purposes.

If SpamFilter is already running as a service, subsequently running the standalone application (SpamFilter.exe) will open a new instance of SpamFilter, it will not be the GUI for the service. This will most likely create a conflict, as two applications cannot bind to the same port on a server.

Please note that the SpamFilter service does show display a GUI (launched from an icon in the tray bar), but if you are accessing a Windows 2000 server remotely using Terminal Services will not be able to display the GUI. This is because Terminal Services in Windows 2000 is not able to display the server's physical console.

Looking at the physical server's screen, or using a product like PCAnywhere, DameWare, VNC etc that displays the actual screen will reveal the console.

Microsoft fixed this limitation in Windows 2003. In this version of the operating system, Terminal Services allows RDP clients to connect to the server's console.

 
Some Terminal Services clients have a checkbox in their settings that forces them to connect to the console. In the Remote Desktop client that ships with Windows XP, Microsoft (in)conveniently decided to not make this checkbox available. In this case, to view the server's physical console, you'll need to invoke Remote Desktop from the command line as follows:

mstsc –console



-------------
Roberto Franceschetti

http://www.logsat.com" rel="nofollow - LogSat Software

http://www.logsat.com/sfi-spam-filter.asp" rel="nofollow - Spam Filter ISP

Posted By: criminallawyer
Date Posted: 22 April 2009 at 9:32am
here is some strange problem that I can not figure out of.
We run MySQL quarantine database, size is at all time about 1GB. It delete files after 6 days.
 hi,

There are two other things that happens:
When Spamfilter.exe is running alone it seems to be working fine.
When spamfiltercvs.exe also appair on the menu, it normally means problem.
Starts to freeze and I can not close it. Not eaven from task manager. Have to stop the Spamfilter windows service to get by this problem remotely from another server via MMC snapin.
 
The other thing is that when i browse into the spamfilter folder and want to open quarantine folder, the server freezes and the only way to get on is to stop the service again.
I then thought it was a Windows Explorer problem that caused this and i tried to enter the same library in command propt. the same thing happens. The folder "quarantine" is about 800MB in size.
 


-------------
http://findcriminallawyer.com - criminallawyer

Posted By: LogSat
Date Posted: 22 April 2009 at 3:50pm
I’m including a section of our manual, which explains how SpamFilter can be executed:

SpamFilter Service / Console Application

SpamFilter can run in two different ways.
•    As a Windows service (the most common - SpamFilterSvc.exe).
•    As a standalone application using SpamFilter.exe. This is mostly used for troubleshooting and testing purposes.

If SpamFilter is already running as a service, subsequently running the standalone application (SpamFilter.exe) will open a new instance of SpamFilter, it will not be the GUI for the service. This will most likely create a conflict and problems, as two applications cannot bind to the same port on a server.

Please note that the SpamFilter service does show display a GUI (launched from an icon in the tray bar), but if you are accessing a Windows 2000 server remotely using Terminal Services will not be able to display the GUI. This is because Terminal Services in Windows 2000 is not able to display the server's physical console.

Looking at the physical server's screen, or using a product like PCAnywhere, DameWare, VNC etc that displays the actual screen will reveal the console.

Microsoft fixed this limitation in Windows 2003. In this version of the operating system, Terminal Services allows RDP clients to connect to the server's console.


Some Terminal Services clients have a checkbox in their settings that forces them to connect to the console. In the Remote Desktop client that ships with Windows XP, Microsoft (in)conveniently decided to not make this checkbox available. In this case, to view the server's physical console, you'll need to invoke Remote Desktop from the command line as follows:

mstsc –console

Please note that some newer versions of the Terminal Services client have replaced the “/console” option with a new “/admin” switch. For these versions you will need to use the command mstsc /admin in order to view the server’s console.

-------------
Roberto Franceschetti

http://www.logsat.com" rel="nofollow - LogSat Software

http://www.logsat.com/sfi-spam-filter.asp" rel="nofollow - Spam Filter ISP


Print Page | Close Window