Spam Filter ISP Forums : Exception occurred during DumpLog https://www.logsat.com/spamfilter/forums/ Wed, 13 May 2026 18:05:44 +0000 Thu, 04 May 2006 03:31:47 +0000 http://blogs.law.harvard.edu/tech/rss Web Wiz Forums 11.04 360 https://www.logsat.com/spamfilter/forums/RSS_post_feed.asp?TID=5592 <![CDATA[Spam Filter ISP Forums]]> https://www.logsat.com/spamfilter/forums/forum_images/web_wiz_forums.png https://www.logsat.com/spamfilter/forums/ <![CDATA[Exception occurred during DumpLog : OK thats brilliant! Thanks. ]]> https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7925&title=exception-occurred-during-dumplog#7925 Author: lyndonje
Subject: 5592
Posted: 04 May 2006 at 3:31am

OK thats brilliant! Thanks.]]> Thu, 04 May 2006 03:31:47 +0000 https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7925&title=exception-occurred-during-dumplog#7925 <![CDATA[Exception occurred during DumpLog : The memory buffer holding the...]]> https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7917&title=exception-occurred-during-dumplog#7917 Author: LogSat
Subject: 5592
Posted: 03 May 2006 at 3:52pm

The memory buffer holding the log data to be saved is not cleared until *after* a successful saving of the file. So if there's a failure, the same old buffer, plus the new entries in the log, will be written the following time the log is saved (by default every 60 seconds). When there are exceptions to be logged, we spawn a separate thread dedicated to saving the buffer, thus increasing the chances that the error is correctly logged even if there are problems. Helps a lot with troubleshooting...]]> Wed, 03 May 2006 15:52:52 +0000 https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7917&title=exception-occurred-during-dumplog#7917 <![CDATA[Exception occurred during DumpLog : Still have a question for LogSat....]]> https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7909&title=exception-occurred-during-dumplog#7909 Author: lyndonje
Subject: 5592
Posted: 03 May 2006 at 5:30am

Still have a question for LogSat. When a DumpLog error occurs, whatactually happens to the data that SF attempted to save to the log file?Is the data buffered and re-tried or is the data lost? If the data islost I have another question... if SF was unable to write to the logfile therefore causing the DumpLog error, how does it actually writethe DumpLog error to file?


]]> Wed, 03 May 2006 05:30:23 +0000 https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7909&title=exception-occurred-during-dumplog#7909 <![CDATA[Exception occurred during DumpLog : How strange. Ever since I&#039;ve...]]> https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7908&title=exception-occurred-during-dumplog#7908 Author: lyndonje
Subject: 5592
Posted: 03 May 2006 at 4:44am

How strange. Ever since I've been running File Monitor, I've only seenthe DumpLog error once on the 28th Apr, and once on the 2nd May, bothat 19:00, which is when SawMill run which I would expect. Beforerunning File Monitor, and even before installing SawMill, there havebeen multiple DumpLog errors in the logs. I'll keep my eye on it...]]> Wed, 03 May 2006 04:44:08 +0000 https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7908&title=exception-occurred-during-dumplog#7908 <![CDATA[Exception occurred during DumpLog : I shouldn&#039;t need to worry...]]> https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7884&title=exception-occurred-during-dumplog#7884 Author: lyndonje
Subject: 5592
Posted: 28 April 2006 at 8:25am

I shouldn't need to worry about mine being a high traffic server then!

I see why you might want to rotate the logs now you've said. But at the moment I don't mind if my stats are a day behind.
]]> Fri, 28 Apr 2006 08:25:47 +0000 https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7884&title=exception-occurred-during-dumplog#7884 <![CDATA[Exception occurred during DumpLog : This is Noon to Midnight yesterday...]]> https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7883&title=exception-occurred-during-dumplog#7883 Author: Desperado
Subject: 5592
Posted: 28 April 2006 at 8:19am

This is Noon to Midnight yesterday (12 Hours)
ActionMessagesBytes
1quarantined68,502   52.2 % 301.28 M
2accepted22,796    17.4 % 674.63 M
3Dropped Connection17,437   13.3 % 3.42 M
4Bypassed all rules13,355   10.2 % 390.76 M
5rejected4,308   3.3 % 10.93 M
6sent to NULL4,258      3.2 % 243.00 k
7spam-tagged658         0.5 % 5.33 M
 Total131,314100 % 1.35 G


Edited by Desperado]]> Fri, 28 Apr 2006 08:19:28 +0000 https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7883&title=exception-occurred-during-dumplog#7883 <![CDATA[Exception occurred during DumpLog : As an idea, how many messages...]]> https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7882&title=exception-occurred-during-dumplog#7882 Author: lyndonje
Subject: 5592
Posted: 28 April 2006 at 8:10am

As an idea, how many messages does your SF server process? from 23rd Apr - 27th Apr (Sun - Thu) mine totalled 135,914.

1rejected62,063   45.7 %23.81 M
2quarantined32,969   24.3 %383.71 M
3accepted22,891   16.8 %2.52 G
4Dropped Connection16,249   12.0 %0 b
5Bypassed all rules1,742   1.3 %232.78 M
 Total135,914   100 % 3.15 G

So far since running the file monitor, the DumpLog error has not yet occured...
]]> Fri, 28 Apr 2006 08:10:30 +0000 https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7882&title=exception-occurred-during-dumplog#7882 <![CDATA[Exception occurred during DumpLog : lyndonje, Heres the deal ......]]> https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7881&title=exception-occurred-during-dumplog#7881 Author: Desperado
Subject: 5592
Posted: 28 April 2006 at 7:55am

lyndonje,

Heres the deal ... I am still on my first POT of coffee so am not quite with it yet but ... what I do is split the logs like Roberto mentioned and use a perl script to move the logs off that server based on date/time and parse the moved logs.  I sometime do a manual parse of the "live" logs if I want imediate, up to date info trying to find some new trend or something.  Also, and this may not apply, I run Diskeeper to defrag my drives automatically.  I make sure my master log folder ie excluded from that process.  I log everything on my servers in a "master" log folder to make this, and my scripting easier to keep track of.

Your idea of tracking what is accessing the files is a good one and I will be interested in any results you get.

A more severe issue I ran into was with my Web GUI.  I write walues to the spamfilter.ini file from the gui and at one point got lazy in my coding and was not checking to see if the ini file was open.  As luck would have it, I did a write at the exact same time as spamfilter was updating the stats in the file and I wiped out the file.  This had a very unfortunate effect as you may guess.  So ... working with very active files can be tricky in unpredictable ways and I am amazed that high traffic servers work at all!

]]> Fri, 28 Apr 2006 07:55:03 +0000 https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7881&title=exception-occurred-during-dumplog#7881 <![CDATA[Exception occurred during DumpLog : At present I don&#039;t know what...]]> https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7880&title=exception-occurred-during-dumplog#7880 Author: lyndonje
Subject: 5592
Posted: 28 April 2006 at 7:43am

At present I don't know what could be opening the files, as I saidSawMill is scheduled to parse the logs at 19:00, and this is not thetime when I'm seeing the error. Also if I look at previous logs I seethe error before I had even installed SawMill.

As there are multiple entries in mylogs with this error, if SF is unable to open and write to the logfile, how come it is able to write the multiple entries saying the dumpfailed? And ultimately what happens to the data it is trying to dump?Does it get buffered and then re-tried later or is the data lost?

I don't think I need to rotate my logs, at present they rotate on a daily basis.
]]> Fri, 28 Apr 2006 07:43:40 +0000 https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7880&title=exception-occurred-during-dumplog#7880 <![CDATA[Exception occurred during DumpLog : lyndonje,When you mentioned &#034;Other...]]> https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7879&title=exception-occurred-during-dumplog#7879 Author: LogSat
Subject: 5592
Posted: 28 April 2006 at 7:04am

lyndonje,

When you mentioned "Other than the obvious (file locked)" in the original post, I had assumed you were certain no other applications where trying to access the logs. Desperado is absolutely correct, if you do have SawMill, or any other application, read the logfiles, they will place a lock on it while it's opened, and that will cause the error in the logs.

Please note that there is an otion in the SpamFilter.ini file to rotate the logs every "n" numbers of hours, so you may want to use that to split the logs hourly for more up-to-date imports.
]]> Fri, 28 Apr 2006 07:04:22 +0000 https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5592&PID=7879&title=exception-occurred-during-dumplog#7879