Exception occurred during DumpLog |
Post Reply ![]() |
Author | ||||||||||||||||||||||||||||||||||||||||||||||||||||||
lyndonje ![]() Senior Member ![]() ![]() Joined: 31 January 2006 Location: United Kingdom Status: Offline Points: 192 |
![]() ![]() ![]() ![]() ![]() Posted: 27 April 2006 at 11:25am |
|||||||||||||||||||||||||||||||||||||||||||||||||||||
Other than the obvious (file locked), do you know what might actually
have caused these errors to appear in my log? There is no AV installed
on the server, so it can't be AV locking the file for scanning... any
ideas? Currently using v3.0.1.555
04/27/06 16:18:49:203 -- Exception occurred during DumpLog: Cannot open file "C:\Program Files\SpamFilter\logfiles\20060427.log". The process cannot access the file because it is being used by another process Thanks, Lyndon. |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
LogSat ![]() Admin Group ![]() ![]() Joined: 25 January 2005 Location: United States Status: Offline Points: 4104 |
![]() ![]() ![]() ![]() ![]() |
|||||||||||||||||||||||||||||||||||||||||||||||||||||
Can you check your SpamFilter.ini file for the option:
RealtimeDiskLogging=0 and ensure it is indeed set to 0? If not, this will cause SpamFilter to flush to disk the logfile everytime a new line is appended, and this could cause a lot of IO traffic and (in theory - never happened before...) locking issues. We use a value of 1 only for troubleshooting purposes. If it was already at 0 (or if the entry does not exist - default is 0), locking by another app is honestly the only thing we can think of. |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
lyndonje ![]() Senior Member ![]() ![]() Joined: 31 January 2006 Location: United Kingdom Status: Offline Points: 192 |
![]() ![]() ![]() ![]() ![]() |
|||||||||||||||||||||||||||||||||||||||||||||||||||||
It was set to 0, I've changed it to 1. Does that mean the log will be saved every 60 seconds? And this is the recommended value?
Regards, Lyndon. |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
LogSat ![]() Admin Group ![]() ![]() Joined: 25 January 2005 Location: United States Status: Offline Points: 4104 |
![]() ![]() ![]() ![]() ![]() |
|||||||||||||||||||||||||||||||||||||||||||||||||||||
You want it back to 0! If 1, it will save the file every time a single line is added to the log, which in high traffic scenarios can be dozens if not hundreds of times per second!
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
Desperado ![]() Senior Member ![]() ![]() Joined: 27 January 2005 Location: United States Status: Offline Points: 1143 |
![]() ![]() ![]() ![]() ![]() |
|||||||||||||||||||||||||||||||||||||||||||||||||||||
lyndonje, If you are using something like SawMill to parse you logs, make sure it is set up to only parse inactive logs. I had the exact same errors when I parsed my active logs during high traffic. |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
The Desperado
Dan Seligmann. Work: http://www.mags.net Personal: http://www.desperado.com |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
lyndonje ![]() Senior Member ![]() ![]() Joined: 31 January 2006 Location: United Kingdom Status: Offline Points: 192 |
![]() ![]() ![]() ![]() ![]() |
|||||||||||||||||||||||||||||||||||||||||||||||||||||
Sorry Roberto, must have missunderstood your post - it was late when I read it!
Its set back to 0 now. With regard to SawMill, I've scheduled it to parse the logs at 19:00, so does it also parse at other times? Also I can't find a setting to only parse inactive logs, which version is that feature found in? |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
lyndonje ![]() Senior Member ![]() ![]() Joined: 31 January 2006 Location: United Kingdom Status: Offline Points: 192 |
![]() ![]() ![]() ![]() ![]() |
|||||||||||||||||||||||||||||||||||||||||||||||||||||
Checking the logs and it looks like these errors have been appearing since before I installed SawMill.
I'm using File Monitor from Sysinternals to capture what processes are accessing the logs folder. Wonder what I'll find...? Should be interesting. Another question for LogSat though, as there are multiple entries in my logs with this error, if SF is unable to open and write to the log file, how come it is able to write the multiple entries saying the dump failed? And ultimately what happens to the data it is trying to dump? Does it get buffered and then re-tried later or is the data lost? Thanks, Lyndon. |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
LogSat ![]() Admin Group ![]() ![]() Joined: 25 January 2005 Location: United States Status: Offline Points: 4104 |
![]() ![]() ![]() ![]() ![]() |
|||||||||||||||||||||||||||||||||||||||||||||||||||||
lyndonje,
When you mentioned "Other than the obvious (file locked)" in the original post, I had assumed you were certain no other applications where trying to access the logs. Desperado is absolutely correct, if you do have SawMill, or any other application, read the logfiles, they will place a lock on it while it's opened, and that will cause the error in the logs. Please note that there is an otion in the SpamFilter.ini file to rotate the logs every "n" numbers of hours, so you may want to use that to split the logs hourly for more up-to-date imports. |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
lyndonje ![]() Senior Member ![]() ![]() Joined: 31 January 2006 Location: United Kingdom Status: Offline Points: 192 |
![]() ![]() ![]() ![]() ![]() |
|||||||||||||||||||||||||||||||||||||||||||||||||||||
At present I don't know what could be opening the files, as I said
SawMill is scheduled to parse the logs at 19:00, and this is not the
time when I'm seeing the error. Also if I look at previous logs I see
the error before I had even installed SawMill.
As there are multiple entries in my logs with this error, if SF is unable to open and write to the log file, how come it is able to write the multiple entries saying the dump failed? And ultimately what happens to the data it is trying to dump? Does it get buffered and then re-tried later or is the data lost? I don't think I need to rotate my logs, at present they rotate on a daily basis. |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
Desperado ![]() Senior Member ![]() ![]() Joined: 27 January 2005 Location: United States Status: Offline Points: 1143 |
![]() ![]() ![]() ![]() ![]() |
|||||||||||||||||||||||||||||||||||||||||||||||||||||
lyndonje, Heres the deal ... I am still on my first POT of coffee so am not quite with it yet but ... what I do is split the logs like Roberto mentioned and use a perl script to move the logs off that server based on date/time and parse the moved logs. I sometime do a manual parse of the "live" logs if I want imediate, up to date info trying to find some new trend or something. Also, and this may not apply, I run Diskeeper to defrag my drives automatically. I make sure my master log folder ie excluded from that process. I log everything on my servers in a "master" log folder to make this, and my scripting easier to keep track of. Your idea of tracking what is accessing the files is a good one and I will be interested in any results you get. A more severe issue I ran into was with my Web GUI. I write walues to the spamfilter.ini file from the gui and at one point got lazy in my coding and was not checking to see if the ini file was open. As luck would have it, I did a write at the exact same time as spamfilter was updating the stats in the file and I wiped out the file. This had a very unfortunate effect as you may guess. So ... working with very active files can be tricky in unpredictable ways and I am amazed that high traffic servers work at all! |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
The Desperado
Dan Seligmann. Work: http://www.mags.net Personal: http://www.desperado.com |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
lyndonje ![]() Senior Member ![]() ![]() Joined: 31 January 2006 Location: United Kingdom Status: Offline Points: 192 |
![]() ![]() ![]() ![]() ![]() |
|||||||||||||||||||||||||||||||||||||||||||||||||||||
As an idea, how many messages does your SF server process? from 23rd Apr - 27th Apr (Sun - Thu) mine totalled 135,914.
So far since running the file monitor, the DumpLog error has not yet occured... |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
Desperado ![]() Senior Member ![]() ![]() Joined: 27 January 2005 Location: United States Status: Offline Points: 1143 |
![]() ![]() ![]() ![]() ![]() |
|||||||||||||||||||||||||||||||||||||||||||||||||||||
This is Noon to Midnight yesterday (12 Hours)
Edited by Desperado |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
The Desperado
Dan Seligmann. Work: http://www.mags.net Personal: http://www.desperado.com |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
lyndonje ![]() Senior Member ![]() ![]() Joined: 31 January 2006 Location: United Kingdom Status: Offline Points: 192 |
![]() ![]() ![]() ![]() ![]() |
|||||||||||||||||||||||||||||||||||||||||||||||||||||
I shouldn't need to worry about mine being a high traffic server then!
I see why you might want to rotate the logs now you've said. But at the moment I don't mind if my stats are a day behind. |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
lyndonje ![]() Senior Member ![]() ![]() Joined: 31 January 2006 Location: United Kingdom Status: Offline Points: 192 |
![]() ![]() ![]() ![]() ![]() |
|||||||||||||||||||||||||||||||||||||||||||||||||||||
How strange. Ever since I've been running File Monitor, I've only seen
the DumpLog error once on the 28th Apr, and once on the 2nd May, both
at 19:00, which is when SawMill run which I would expect. Before
running File Monitor, and even before installing SawMill, there have
been multiple DumpLog errors in the logs. I'll keep my eye on it...
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
lyndonje ![]() Senior Member ![]() ![]() Joined: 31 January 2006 Location: United Kingdom Status: Offline Points: 192 |
![]() ![]() ![]() ![]() ![]() |
|||||||||||||||||||||||||||||||||||||||||||||||||||||
Still have a question for LogSat. When a DumpLog error occurs, what
actually happens to the data that SF attempted to save to the log file?
Is the data buffered and re-tried or is the data lost? If the data is
lost I have another question... if SF was unable to write to the log
file therefore causing the DumpLog error, how does it actually write
the DumpLog error to file?
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
LogSat ![]() Admin Group ![]() ![]() Joined: 25 January 2005 Location: United States Status: Offline Points: 4104 |
![]() ![]() ![]() ![]() ![]() |
|||||||||||||||||||||||||||||||||||||||||||||||||||||
The memory buffer holding the log data to be saved is not cleared until *after* a successful saving of the file. So if there's a failure, the same old buffer, plus the new entries in the log, will be written the following time the log is saved (by default every 60 seconds). When there are exceptions to be logged, we spawn a separate thread dedicated to saving the buffer, thus increasing the chances that the error is correctly logged even if there are problems. Helps a lot with troubleshooting...
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() |
||||||||||||||||||||||||||||||||||||||||||||||||||||||
lyndonje ![]() Senior Member ![]() ![]() Joined: 31 January 2006 Location: United Kingdom Status: Offline Points: 192 |
![]() ![]() ![]() ![]() ![]() |
|||||||||||||||||||||||||||||||||||||||||||||||||||||
OK thats brilliant! Thanks.
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||
![]() |
Post Reply ![]() |
|
Tweet
|
Forum Jump | Forum Permissions ![]() You cannot post new topics in this forum You cannot reply to topics in this forum You cannot delete your posts in this forum You cannot edit your posts in this forum You cannot create polls in this forum You cannot vote in polls in this forum |
This page was generated in 0.281 seconds.