Print Page | Close Window

According to Domains and From Emails filtering

Printed From: LogSat Software
Category: Spam Filter ISP
Forum Name: Spam Filter ISP Support
Forum Description: General support for Spam Filter ISP
URL: https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=3506
Printed Date: 26 December 2024 at 6:08pm


Topic: According to Domains and From Emails filtering
Posted By: Guests
Subject: According to Domains and From Emails filtering
Date Posted: 29 April 2004 at 3:04am
As I noticed before, there is no ability in SpamFilter to filter connections by their domain name. So I made batch file for Windows that scans SpamFilter's logfile and refreshes IPs database. This batch uses some utilities from http://unxutils.sourceforge.net/." CLASS="ASPForums" TITLE="WARNING: URL created by poster. - http://unxutils.sourceforge.net/. (sed.exe, uniq.exe, cut.exe) It requires file named spam.dat, that contains something like: ====== \.ppp \.client dynam \.dial \.client \.pool \.ip\- ip[0-9] dsl cable ====== As you noticed, it uses Regular Expressions. So you can improve this file for your needs. And here is batch itself: =========== echo.>database.txt rem take all the symbol names to be blacklisted by their IP for /f "tokens=1,* delims= " %%a in (spam.dat) do sed -n "/%%a/p" %1>>database.txtdatabase.txt rem take all the symbol names to be blacklisted by their IP for /f "tokens=1,* delims= " %%a in (spam.dat) do sed -n "/%%a/p" %1>>database.txtdatabase.txt rem take all the symbol names to be blacklisted by their IP for /f "tokens=1,* delims= " %%a in (spam.dat) do sed -n "/%%a/p" %1>>database.txt>database.txt>database.txtdatabase.txtdatabase.txt

rem select only DNS resolve strings sed -n "s/.*Resolving \(.*\)/\1/p" database.txt>1.txt1.txt1.txt

rem remove repeating strings sort 1.txt>2.txt uniq 2.txt>3.txt2.txt uniq 2.txt>3.txt2.txt uniq 2.txt>3.txt3.txt3.txt

rem take only IPs without their DNS names cut -d- -f 1 3.txt>4a.txt cut -d- -f 2- 3.txt>4b.txt4a.txt cut -d- -f 2- 3.txt>4b.txt4a.txt cut -d- -f 2- 3.txt>4b.txt4b.txt4b.txt

rem you can comment next line and replace it by copy 4a.txt 5.txt sed "s/\.[0-9]* /.0/" 4a.txt>5.txt rem previous line replaces last group in IP address by 05.txt rem previous line replaces last group in IP address by 05.txt rem previous line replaces last group in IP address by 0

rem add new IPs to existing base cat 5.txt BlacklistedIPs >6.txt6.txt6.txt

rem remove dupes sort 6.txt>7.txt uniq 7.txt>8.txt7.txt uniq 7.txt>8.txt7.txt uniq 7.txt>8.txt8.txt8.txt

rem form new base that can be copied to location, where SpamFilter set to. ren 8.txt BlacklistedIPs =========

That's it. I think it is easier to make copuple of white addresses instead of receiving tons of junk email to analyse its contents by text filters.


Replies:
Posted By: Guests
Date Posted: 29 April 2004 at 3:21am
Hmm... looks like forum deleted all my single line breaks...

Corrections to previous message:

spam.dat has one entry per one line.

batch file needs correction too. It needs to insert line breaks instead of unneeded spaces.

if you interested, don't hesitate to contact me by email.

Posted By: Dan B
Date Posted: 30 April 2004 at 11:23pm

Oleg,

Can you email me the batch file and the spam.dat files?  I would like to see what our large log files will show.  You can email me at funnyman____ at yahoo dot com  those are (4 under scores)

Thanks,

Dan Blickensderfer


Print Page | Close Window