Print Page | Close Window

New Web Interface

Printed From: LogSat Software
Category: Spam Filter ISP
Forum Name: Web Interface Mods
Forum Description: Open to all users who wish to share their quarantine web interface modifications
URL: https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=6883
Printed Date: 27 December 2024 at 4:50am


Topic: New Web Interface
Posted By: AndrewD
Subject: New Web Interface
Date Posted: 22 October 2010 at 2:22am

I am currently developing a new web interface to SpamFilter.

Features

My Settings

·         Change Password
Allows the user to change their password

·         Alias's
Allows users to add alias address’s. (eg.
mailto:sales@mydomain.com - sales@mydomain.com )

·         Hidden Senders
Displays email addresses that will not be displayed in their quarantine folder. These are automatically created when you delete a quarantined message. The quarantine folder tells you how many are hidden, and has a button to show the messages and allow you to manage them as you would any other message.

·         White List * These are emails that will not be checked.
These are the emails that you have released (Send) messages from in the past. This list is automatically generated from within SpamFilter ISP, however this allows you to see what is in there and delete an entry if you accidently “Sent” an email from an address that you didn’t want.

Domain Settings

·         Managed Domains
Displays the domains that your login is linked to. This allows you to manage the settings for all the domains that your account is linked to, also add alias’s for other domains.
(Eg. Your company has 2 domains mydomain.com and myotherdomain.com.uk you can now have a single logon that gets the spam from all your addresses on both domains, likewise you can manage the settings on both (or as many as you like) domains.)

·         User's
This is a listing of the users that exist in your domain. Depending on your access level you can see there password, and click on it to logon as that user.

·         Quarantine Report
This is a report that will generate and send to all the users.
Registered users (users that have a valid logon and password) can delete, send, or view the message from the email.
Un-Registered users (users that do not have a valid logon and password) will get the same report except that they will not be able to delete, send, or view the message from the email until they register. The email includes a link that allows them to register the email address automatically. They will still receive the password in a follow up email automatically.

  Black Lists

·         Black List Countries
Allows the domain administrator to add/delete country codes to the SpamFilter ISP filter.

·         Black List Email
Allows the domain administrator to add/delete Blacklisted sender email addresses to the SpamFilter ISP filter.

·         Black List Keyword
Allows the domain administrator to add/delete Black list keywords to the SpamFilter ISP filter.

  White Lists

·         White List Email
Allows the domain administrator to add/delete Blacklisted sender email addresses to the SpamFilter ISP filter.

·         White List Keyword
Allows the domain administrator to add/delete Black list keywords to the SpamFilter ISP filter.

Admin Settings

·         Domains
Lists all your domains and allows you to change there settings. (eg. Destination SMTP, Destination SMTP Port, Alternate SMTP, Alternate SMTP Port,...)

System Settings

·         FAQ Page
Allows you to customize the content of the FAQ page. Includes a html editor.

·         This section will be increased to allow customization of all content that appears on the site.

 

Other features

Validates users email addresses at registeration time. (eg. Will not allow a user to register an email address that contains invalid characters like spaces, multiple “@”, “&”, domains that SpamFilter is not acting for, ....)

Search capability within the quarantine folder.

Sorting by any column in the quarantine folder.

 

I will also be putting together a few different skins for the site, so if you dont like the dark look that I have on mine then there will be a few options. 

I am looking for any more features you think would be good, I will develop based on complexity and value. Just post a reply to this message and I will look at it.

 

Feel free to have a look at what I have got by going to:-

  http://www.tyrexpg.com.au/ - www.tyrexpg.com.au

Administration Username:- mailto:adminuser@tyrexpg.com.au - adminuser@tyrexpg.com.au

Administration Password:- SpamFilter

 

Standard Username:- mailto:user@tyrexpg.com.au - user@tyrexpg.com.au

Standard Password:- SpamFilter

 

Please note that the adminuser can see all the settings and alter as they desire however no changes will actually be written to the database.

 

If you like what you see then send me an email  Andrew at ntbm .com .au

As I am looking for beta Testers 



Replies:
Posted By: AndrewD
Date Posted: 22 October 2010 at 6:02am
Update.
I have just added content customisation to all pages.
(Header, Homepage, FAQ, Contact, Footer)
Cheers


Posted By: AndrewD
Date Posted: 24 October 2010 at 2:12pm

I am just using this to post idea's of enhancements. Please feel free to vote on suggestions or let me know of any that i may not have thought of.

 Inability to set direct feedback from email clients ("This email is spam!", "This email is NOT spam!" type) for the bayesian filter (from http://download.cnet.com/Spam-Filter-ISP/3000-2382_4-10138729.html - http://download.cnet.com/Spam-Filter-ISP/3000-2382_4-10138729.html  comment). This is worthy and will certainly be added.


-------------
Spamfilter web interface. www.tyrexpg.com.au

See http://www.logsat.com/SpamFilter/Forums/forum_posts.asp?TID=6883


Posted By: birkir
Date Posted: 25 October 2010 at 8:53am
Hi Andrew
 
This looks really good! Good job.


Posted By: AndrewD
Date Posted: 25 October 2010 at 9:44pm
Thanks for haveing a look. I have emailed you back with details on setting up the site for you.
 
Also note.
I have added the functionality for domain admins to view all the spam for their domain. By default it only shows the email that is sent to users that have a valid login, or addresses that are in a users alias list. You can click the "Show all" button to see all quarantined item's for the domain. I did this as most spam in the quarantine area will be to non existent users, as the spammers are just trying to guess at addresses.


-------------
Spamfilter web interface. www.tyrexpg.com.au

See http://www.logsat.com/SpamFilter/Forums/forum_posts.asp?TID=6883


Posted By: jym5960
Date Posted: 26 October 2010 at 5:40pm
Hi Andrew,
 
excellent ideas. I was looking for them for a long time.
With all your additions, teh product will be almost full, and I will probably then, switch to 2 or 3 nodes enterprise !!! Thanks.
 
Nevertheless, I could not login onto your page with the credentials you provide. Can you send me back other credential? i am interested in being beta tester.
 
Also, suggestion for future: use .Net rather than asp?
 
Thanks by advance, continue that way!!! Cheers


Posted By: AndrewD
Date Posted: 26 October 2010 at 7:04pm
Sorry my bad ;)
The password above should have been in lowercase. I have set it now on those two accounts that the password is not case sensitive.
 
Cheers


-------------
Spamfilter web interface. www.tyrexpg.com.au

See http://www.logsat.com/SpamFilter/Forums/forum_posts.asp?TID=6883


Posted By: jym5960
Date Posted: 27 October 2010 at 11:28am

Hi Andrew,

 

thanks for the access. It's OK now.

 

I would suggest (having seen that elsewhere (ie Bizanga with Mailcube)):

- when you are in a quarantine email, have a direct button "Add to whitelist" and a button "Add to blacklist"

- quarantine report for a domain should be schedule by the domain webadministrator in the web interface, not from a VBS (with the whole mess it could go (ie proxy, auth, ...)) scheduled task

- possibility to have a quarantine template (online and report) that you can customize, and plus, have icons or pictures per domain (ie ini or xml conf. file for hosters)

 

Can you give a sample report of what would be send to user as quarantine report ( jym at kajan . fr  )?

 

Continue like that, good job!!!

I'm waiting to switch to that brand new interface into production



Posted By: AndrewD
Date Posted: 27 October 2010 at 8:49pm
Thanks for your input.
Quote {when you are in a quarantine email, have a direct button "Add to whitelist" and a button "Add to blacklist" }
I like this idea for the domain adminstrators only.
Normal users when they send an item, it automatically adds the sender to their personal whitelist. When they delete a message it adds the sender to their personal "Hide" list.
But I like the idea that a domain admin can add senders to the domain whitelist. and likewise add Senders to the domain blacklisted email.
 
Quote {quarantine report for a domain should be schedule by the domain webadministrator in the web interface, not from a VBS (with the whole mess it could go (ie proxy, auth, ...)) scheduled task}
I originally did it the way I have so that the domain administrator could control the timing of when the reports would send. However I could have this as a setting that they can set within the control panel "Settings". I will put this on my to do list.
 
 

Quote {possibility to have a quarantine template (online and report) that you can customize, and plus, have icons or pictures per domain (ie ini or xml conf. file for hosters)}

I am not 100% sure what you mean here. But if you are talking about what appears on the "Spamlist.asp" page then the header and footer are customizable, I am unsure of what else you would need to customize.

As for the report, if you are talking about the report that users will receive then that WILL be customizable, i just havent yet coded the settings to allow this, but it is very high on my to do list.
 

Quote {Can you give a sample report of what would be send to user as quarantine report ( jym at kajan . fr  )?}

I will send you a sample for the mailto:user@tyrexpg.com.au - user@tyrexpg.com.au  I do have a "to do" to add to the report page the ability to send a test report, which would have an option to send the report to either a web page or your email address (Note the Email option wont work for SpamfilterISP testers as it will send the email to  mailto:adminuser@tyrexpg.com.au - adminuser@tyrexpg.com.au )
 
Thanks for your input.
 


-------------
Spamfilter web interface. www.tyrexpg.com.au

See http://www.logsat.com/SpamFilter/Forums/forum_posts.asp?TID=6883


Posted By: AndrewD
Date Posted: 28 October 2010 at 9:10pm
Thanks for the input guys.
For the benefit of any who read this thread.
 
Here is the current to do list in no particular order, Primary ones will be done first.
Primary
- Customizable email report.
- Test Email report (To screen and to email)
- Domain Logo. Ability to add them to content and email reports.
- Customizable welcome email.
- Email report to include "Delete All"
- ability for domain admins to be able to add email/domain to domain white/black list.
- ability to clone/merge settings from one domain to another. Allows domain admins to setup template domains.
 
Secondary
- scheduale email report delivery from domain setting, rather than using task scheduler.
- Ability for user to extend auto delete period for an individual user. Perhaps rather than extend it the option to tag and deliver for an individual user.
 
Cheers


-------------
Spamfilter web interface. www.tyrexpg.com.au

See http://www.logsat.com/SpamFilter/Forums/forum_posts.asp?TID=6883


Posted By: AndrewD
Date Posted: 31 October 2010 at 7:31pm
The email report is now fully customizable. It is done from the "System Settings" Menu.
 
Also the "Quarantine Report" settings ( http://www.tyrexpg.com.au/Settings.asp?Setting=QuarRep - http://www.tyrexpg.com.au/Settings.asp?Setting=QuarRep  ) Now have another link next to each domain so as you may run a test report of the quarantine report, without sending to all the users. I will code one to go to the administrators email address as well but this will be bumped down the list now, as there are a few more urgent sections and you can view it on screen.
 
Cheers


-------------
Spamfilter web interface. www.tyrexpg.com.au

See http://www.logsat.com/SpamFilter/Forums/forum_posts.asp?TID=6883


Posted By: AndrewD
Date Posted: 03 November 2010 at 9:53pm
Current Update.
To Do List.
Short Term
Done! Customizable email report.
Done! Customizable welcome email.
Done! Test Email report (To screen)
Done! Ability for a user to turn filtering on/off for their email address
Done! Email report to include "Delete All"
• ability for domain admins to be able to add email/domain to domain white/black list from spamlist.asp page.
Medium Term
• Domain Logo. Ability to add them to content and email reports.
• ability for domain admins to be able to add email/domain to domain white/black list from spamlist.asp page.
• ability to clone/merge settings from one domain to another. Allows domain admins to setup template domains.
Long Term
• Ability for rejected sender to request addition to allow list.
• scheduale email report delivery from domain setting, rather than using task scheduler.
• Ability for user to extend auto delete period for an individual user. Perhaps rather than extend it the option to tag and deliver for an individual user.
• Test Email report (To email)


-------------
Spamfilter web interface. www.tyrexpg.com.au

See http://www.logsat.com/SpamFilter/Forums/forum_posts.asp?TID=6883


Posted By: tgs
Date Posted: 29 March 2011 at 11:15pm

Hi Andrew,

I don’t know if you are still looking for feedback on the website you’re developing or “beta testers”, but if you are I’d be interested.

 

The site is very impressive.  The only piece that we’ve had requests for that doesn’t seem to exist is the ability for a user to manually add email addresses (either one at a time or via an import) to their personal white lists.

 

Other than that and the things that were on your “to do” list it seems very complete.

 

Does this work with the “Enterprise” version or the “Standard” version, or both?  Are there significant database changes required to implement this?

 

Again great work.

Thanks for your time.



Posted By: AndrewD
Date Posted: 29 March 2011 at 11:33pm

tgs,
Thanks for your input. Consider the personal whitelist addition ability as now on the to do list.
 
What i have done is created two versions.
1. Lite  $Free
2. Enterprise  $400/Year Includes all Updates.
 
The product is written for Enterprise, as it stores data in a database, at the moment we only interface to MYSQL, SQL, as have not had requests to support others.
 
if you send me an email (you can do this via my profile http://www.logsat.com/spamfilter/forums/member_profile.asp?PF=905 - http://www.logsat.com/spamfilter/forums/member_profile.asp?PF=905 ) with your email address i will send you the files and instructions for the lite version.

This will allow you to test it in your environment before committing to purchase.

Regards
Andrew



-------------
Spamfilter web interface. www.tyrexpg.com.au

See http://www.logsat.com/SpamFilter/Forums/forum_posts.asp?TID=6883


Posted By: tgs
Date Posted: 29 March 2011 at 11:45pm
There seems to be some issue with the forum right now as I've tried to send you an email and I continue to get an "access denied".  I've sent an email to Roberto about it...


Posted By: AndrewD
Date Posted: 30 March 2011 at 2:44am
Got your message. Have sent you an EMail.

-------------
Spamfilter web interface. www.tyrexpg.com.au

See http://www.logsat.com/SpamFilter/Forums/forum_posts.asp?TID=6883


Posted By: yapadu
Date Posted: 24 April 2011 at 6:18pm
Andrew,

I see you have the feature of aliases, how have you implemented that?

I have tried to think of a way to do aliases in spamfilter but can't figure it out.




-------------
--------------------------------------------------------------
I am a user of SF, not an employee. Use any advice offered at your own risk.


Posted By: AndrewD
Date Posted: 25 April 2011 at 1:00am
Hi Yapadu,
If you send me a message with your email address i will send you the code to my current lite version of the site. It is in ASP so i am unsure if you are using ASP or PHP.
 
But to answer your question.
I keep a table called Alias, Field1 = Logon_Email Field2 = Alias
then when the logon i retrieve all there alias's and store them into a session variable with them all listed with there logon email and a comma in front and behind. (Eg. mailto:logon@mydomain.com.au,Alias1@mydomain.com.au,alias2@mydomain.com - ,logon@mydomain.com.au,Alias1@mydomain.com.au,alias2@mydomain.com , )
 
Then when i do my query..

SQL = "SELECT QuarID, EmailTo, EmailFrom, Subject, MsgDate, MsgID, RejectDesc, RejectDetails "

SQL = SQL & "FROM tblQuarantine, tblRejectCodes "

SQL = SQL & "WHERE (lcase(EmailTo) in (" & Emaillist & ")) "

SQL = SQL & "AND (Deliver = 0) "

SQL = SQL & "AND (Expire = 0) "

SQL = SQL & "AND (tblQuarantine.RejectID = tblRejectCodes.RejectID) "

SQL = SQL & "ORDER BY " & order_by

Set rs = con.Execute(SQL)

Thats basically it.
 
Cheers


-------------
Spamfilter web interface. www.tyrexpg.com.au

See http://www.logsat.com/SpamFilter/Forums/forum_posts.asp?TID=6883


Posted By: yapadu
Date Posted: 25 April 2011 at 1:18am
I see, so it is for the purposes of viewing the messages in quarantine only.

I have been asking Roberto if there is any way to do domains/aliases/catchall type addresses, at the server level.

We charge our clients on a per email address basis, which causes a couple of problems with the current spamfilter implementation so I was hoping you had done some magic that allowed true aliases.

We don't have any problem with allowing aliases or catch all.  For example if you were andrew@widget.com and also sales@widget.com we would ideally like to charge you for only a single email address.

However the way it is currently I can't find a solution to do this with spamfilter.

Lets assume you are andrew@widget.com, we will give you an unlimited number of aliases no problem as it all goes into the same andrew mailbox....  but spamfilter can't do that unless there is some way to have spamfilter change the incoming aliases to actually go to andrew@widget.com.

Same is true for catchall type addresses (why anyone uses those is beyond me!).  No objection to a catch all if messages could actually be directed to a specific address.  Otherwise we end up ripping ourselves off.

Since your alias system is at the quarantine level, would you see any value in having the ability to do real aliases at the server level?


-------------
--------------------------------------------------------------
I am a user of SF, not an employee. Use any advice offered at your own risk.


Posted By: AndrewD
Date Posted: 25 April 2011 at 2:09am
i see your issue.
Correct me if i am wrong.
Currently.
Customer x signs up for your service. They say we have 20 users, so you charge them accordingly (Trust them), although they may have 30 valid email adresses (including groups, aliases, etc..) but your database will receive mail for a lot of other addresses as you have spammers guesing at addresses ( mailto:johndoe@widget.com - johndoe@widget.com )
 
What I would suggest.
Do your billing based on the number of logon addresses for the web interface. In my daily email report i send a report to every email address that does not have a valid logon or exists on an alias, but does have email in its quarantine folder, letting them know that there are email in quarantine for them and they need to register to view/release. This gets them to pretty quickly register, allowing you to track the users. (See note below about the frequency of this email)
I think if you were to trial this billing method with your clients you would find that the ammount of logon's would be pretty close to the clients correct number (assuming they are telling you the truth).
 
For them to avoid paying you this they would need to create an logon that is either checked by one person or a group of people. This would be counter productive to any organisation as they would need to trust one person to sift through a LOT of messages, and potentially miss emails.
 
In my opinion the only way a company might consider centralizing the management of all the staffs email addresses is if they were very small ( 5 or less).  And in this case you need to manage that client and ensure that the ammount they are being charged is value.
 
Personally i have several alias's ( mailto:firstname@domain.com - firstname@domain.com   mailto:firstname.lastname@domain.com - firstname.lastname@domain.com   mailto:username@domain.com - username@domain.com   mailto:nickname@domain.com - nickname@domain.com  )
and several of my staff who have commonly misspelt (Brendan Brenden Brendon ) names have ones to cover them.
 
i would test this on your next client.
When they sign up ask them how many users they have and base your billing on that.
then after x period of time check how many logon email addresses they have that they have used within the last x months (I record the last login date/time at every logon) this will cover them against staff that have left.
Compare the amount that they have declared to you vs the ammount of active logons they have. if there is more than y% then you need to make the call as to whether you trust the client and manage accordingly. bearing in mind that your clients do not want to micro manage your service by notifying you of every staff add/delete but you do want a close to realistic number.
 
With the notifications to new email addresses i only send them three consecutive emails on the daily reports after that the email address is skipped untill the last notify was more than x days ago, this reduces the ammount of un-necessary emails being sent from the system.
 
As for the server knowing how many of the addresses are users, i can see no way to do this. Unless you are also providing the mailboxes and have these users in your active directory. Assuming that you are recieving the messages and then forwarding clean mail to there server. Then there is no possible way of telling the difference between a users email address vs an alias/group address.
 
What are you doing with the users outgoing emails. Do you provide them with an outgoing connection? if so then you could look at the reply email address and store these as most will have unique reply to's, this also allows you to filter and capture the receivers abnd add them to the users whitelist (eg if mailto:andrew@wdget.com - andrew@wdget.com sends a message to mailto:yapadu@somewhere.com - yapadu@somewhere.com then yapadu is added to andrew's whitelist, This would get around the worst complaint that i get from users which is why did mailto:yapadu@somewhere.com - yapadu@somewhere.com get quarantined when he has been allowed for the past 2 years. The reason may be that his message suddenly failed a keyword check but because he had never been caught, and released in the past he was never added to the whitelist. By capturing all the users outgoing email recipients and dynamically building a whitelist this allows you to be a lot more agressive with your filters.
 
The downside to providing an outgoing smtp is that you are greatly increasing the traffic through your server (note it doesnt need to be the same server that provides your incoming) and as such you are paying for that traffic data. So its a catch 22.
 
i am currently working on various idea's to this.
1. provide an outgoing with automatic capture of receivers emails. As detailed above.
2. Provide a small exe to the clients that periodically scans there active directory for the number of user accounts (excluding known bogies eg, administrator, iusr_xxx, etc..) it will also look at the exchange log and build a list of receivers that they have sent mail to. This will then connect to my server and update the clients records.
 
Your thoughts on this would be great.
 
Cheers


-------------
Spamfilter web interface. www.tyrexpg.com.au

See http://www.logsat.com/SpamFilter/Forums/forum_posts.asp?TID=6883


Posted By: yapadu
Date Posted: 25 April 2011 at 4:37am
We don't host any mailboxes for users.  All messages are cleaned & forwarded to their remote server.  We don't offer any outbound at all, can imagine the spam complaints (and getting IP's banned) that would cause.

We charge on a per email address, every email address that receives email must be specifically defined in our GUI.  If it is not defined, email is bounced so we don't care if it is a group list etc.

That is why we would like to provide 'free' aliases, only if we have a way to control the target mailbox ourselves and not rely on the recipient server to do it.




-------------
--------------------------------------------------------------
I am a user of SF, not an employee. Use any advice offered at your own risk.


Posted By: AndrewD
Date Posted: 26 April 2011 at 9:24pm
There is no way that this can be done currently. It would be faily simple with the quarantined items as you would only need to replace the destination address with the actual user destination address and forward on for released messages.
 
However to do a lookup and replace on every clean message would be frought with problems (performance etc..) this is also sitting outside what we are there to do which is not alter the original message but simply filter out spam.
 
I think it would be very few clients that would understate there usernumber and if the users have individual logins then i would be surprised if any will activley avoid paying you a fair price.


-------------
Spamfilter web interface. www.tyrexpg.com.au

See http://www.logsat.com/SpamFilter/Forums/forum_posts.asp?TID=6883


Posted By: ktrunkett
Date Posted: 30 April 2012 at 6:23pm
Any suggestions on getting the Webbased quarantine working on Server 2008.  I did get the access data file to connect.  just can't get the web site to display.  


Posted By: AndrewD
Date Posted: 02 May 2012 at 9:20pm
What error are you getting?
Does it show localy?
 
is it publicly published and what is the url i should be able to see it at, so that i can see what error is displayed?
 
cheers


-------------
Spamfilter web interface. www.tyrexpg.com.au

See http://www.logsat.com/SpamFilter/Forums/forum_posts.asp?TID=6883


Posted By: ktrunkett
Date Posted: 02 May 2012 at 9:35pm
it is not public yet.  trying to get this fixed before i dump the old server..


Posted By: b00st3r
Date Posted: 17 July 2012 at 12:09pm
Hi Andrew, 

I have send You an email regarding trying Your webinterface. Don't now if this is still possible?

/Bo :)



Print Page | Close Window