Spam Filter ISP Forums

Spam Filter ISP Support : filter giving me invalid mx record

Thu, 28 Aug 2008 10:28:07 +0000

Author: Desperado
Subject: filter giving me invalid mx record
Posted: 28 August 2008 at 10:28am

sepcity,

The error can also be caused by a reply-to email being formed improperly ... such as something@mail.yahoo.com, rather than something@yahoo.com.

The clip of the log you included looks, however, like some sort of DNS issue. On the machine that SpamFilter is installed on, try running with the "DNS Client" service stopped and see if the errors reduce. If your ISPs DNS Resolvers fail for a lookup, the DNS Client service will cache that "bad" lookup ... not a good thing for a mail server.

In my setup, I have DNS resolvers that are used just for my mail servers and I clear their cache every 30 minutes. This causes more "outside" lookups but less cached errors. My DNS resolvers DO NOT forward the requests to our primary resolvers but rather, go directly to the authoritative DNS servers for lookups.

Edited by Desperado - Today at 10:31am

Spam Filter ISP Support : filter giving me invalid mx record

Thu, 28 Aug 2008 08:48:12 +0000

Author: MokiTheGeek
Subject: filter giving me invalid mx record
Posted: 28 August 2008 at 8:48am

I am having the same type of issues. I have my ISP's DNS server configured within SpamFilter. The majority of the messages are resolved without problem however some get quarantined with failure to find MX record. If you look them up, even from the box they failed from, you get a reply no problem.

My first thought was this was a timeout issue so I upped the DNS timeout within the config file but it has had no effect.

Any suggestions? Also, does anyone use an outside commercial company for lookups to get around this kind of problem?

Spam Filter ISP Support : filter giving me invalid mx record

Wed, 27 Aug 2008 21:53:53 +0000

Author: jerbo128
Subject: filter giving me invalid mx record
Posted: 27 August 2008 at 9:53pm

This is caused by either

1 - incorrect DNS server settings in Spamfilter

2 - a DNS server that is not resolving correctly.

Try pointing the DNS servers settings in Spamfilter to a different DNS resolver (such as one of your ISP's servers)

jerbo128

Spam Filter ISP Support : Exception occurs on autowhitelisting

Wed, 27 Aug 2008 21:53:12 +0000

Author: davemeister
Subject: Exception occurs on autowhitelisting
Posted: 27 August 2008 at 9:53pm

today i've noticed a major issue with my spamfilter 4.0.1.785. I am getting exceptions and a lot of them. They are occuring when a user forces delivery of a message from quaratine or if I try to force delivery from the quarantine (actually, the latter makes spamfilter fail and closes). Here is an excerp from my log:

08/27/08 16:42:53:156 -- (188) Adding to C:\Program Files\SpamFilter\AutoWhiteListForceDelivery.txt:3llb@centa-uk.co.uk|admin@k-com.net
08/27/08 16:42:53:171 -- (188) Exception occurred during TDeliverQuarantineThread.Execute: Insufficient key column information for updating or refreshing 1 2 3 4 5 6 7 8 9 10 11 12 14 15 16 17 18 36 37 38
08/27/08 16:42:54:156 -- (1504) Adding to C:\Program Files\SpamFilter\AutoWhiteListForceDelivery.txt:3llb@centa-uk.co.uk|admin@k-com.net
08/27/08 16:42:54:171 -- (1504) Exception occurred during TDeliverQuarantineThread.Execute: Insufficient key column information for updating or refreshing 1 2 3 4 5 6 7 8 9 10 11 12 14 15 16 17 18 36 37 38
08/27/08 16:42:55:171 -- (3284) Adding to C:\Program Files\SpamFilter\AutoWhiteListForceDelivery.txt:3llb@centa-uk.co.uk|admin@k-com.net
08/27/08 16:42:55:187 -- (3284) Exception occurred during TDeliverQuarantineThread.Execute: Insufficient key column information for updating or refreshing 1 2 3 4 5 6 7 8 9 10 11 12 14 15 16 17 18 36 37 38
08/27/08 16:42:56:156 -- (4036) Adding to C:\Program Files\SpamFilter\AutoWhiteListForceDelivery.txt:3llb@centa-uk.co.uk|admin@k-com.net
08/27/08 16:42:56:171 -- (4036) Exception occurred during TDeliverQuarantineThread.Execute: Insufficient key column information for updating or refreshing 1 2 3 4 5 6 7 8 9 10 11 12 14 15 16 17 18 36 37 38
08/27/08 16:42:57:156 -- (1744) Adding to C:\Program Files\SpamFilter\AutoWhiteListForceDelivery.txt:3llb@centa-uk.co.uk|admin@k-com.net
08/27/08 16:42:57:171 -- (1744) Exception occurred during TDeliverQuarantineThread.Execute: Insufficient key column information for updating or refreshing 1 2 3 4 5 6 7 8 9 10 11 12 14 15 16 17 18 36 37 38
08/27/08 16:42:58:156 -- (3748) Adding to C:\Program Files\SpamFilter\AutoWhiteListForceDelivery.txt:3llb@centa-uk.co.uk|admin@k-com.net
08/27/08 16:42:58:171 -- (3748) Exception occurred during TDeliverQuarantineThread.Execute: Insufficient key column information for updating or refreshing 1 2 3 4 5 6 7 8 9 10 11 12 14 15 16 17 18 36 37 38

I have no idea what can be causing this. I've viewed a few posts with similar results but this is not temorary. Once I manually remove the marked message from quarantine, the problem stops until yet another message is marked for delivery. It appears to be taking up a lot or resources as well. I even removed all items from quarantine to see if that fixes it and it doesn't.

Any help would be much appreciated.

-Dave

p.s. tried to email the logfiles to support@logsat.com but messages came back as undeliverable. Perhaps they fell victim to greylisting, but my server retries every minute for 15 minutes and they still were returned. So if you need a copy of the logfile, please provide me with the FTP address and login to do so. thx.

Spam Filter ISP Support : filter giving me invalid mx record

Wed, 27 Aug 2008 14:40:06 +0000

Author: sepcity
Subject: filter giving me invalid mx record
Posted: 27 August 2008 at 2:40pm

I am getting an invalid MX record when I turn this filter on for I think all the outside domains like yahoo, hotmail and a couple others I noticed

X-SF-HELO-Domain: web81303.mail.mud.yahoo.com
X-SF-Originating-IP: 68.142.199.119
X-Rejection-Reason: 16 - 557 Your domain yahoo.com does not have a valid MX DNS record.
X-SF-SPAM: Y

Could that be something on my DNS server?

Spam Filter ISP Support : Spamfilter 3.1.3.615

Tue, 26 Aug 2008 16:54:56 +0000

Author: LogSat
Subject: Spamfilter 3.1.3.615
Posted: 26 August 2008 at 4:54pm

The growth of the DB depends on the amount of emails you receive. If for example you receive for example 100,000 emails/day, on average that will result in the database growing 1GB per day.

An increase of 800MB in half an hour would indicate a flow of about 4 million emails/day, which I do not believe is your case (please do correct me if the assumption is wrong). However...

..In your 1st post you say that the database is over 9GB, but without going into specifics on the size of the .MDF and of the .LDF files. Only now we see that they are 9.2GB and 1.2GB. As I mentioned before, maintaing the SQL transaction logs (the .LDF files) on a SQL Server is a hassle that database administrators need to beware of, as these transaction logs can become very large. If your .ldf files is 1.2GB *after* you compacted the database, that usually indicates that you (or the DBA) did not truncate the transaction log. If you perform routine backups, and are willing to sacrifice the ability to restore the database at any specific point in time in case of disasters, and are comfortable with just having the ability to restore the database in its entirety only (without the point-in-time option), then I'd recommend you configure the database(s) to use the "Simple" recovery model in SQL Server. This almost completely eliminates the issue with large growing .LDF files and will allow you to have more room.

You can try saving

Spam Filter ISP Support : Spamfilter 3.1.3.615

Tue, 26 Aug 2008 14:37:41 +0000

Author: jwutzke
Subject: Spamfilter 3.1.3.615
Posted: 26 August 2008 at 2:37pm

And so the saga continues

I deleted and rearanged to get 2.1 gigs of free space on the partition that spamfilter database is stored. within 30 min the following database files grew to the following numbers spamfilter.mdf 9,210,368 KB and spamfilter_log.LDF 1,206,106 KB leaving me 1.25 gigs on the hard drive. So they ate up 800 megs in 30 min. I have changed the retention of the quarantined database from 30 to 15 days and have verified that is all that is being saved. My question is what is taking up all the space in the database, and what is growing so quickly?

Spam Filter ISP Support : Stats and Webpage

Mon, 25 Aug 2008 23:27:04 +0000

Author: LogSat
Subject: Stats and Webpage
Posted: 25 August 2008 at 11:27pm

Bart,

SpamFilter provides very limited reporting capability, as there are 3rd party products available that analyze our logs and provide much better reporting capabilities we could add. We recommend using Sawmill (www.sawmill.net). They provide a sample of their capabilities for reporting against SpamFilter logs viewable at:
www.sawmill.net/cgi-bin/samples_bounce.pl?profile_name=spamfilterisp_sample

The web administration sample we provide is still in beta version, but it does allow to control most settings for each domain in the same way SpamFilter does. By default, all domains in SpamFilter Enterprise will use the "default" settings that are applied to the special domain "ALL DOMAINS". If you wish to customize the settings for any domain, you will need to deselect the option "use defaults", which will then allow you to customize the settings for that domain.

There are no options for the end-users to make changes to SpamFilter. It is up to administrators to add blacklist/whitelist entres to the system. The only exception to this occurs when a end-user (or an administrator) forces the delivery of an email that was blocked by SpamFilter (we provide a sample quarantine-access web interface for self users that allows them to view/deliver their spam emals). When an email that was blocked by mistake is force-delivered, SpamFilter will automatically match the sender's email address with the recipient's email address, and will from then on automatically whitelist all emails from that sender to that recipient so that no more emails will be blocked.

Spam Filter ISP Support : Spamfilter 3.1.3.615

Mon, 25 Aug 2008 20:18:29 +0000

Author: LogSat
Subject: Spamfilter 3.1.3.615
Posted: 25 August 2008 at 8:18pm

Jeff,

Hundreds of thousands or several millions can be normal if you receive a lot of emails. The best way to see if the automatic deletion is working is to look at the first dozen of records in the tblQuarantine table. The records will have a field called "MsgDate" that contains the date stamp for the emails that were received. None of the emails in the database should have values in the MsgDate fields that are older than 30 days. If you do have many (as in thousands) records which have older dates, then there is indeed an issue with SpamFilter not being able to delete older messages.

If SpamFilter does have issues deleting the records, you can manually delete them by executing the following query in SQL Server on the SpamFilter database:

SET ROWCOUNT 500
delete_more1:
UPDATE tblQuarantine SET Expire = 1 WHERE (DATEDIFF(day, MsgDate, GETDATE()) > 30)
IF @@ROWCOUNT > 0 GOTO delete_more1
SET ROWCOUNT 0

SET ROWCOUNT 500
delete_more2:
DELETE FROM tblQuarantine WHERE tblQuarantine.Expire <> 0
IF @@ROWCOUNT > 0 GOTO delete_more2
SET ROWCOUNT 0

SET ROWCOUNT 500
delete_more3:
DELETE tblMsgs FROM tblMsgs LEFT JOIN tblQuarantine
ON tblMsgs.MsgID = tblQuarantine.MsgID WHERE (tblQuarantine.MsgID IS NULL)
IF @@ROWCOUNT > 0 GOTO delete_more3
SET ROWCOUNT 0

The only parameter you may want to change is that big “30” that specifies the number of days to hold the emails. This procedure uses loops to update/delete 500 rows of data at a time, and this avoid extensive table/row locking to increase performance and reduce database timeouts.

Records can also be deleted from the database with a simple "DELETE" query to remove all old entries, but doing so can place locks on the database preventing SpamFilter from adding new records while the delete process occurs in the background.

Spam Filter ISP Support : Stats and Webpage

Mon, 25 Aug 2008 18:12:34 +0000

Author: Bart
Subject: Stats and Webpage
Posted: 25 August 2008 at 6:12pm

Hi there,

I' m testing SFE and we're planning to implement this in a couple of weeks but there are some things i can' t find.

1. Stats for a single domain ?

Is there a way to get the statistics for a single domain ? What i want is total number of messages filterd in a specific time frame and some total spam reports with Country stats and reject reasons.

2. Web Admin

I found the web admin but it' s not enough, is there a complete web interface to administrate the complete settings for myself and as an alternative a page to set filter settings per domain ? In het example i can set everything i want for each domain i online have to switch to that domain and then i can set whatever i want.

I' m no ASP (.net) guru so i was searching for a complete web solution.

Also looking for an interface to ad senders to a blacklist based on the messages in their inbox. I can't believe there is nobody that has a total solution but i can't find it

It doesn't have to be a free solution but it needs to have good functionality.

If there are solutions for these 2 simple questions you have a new happy customer