On Thursday, September 14, 2006, 7:02:46 AM, Ron Guerin wrote:
Jeff Chan wrote:
Submission-time checks were the main intention.
That's what I thought, but I wanted some clarification. I'm the author of a redirector created in October 2004 that has always used SURBL to check submitted URLs. Nevertheless, I find my database polluted with abuse. Even though most of it redirects to pages in Asian languages I don't understand, it's not hard to recognize spammers landing pages. It also occurs to me that checking the URL at submission time is probably checking it before any spam with that URL has been sent, and by extension, before it would appear in SURBL.
Makes sense.
Among the things I'm considering, is re-checking accepted URLs a few hours later, and flagging them for abuse if they come up with a hit. The other thing I think needs to be done is to follow and count the number of re-directions. I see a lot of URLs in my database that are other redirection services.
A re-check sounds reasonable. If you'd be doing a large volume of queries you may want to consider using rsynced local versions of the zone files:
http://www3.surbl.org/rsync-signup.html
Jeff C. -- Don't harm innocent bystanders.