On Tuesday, December 7, 2004, 3:32:51 PM, Ryan Thompson wrote:
Jeff Chan wrote to Matt on Tue, Dec 7th at 10:04 -0800:
yahoo.com and hotmail.com were briefly on sc.surbl.org due a blank line getting onto a whitelist. That problem has since been corrected and all the lists are working normally again.
Whoa! Thanks for the information, Jeff.
To make my searching easier, can you give me a time interval where this occurred? (Or at least a reasonable upper/lower bound?) I'd like to check our logs here to see if anything might have been nuked by this. As long as it was only yahoo.com and hotmail.com, it should just be a matter of grepping the tests for SC hits on hotmail/yahoo during the affected period, right?
To be honest it was anything on our whitelists that were also on sc or any other lists. It started from about 02:30 pacific time until I fixed it around 05:30. Here are logs for yahoo and hotmail:
top-sites-domains.new.log:2004-12-07 10:28 yahoo.com top-sites-domains.new.log:2004-12-07 13:22 yahoo.com top-sites-domains.new.log:2004-12-07 10:28 hotmail.com top-sites-domains.new.log:2004-12-07 13:22 hotmail.com
These are in GMT; the second time was probably triggered by the whitelist joining correctly again.
Another way to fix this would be to find a sort order that puts blank lines at the end of the file instead of the beginning, but it's a moot point since it now squashes blank lines at multiple places, including the final step of producing the master whitelist, so it won't happen again.
FWIW here is the full list for SC:
http://spamcheck.freeapp.net/top-sites-domains.new.log
on:
2004-12-07 10:28 abbonati.tiscali.it 2004-12-07 10:28 altavista.com 2004-12-07 10:28 borland.com 2004-12-07 10:28 cafe24.com 2004-12-07 10:28 co.kr 2004-12-07 10:28 co.uk 2004-12-07 10:28 com.ar 2004-12-07 10:28 com.br 2004-12-07 10:28 com.ph 2004-12-07 10:28 com.tw 2004-12-07 10:28 ebay.com 2004-12-07 10:28 geocities.com 2004-12-07 10:28 hotmail.com 2004-12-07 10:28 idv.tw 2004-12-07 10:28 ig.com.br 2004-12-07 10:28 net.tw 2004-12-07 10:28 nom.br 2004-12-07 10:28 nullsoft.com 2004-12-07 10:28 nvidia.com 2004-12-07 10:28 opera.com 2004-12-07 10:28 placementusa.com 2004-12-07 10:28 tiscali.it 2004-12-07 10:28 topica.com 2004-12-07 10:28 wamu.com 2004-12-07 10:28 yahoo.com
and off:
2004-12-07 13:22 abbonati.tiscali.it 2004-12-07 13:22 altavista.com 2004-12-07 13:22 borland.com 2004-12-07 13:22 cafe24.com 2004-12-07 13:22 co.kr 2004-12-07 13:22 co.uk 2004-12-07 13:22 com.ar 2004-12-07 13:22 com.br 2004-12-07 13:22 com.ph 2004-12-07 13:22 com.tw 2004-12-07 13:22 ebay.com 2004-12-07 13:22 geocities.com 2004-12-07 13:22 hotmail.com 2004-12-07 13:22 idv.tw 2004-12-07 13:22 ig.com.br 2004-12-07 13:22 net.tw 2004-12-07 13:22 nom.br 2004-12-07 13:22 nullsoft.com 2004-12-07 13:22 nvidia.com 2004-12-07 13:22 opera.com 2004-12-07 13:22 placementusa.com 2004-12-07 13:22 tiscali.it 2004-12-07 13:22 topica.com 2004-12-07 13:22 wamu.com 2004-12-07 13:22 yahoo.com
If I can make time to redo the engine, it will be more uniform in the handling of everything and should be simpler, somewhat faster, and a bit more programatically correct. (Speed is really a non issue since I have things so lean by design that most programs complete within a few seconds.)
Jeff C. -- "If it appears in hams, then don't list it."