On Monday, July 12, 2004, 4:06:44 PM, Marc Kool wrote:
Chris Santerre wrote:
To start another thread: I am a contributor to the free URL database that can be used by squidguard and dansguardian with a strong focus on sex sites (with 397000 domains). Although not every sex site sends spam, a mail administrator may want to implement a local policy to block emails that refer to sex sites (I would :-) Does anybody wants/needs/likes sex.surbl.org ??? For a list like sex.surbl.org a feature to include IP addresses is a benefit since 57% percent of the sex domains have 10 or more domains resolving to a single IP address.
Mark this is a GREAT idea. I'm BCC'ing Jeff on it to make sure he sees this.
--Chris
I received some questions, so for those who don't know it yet: the free URL database that mainly includes a list of adult domains can be found on http://cri.univ-tlse1.fr/documentations/cache/squidguard_en.html#contrib (correction to the above number: 466057 adult domains are listed on July 13 2004). If you want to pay for it, you may want to go to http://www.urlblacklist.com
-Marc
Thanks for sharing this idea and a free list of the relevant domains. I agree it's an interesting idea, though we've been focussed on spammer's URI domains so far, so it's a bit of a tangent.
At nearly 500k record we'd definitely want to do this with rbldnsd. BIND is already getting pretty slow with lists approaching 100k records. For comparison, sbl.spamhaus.org has about 5k records, xbl has about 1.7 million records, list.dsbl.org has nearly 4 million records. multi.surbl.org, our largest production list has about 45k records.
How does anyone else feel about turning this list of sex sites into a SURBL?
Jeff C.
Hi!
Thanks for sharing this idea and a free list of the relevant domains. I agree it's an interesting idea, though we've been focussed on spammer's URI domains so far, so it's a bit of a tangent.
At nearly 500k record we'd definitely want to do this with rbldnsd. BIND is already getting pretty slow with lists approaching 100k records. For comparison, sbl.spamhaus.org has about 5k records, xbl has about 1.7 million records, list.dsbl.org has nearly 4 million records. multi.surbl.org, our largest production list has about 45k records.
How does anyone else feel about turning this list of sex sites into a SURBL?
If its a seperate list, sure, would be great i think.
Bye, Raymond.
On Sunday, July 18, 2004, 2:48:54 AM, Raymond Dijkxhoorn wrote:
Thanks for sharing this idea and a free list of the relevant domains. I agree it's an interesting idea, though we've been focussed on spammer's URI domains so far, so it's a bit of a tangent.
At nearly 500k record we'd definitely want to do this with rbldnsd. BIND is already getting pretty slow with lists approaching 100k records. For comparison, sbl.spamhaus.org has about 5k records, xbl has about 1.7 million records, list.dsbl.org has nearly 4 million records. multi.surbl.org, our largest production list has about 45k records.
How does anyone else feel about turning this list of sex sites into a SURBL?
If its a seperate list, sure, would be great i think.
Yes, it would be a separate list.
I'm a little concerned that such a list could result in significant false positives *if misapplied*. While sex sites probably appears in a lot of spams, this would also be slightly off our charter of going specifically after spammer domains. In other words while some adult sites are probably major spammers, some probably aren't. On the other hand, I can see how it would be quite useful for general content blocking, including the novel suggestion to use SURBLs in squid web proxy caches. But it feels like some topic drift to me....
Anyone else have thoughts on this?
Jeff C.
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
Jeff Chan writes:
On Sunday, July 18, 2004, 2:48:54 AM, Raymond Dijkxhoorn wrote:
Thanks for sharing this idea and a free list of the relevant domains. I agree it's an interesting idea, though we've been focussed on spammer's URI domains so far, so it's a bit of a tangent.
At nearly 500k record we'd definitely want to do this with rbldnsd. BIND is already getting pretty slow with lists approaching 100k records. For comparison, sbl.spamhaus.org has about 5k records, xbl has about 1.7 million records, list.dsbl.org has nearly 4 million records. multi.surbl.org, our largest production list has about 45k records.
How does anyone else feel about turning this list of sex sites into a SURBL?
If its a seperate list, sure, would be great i think.
Yes, it would be a separate list.
I'm a little concerned that such a list could result in significant false positives *if misapplied*. While sex sites probably appears in a lot of spams, this would also be slightly off our charter of going specifically after spammer domains. In other words while some adult sites are probably major spammers, some probably aren't. On the other hand, I can see how it would be quite useful for general content blocking, including the novel suggestion to use SURBLs in squid web proxy caches. But it feels like some topic drift to me....
Anyone else have thoughts on this?
Good point.
I would suggest that if you set up a separate page on the website listing SURBLs that are specifically *not* necessarily spam-oriented, that'd be a good way to keep them separate and avoid people blindly throwing it into the spamfiltering mix.
- --j.
On Sunday, July 18, 2004, 5:35:52 PM, Justin Mason wrote:
Jeff Chan writes:
How does anyone else feel about turning this list of sex sites into a SURBL?
I'm a little concerned that such a list could result in significant false positives *if misapplied*. While sex sites probably appears in a lot of spams, this would also be slightly off our charter of going specifically after spammer domains. In other words while some adult sites are probably major spammers, some probably aren't. On the other hand, I can see how it would be quite useful for general content blocking, including the novel suggestion to use SURBLs in squid web proxy caches. But it feels like some topic drift to me....
I would suggest that if you set up a separate page on the website listing SURBLs that are specifically *not* necessarily spam-oriented, that'd be a good way to keep them separate and avoid people blindly throwing it into the spamfiltering mix.
That's a good suggestion of course. Even so, I can still see some "people blindly throwing it into the spamfiltering mix".... :-(
Not too many people would probably complain to their bosses about not being able to get mail about sex sites, but it could still technically be a false positive in some cases with respect to spam.
Jeff C.
-
Bret Miller -
Jeff Chan -
jm＠jmason.org -
Raymond Dijkxhoorn