Discuss

discuss@lists.surbl.org

1862 discussions

Re: [SURBL-Discuss] multi.surbl.org.rbldnsd Update Times
by Jeff Chan 10 May '05

10 May '05

[off list reply published with Eric's permission] On Monday, May 9, 2005, 9:33:12 AM, Eric Smith wrote: > Found out this morning it was an error in the way we were reporting file > times. Everything is good now. We were piping modified times out to an > HTML page every hour then we check if the page had changed at all in the > last 12 hours. > /E. Cool. BTW if you want to know the actual timestamp of the data, the best way is to look at the zone file serial number. Those are generated from the number of epoch seconds at UTC when the file is created. For example: % dig multi.surbl.org soa [...] multi.surbl.org. 15M IN SOA a.surbl.org. zone.surbl.org. ( 1115680902 ; serial 10M ; refresh 5M ; retry 1W ; expiry 15M ) ; minimum % % date -u -r 1115680902 Mon May 9 23:21:42 UTC 2005 Jeff C. -- Don't harm innocent bystanders.

1 0

RE: [SURBL-Discuss] newly registered domains
by Chris Santerre 10 May '05

10 May '05

Because they don't take to kindly to anyone doing tons of whois looksups an hour. Trust me ;) --Chris >-----Original Message----- >From: Matthew Wilson [mailto:matthew@boomer.com] >Sent: Monday, May 09, 2005 9:44 AM >To: SURBL Discussion list >Subject: RE: [SURBL-Discuss] newly registered domains > > >Why not integrate a whois date lookup directly into SURBL or URIBL? >Design an encoding system whereby >suspectedspammydomain.spammertld.dr.surbl.org (or uribl.com) would >return the date somehow regex encoded in the IP address. Then write a >nice SA rule that decodes it, also using regex. Are there any regex >geniuses out there that could encode a date in an IP address? > >-Matthew > > >> Well this has been brought up before. It is a very good idea, >> however difficult to implement. Unfortunetly the date >> returned by a whois querey comes in a wide variety of >> flavors. We (SARE) thought we had all of the returned date >> codes figured out. Nope. New ones still keep coming. >> >> uribl.com has some ideas on how to attack this very issue, >> but not sure it is worth it yet. >> >> In short, it would be wonderful to start doing whois lookups >> for every domain in an email. Lots of things could be flagged >> off of it. Think of a sort of baysien whois DB. But the >> traffic would be pretty dam big. >> >> --Chris >> _______________________________________________ >> Discuss mailing list >> Discuss(a)lists.surbl.org >> http://lists.surbl.org/mailman/listinfo/discuss >> >> >> > > >_______________________________________________ >Discuss mailing list >Discuss(a)lists.surbl.org >http://lists.surbl.org/mailman/listinfo/discuss >

3 2

RE: [SURBL-Discuss] newly registered domains
by Chris Santerre 09 May '05

09 May '05

Exactly, and do you have any idea how many of the lookups would be needed per day? I do! Enough to get the uribl dns ip doing the lookups, blocked from the whois servers. People running the whois servers don't really play nice with others. You need to approach them very carefully. APNIC is not going to be to helpful ;) --Chris >-----Original Message----- >From: Matthew Wilson [mailto:matthew@boomer.com] >Sent: Monday, May 09, 2005 1:29 PM >To: SURBL Discussion list >Subject: RE: [SURBL-Discuss] newly registered domains > > >I wasn't talking about doing huge numbers of whois lookups; I >was saying >cache the whois lookups in the a uribl dns zone, encoded using regex. > >> -----Original Message----- >> From: discuss-bounces(a)lists.surbl.org >> [mailto:discuss-bounces@lists.surbl.org] On Behalf Of Chris Santerre >> Sent: Monday, May 09, 2005 9:20 AM >> To: 'SURBL Discussion list' >> Subject: RE: [SURBL-Discuss] newly registered domains >> >> Because they don't take to kindly to anyone doing tons of >> whois looksups an hour. Trust me ;) >> >> --Chris >> >> >-----Original Message----- >> >From: Matthew Wilson [mailto:matthew@boomer.com] >> >Sent: Monday, May 09, 2005 9:44 AM >> >To: SURBL Discussion list >> >Subject: RE: [SURBL-Discuss] newly registered domains >> > >> > >> >Why not integrate a whois date lookup directly into SURBL or URIBL? >> >Design an encoding system whereby >> >suspectedspammydomain.spammertld.dr.surbl.org (or uribl.com) would >> >return the date somehow regex encoded in the IP address. >> Then write a >> >nice SA rule that decodes it, also using regex. Are there >any regex >> >geniuses out there that could encode a date in an IP address? >> > >> >-Matthew > > >_______________________________________________ >Discuss mailing list >Discuss(a)lists.surbl.org >http://lists.surbl.org/mailman/listinfo/discuss >

1 0

RE: [SURBL-Discuss] newly registered domains
by Matthew Wilson 09 May '05

09 May '05

I wasn't talking about doing huge numbers of whois lookups; I was saying cache the whois lookups in the a uribl dns zone, encoded using regex. > -----Original Message----- > From: discuss-bounces(a)lists.surbl.org > [mailto:discuss-bounces@lists.surbl.org] On Behalf Of Chris Santerre > Sent: Monday, May 09, 2005 9:20 AM > To: 'SURBL Discussion list' > Subject: RE: [SURBL-Discuss] newly registered domains > > Because they don't take to kindly to anyone doing tons of > whois looksups an hour. Trust me ;) > > --Chris > > >-----Original Message----- > >From: Matthew Wilson [mailto:matthew@boomer.com] > >Sent: Monday, May 09, 2005 9:44 AM > >To: SURBL Discussion list > >Subject: RE: [SURBL-Discuss] newly registered domains > > > > > >Why not integrate a whois date lookup directly into SURBL or URIBL? > >Design an encoding system whereby > >suspectedspammydomain.spammertld.dr.surbl.org (or uribl.com) would > >return the date somehow regex encoded in the IP address. > Then write a > >nice SA rule that decodes it, also using regex. Are there any regex > >geniuses out there that could encode a date in an IP address? > > > >-Matthew

1 0

RE: [SURBL-Discuss] newly registered domains
by Matthew Wilson 09 May '05

09 May '05

Why not integrate a whois date lookup directly into SURBL or URIBL? Design an encoding system whereby suspectedspammydomain.spammertld.dr.surbl.org (or uribl.com) would return the date somehow regex encoded in the IP address. Then write a nice SA rule that decodes it, also using regex. Are there any regex geniuses out there that could encode a date in an IP address? -Matthew > Well this has been brought up before. It is a very good idea, > however difficult to implement. Unfortunetly the date > returned by a whois querey comes in a wide variety of > flavors. We (SARE) thought we had all of the returned date > codes figured out. Nope. New ones still keep coming. > > uribl.com has some ideas on how to attack this very issue, > but not sure it is worth it yet. > > In short, it would be wonderful to start doing whois lookups > for every domain in an email. Lots of things could be flagged > off of it. Think of a sort of baysien whois DB. But the > traffic would be pretty dam big. > > --Chris > _______________________________________________ > Discuss mailing list > Discuss(a)lists.surbl.org > http://lists.surbl.org/mailman/listinfo/discuss > > >

1 0

RE: [SURBL-Discuss] newly registered domains
by Chris Santerre 09 May '05

09 May '05

>-----Original Message----- >From: Matthew Wilson [mailto:matthew@boomer.com] >Sent: Sunday, May 08, 2005 9:29 PM >To: Jeff Chan; SURBL Discussion list >Subject: [SURBL-Discuss] newly registered domains > > >Does anyone know of a SA rule to check how recently a domain name has >been registered? > >The various uri lookups catch the vast majority of spammy urls during >the day, but from 2-5 a.m. CST, my servers get hit with tons of spam >with urls that aren't in SURBL yet. All of the domains are newly >registered domains (registered in the past week or so). > >I know that the SARE ninjas have some private tools to do this kind of >lookup for their feeds and manual lookups, but I'm wondering if this >kind of thing could be worked directly into a SA rule. Well this has been brought up before. It is a very good idea, however difficult to implement. Unfortunetly the date returned by a whois querey comes in a wide variety of flavors. We (SARE) thought we had all of the returned date codes figured out. Nope. New ones still keep coming. uribl.com has some ideas on how to attack this very issue, but not sure it is worth it yet. In short, it would be wonderful to start doing whois lookups for every domain in an email. Lots of things could be flagged off of it. Think of a sort of baysien whois DB. But the traffic would be pretty dam big. --Chris

2 1

RE: [SURBL-Discuss] multi.surbl.org.rbldnsd Update Times
by Smith, Eric 09 May '05

09 May '05

When you say several times an hour, does that mean weekends and holidays also? /E. -----Original Message----- From: discuss-bounces(a)lists.surbl.org [mailto:discuss-bounces@lists.surbl.org] On Behalf Of Jeff Chan Sent: Sunday, May 08, 2005 11:01 AM To: SURBL Discussion list Subject: Re: [SURBL-Discuss] multi.surbl.org.rbldnsd Update Times On Sunday, May 8, 2005, 7:09:11 AM, Eric Smith wrote: > I'm sure this is dependent on the mirror we are pulling the zone from, but > how often is the source zone updated, and should we expect that mirrors > update on a regular schedule around the clock? What I'm getting at is we > are monitoring file changes to the zone file to ensure it's updating often, > but as of Friday we have received no updates (I'm guessing because it > doesn't get updated on the weekends). Is my assumption correct? Does the > schedule vary by mirror? If so is there a mirror that anyone knows the > replication interval for? If not Jeff do you know the schedule requirements > for a site to become a mirror so we can base monitoring off this schedule? If you're asking about spamhaus lists, I have no idea. SURBL lists are updated several times an hour usually. Jeff C. -- Don't harm innocent bystanders. _______________________________________________ Discuss mailing list Discuss(a)lists.surbl.org http://lists.surbl.org/mailman/listinfo/discuss

2 1

newly registered domains
by Matthew Wilson 09 May '05

09 May '05

Does anyone know of a SA rule to check how recently a domain name has been registered? The various uri lookups catch the vast majority of spammy urls during the day, but from 2-5 a.m. CST, my servers get hit with tons of spam with urls that aren't in SURBL yet. All of the domains are newly registered domains (registered in the past week or so). I know that the SARE ninjas have some private tools to do this kind of lookup for their feeds and manual lookups, but I'm wondering if this kind of thing could be worked directly into a SA rule. Thanks, Matthew

2 1

multi.surbl.org.rbldnsd Update Times
by Smith, Eric 08 May '05

08 May '05

I'm sure this is dependent on the mirror we are pulling the zone from, but how often is the source zone updated, and should we expect that mirrors update on a regular schedule around the clock? What I'm getting at is we are monitoring file changes to the zone file to ensure it's updating often, but as of Friday we have received no updates (I'm guessing because it doesn't get updated on the weekends). Is my assumption correct? Does the schedule vary by mirror? If so is there a mirror that anyone knows the replication interval for? If not Jeff do you know the schedule requirements for a site to become a mirror so we can base monitoring off this schedule? Any input is greatly appreciated. Thanks, Eric

2 1

RE: [SURBL-Discuss] SURBL Content
by Smith, Eric 08 May '05

08 May '05

XBL actually, very strange, I will check and follow up regarding it. /E. -----Original Message----- From: discuss-bounces(a)lists.surbl.org [mailto:discuss-bounces@lists.surbl.org] On Behalf Of Jeff Chan Sent: Friday, May 06, 2005 11:34 PM To: SURBL Discussion list Subject: Re: [SURBL-Discuss] SURBL Content On Friday, May 6, 2005, 5:59:15 PM, Eric Smith wrote: > This morning we received a huge blast from a spammer that spamhaus.org > identified properly but multi.surbl.org.rbldnsd didn't :( Just checking > though :) > Eric When you say spamhaus.org, which list are you referring to, XBL or SBL? Because one of the new lists we're experimenting with, xu.surbl.org, gets data from CBL spamtrap URI hits. CBL feeds into XBL, and some of the XBL senders probably end up in SBL also. Next time you see one like this, if you check it using the SURBL checker: http://www.rulesemporium.com/cgi-bin/uribl.cgi it would be interesting to to hear if it hits the preliminary version of the XS data. Cheers, Jeff C. -- Don't harm innocent bystanders. _______________________________________________ Discuss mailing list Discuss(a)lists.surbl.org http://lists.surbl.org/mailman/listinfo/discuss

1 0

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

Discuss