[SURBL-Discuss] Ham corpora needed

Ryan Thompson ryan at sasknow.com
Mon Sep 6 02:55:19 CEST 2004


Ryan Thompson wrote to Raymond Dijkxhoorn and SURBL Discussion list:

> Jeff Chan wrote to SURBL Discuss:
>
>> Aha, but I'm not too interested in their spams.  I'm interested
>> in their hams for use in FP detection.  Hams probably don't
>> change as rapidly as spams......
>
> I'm running a mass-check against the entire 2003 public corpus. (about
> 6000 messages total). I'll post the results once it's done and I've
> collected easy groupings.

OK. Here it is:

OVERALL%   SPAM%     HAM%     S/O    RANK   SCORE  NAME
    6048     1898     4150    0.314   0.00    0.00  (all messages)
100.000  31.3823  68.6177    0.314   0.00    0.00  (all messages as %)
   1.091   3.4773   0.0000    1.000   1.00    4.00  URIBL_OB_SURBL
   5.258   9.0622   3.5181    0.720   0.29    3.00  URIBL_WS_SURBL
   0.000   0.0000   0.0000    0.500   0.14    5.00  URIBL_AB_SURBL
   0.000   0.0000   0.0000    0.500   0.14    2.00  URIBL_PH_SURBL
   0.000   0.0000   0.0000    0.500   0.14    4.00  URIBL_SC_SURBL
   0.265   0.3688   0.2169    0.630   0.00    1.00  URIBL_PJ_SURBL

I don't have time to go through the results right now, but feel free:

Ham that hit any URIBL rule: http://ry.ca/geturi/pc-ham-uribl.log (14K)
Full ham log: http://ry.ca/geturi/pc-ham.log (340K)
Full spam log: http://ry.ca/geturi/pc-spam.log (159K)

Really, the first one is the interesting one, but the full logs might be
interesting if you want to do your own frequency comparisons.

What you want to do is go through pc-ham-uribl.log, and check each
message mentioned in the log in the SA public corpus to see if you have
any FP candidates or not.

- Ryan

-- 
   Ryan Thompson <ryan at sasknow.com>

   SaskNow Technologies - http://www.sasknow.com
   901-1st Avenue North - Saskatoon, SK - S7K 1Y4

         Tel: 306-664-3600   Fax: 306-244-7037   Saskatoon
   Toll-Free: 877-727-5669     (877-SASKNOW)     North America


More information about the Discuss mailing list