On Friday, October 15, 2004, 8:01:31 AM, Chris Santerre wrote:
We are going to remove the original 3k+ BigEvil domains from WS. We feel there may be too many FPs coming from it, as our methods of checking have gotten 5 million times better then what I used to do alone.
So rather then checking them all for FP, we simplt remove.
We feel this shouldn't cause any problems, and any domains still being used will be reported to us, and added back in.
Does anyone have any objections to this?
Thanks Chris, Since there were no objections, I have removed the ~3k old domains that are only in BigEvil from WS. This will not remove any that are in BigEvil and also in any other of the data sources feeding into WS.
Note that I have not whitelisted the old BigEvil domains. Instead the process is a "reverse join" where records that are only in the old BigEvil are removed from WS. Any domains or IPs that are are in any WS data sources other than BigEvil will continue to get listed. That includes any that were in BigEvil but get added to WS from another source. So the process is somewhat dynamic, and not a simple static removal or whitelisting. In other words this change won't prevent any domains in BigEvil from getting listed in WS if they get added by another WS data source.
Hopefully that will decrease the FPs in WS, though there is still work to do if we're serious about reducing FPs.
Jeff C. -- "If it appears in hams, then don't list it."