The main system used to measure spam-filtering accuracy in SpamAssassin is the "FP%/FN% percentages" system.
It's quite simple. First, you scan a corpus of hand-classified mail (see HandClassifiedCorpora) to get 4 figures:
nspam = number of known-to-be-spam messages in the corpus nham = number of known-to-be-ham (nonspam) messages in the corpus fp = number of ham messages incorrectly marked as spam fn = number of spam messages incorrectly marked as ham |
fp is so named because it's more commonly and concisely called a FalsePositive, and fn a FalseNegative.
Next, perform this calculation:
FP% = (fp / nham) * 100 FN% = (fn / nspam) * 100 |
and you have two numbers that simply, concisely, and comprehensibly describe the accuracy and performance of the filter.
For example, let's say we do a test as follows:
nspam = 1000 nham = 1500 fp = 2 fn = 30 |
the FP% and FN% work out as (2 / 1500) * 100 = 0.1333% and (30 / 1000) * 100 = 3.0% respectively.
The 'STATISTICS.txt' files distributed with SpamAssassin versions since about 2.30 include this data, measuring the ruleset's accuracy against a validation ruleset:
# SUMMARY for threshold 5.0: # Correctly non-spam: 29443 99.97% # Correctly spam: 27220 97.53% # False positives: 9 0.03% # False negatives: 688 2.47% # TCR(l=50): 24.523726 SpamRecall: 97.535% SpamPrec: 99.967% |
As you can see, FP% and FN% get pride of place in the measurement scheme.
See also MeasuringAccuracy for other methods.
\[http://teensiest.fcpages.com/8.html kissing bridge ny\] | \[http://gonococcal.150m.com/95.html pee wees pads\] | \[http://expletives.100freemb.com/26.html bondage torture female\] | \[http://benched.00freehost.com/32.html petite tit teens\] | \[http://clearstory.00freehost.com/60.html japanese porno\] | \[http://refiled.1sweethost.com/7.html wmv handjob\] | \[http://potty.freewebsitehosting.com/52.html young-gush\] | \[http://stillborn.freewebpages.org/47.html teenage gay pictures\] | \[http://handed.dreamstation.com/49.html anal movie tgp\] | \[http://rumbas.freecities.com/47.html drunk swing party\] | \[http://gelatins.o-f.com/94.html gunge filled knickers\] | \[http://shuffles.fcpages.com/41.html young webcam girl\] | \[http://rigidness.freewebpages.org/21.html mmf bisexual\] | \[http://goodnight.freewebpages.org/33.html used gran prix\] | \[http://faux.1sweethost.com/76.html wet shirt contest\] | \[http://homepage.mac.com/islam2/34.html burn porn dvds\] | \[http://mayflies.angelcities.com/49.html free webcam voyer\] | \[http://woofed.ibnsites.com/92.html hairy wet blondes\] | \[http://muffler.741.com/36.html xxx webcam\] | \[http://clownishly.00freehost.com/20.html mt bachelor webcam\] | \[http://porkers.o-f.com/42.html adult webcam chatrooms\] | \[http://homepage.mac.com/cornflour/93.html erotic black drawings\] | \[http://counters.150m.com/7.html big dick bukkake\] | \[http://homepage.mac.com/docilities/45.html wife orgasm\] | \[http://unwiser.ibnsites.com/53.html spanking story\] | \[http://whensoever.envy.nu/92.html erotic hand job\] | \[http://rigidness.freewebpages.org/64.html female celebrity gallery\] | \[http://catholicly.g0g.net/44.html natural breasted bbw\] |