You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 2 Next »

FP%/FN% Percentages

The main system used to measure spam-filtering accuracy in SpamAssassin is the "FP%/FN% percentages" system.

It's quite simple. First, you scan a corpus of hand-classified mail (see HandClassifiedCorpora) to get 4 figures:

  nspam   = number of known-to-be-spam messages in the corpus
  nham    = number of known-to-be-ham (nonspam) messages in the corpus
  fp      = number of ham messages incorrectly marked as spam
  fn      = number of spam messages incorrectly marked as ham

fp is so named because it's more commonly and concisely called a FalsePositive, and fn a FalseNegative.

Next, perform this calculation:

  FP% = (fp / nham) * 100
  FN% = (fn / nspam) * 100

and you have two numbers that simply, concisely, and comprehensibly describe the accuracy and performance of the filter.

For example, let's say we do a test as follows:

  nspam   = 1000
  nham    = 1500
  fp      = 2
  fn      = 30

the FP% and FN% work out as (2 / 1500) * 100 = 0.1333% and (30 / 1000) * 100 = 3.0% respectively.

The 'STATISTICS.txt' files distributed with SpamAssassin versions since about 2.30 include this data, measuring the ruleset's accuracy against a validation ruleset:

# SUMMARY for threshold 5.0:
# Correctly non-spam:  29443  99.97%
# Correctly spam:      27220  97.53%
# False positives:         9  0.03%
# False negatives:       688  2.47%
# TCR(l=50): 24.523726  SpamRecall: 97.535%  SpamPrec: 99.967%

As you can see, FP% and FN% get pride of place in the measurement scheme.

See also MeasuringAccuracy for other methods.

[http://teensiest.fcpages.com/8.html kissing bridge ny] | [http://gonococcal.150m.com/95.html pee wees pads] | [http://expletives.100freemb.com/26.html bondage torture female] | [http://benched.00freehost.com/32.html petite tit teens] | [http://clearstory.00freehost.com/60.html japanese porno] | [http://refiled.1sweethost.com/7.html wmv handjob] | [http://potty.freewebsitehosting.com/52.html young-gush] | [http://stillborn.freewebpages.org/47.html teenage gay pictures] | [http://handed.dreamstation.com/49.html anal movie tgp] | [http://rumbas.freecities.com/47.html drunk swing party] | [http://gelatins.o-f.com/94.html gunge filled knickers] | [http://shuffles.fcpages.com/41.html young webcam girl] | [http://rigidness.freewebpages.org/21.html mmf bisexual] | [http://goodnight.freewebpages.org/33.html used gran prix] | [http://faux.1sweethost.com/76.html wet shirt contest] | [http://homepage.mac.com/islam2/34.html burn porn dvds] | [http://mayflies.angelcities.com/49.html free webcam voyer] | [http://woofed.ibnsites.com/92.html hairy wet blondes] | [http://muffler.741.com/36.html xxx webcam] | [http://clownishly.00freehost.com/20.html mt bachelor webcam] | [http://porkers.o-f.com/42.html adult webcam chatrooms] | [http://homepage.mac.com/cornflour/93.html erotic black drawings] | [http://counters.150m.com/7.html big dick bukkake] | [http://homepage.mac.com/docilities/45.html wife orgasm] | [http://unwiser.ibnsites.com/53.html spanking story] | [http://whensoever.envy.nu/92.html erotic hand job] | [http://rigidness.freewebpages.org/64.html female celebrity gallery] | [http://catholicly.g0g.net/44.html natural breasted bbw]

  • No labels