bugzilla-daemon at bugzilla
Oct 14, 2009, 4:29 PM
Post #62 of 165
(1819 views)
Permalink
|
|
[Bug 6155] generate new scores for 3.3.0 release
[In reply to]
|
|
https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6155
--- Comment #97 from Mark Martinec <Mark.Martinec [at] ijs> 2009-10-14 16:29:29 UTC ---
gen-set0-5-5.0-10000-ga
test (10%)
# SUMMARY for threshold 5.0:
# Correctly non-spam: 35461 98.50%
# Correctly spam: 38357 81.35%
# False positives: 541 1.50%
# False negatives: 8794 18.65%
# TCR(l=50): 1.315450 SpamRecall: 81.349% SpamPrec: 98.609%
scores (90%):
# SUMMARY for threshold 5.0:
# Correctly non-spam: 283119 42.494% (98.304% of non-spam corpus)
# Correctly spam: 306367 45.984% (80.997% of spam corpus)
# False positives: 4886 0.733% (1.696% of nonspam, 179777 weighted)
# False negatives: 71879 10.789% (19.003% of spam, 231331 weighted)
# Average score for spam: 10.4 nonspam: 1.7
# Average for false-pos: 5.6 false-neg: 3.2
# TOTAL: 666251 100.00%
gen-set1-10-5.0-10000-ga
test:
# SUMMARY for threshold 5.0:
# Correctly non-spam: 35942 99.83%
# Correctly spam: 45983 97.52%
# False positives: 60 0.17%
# False negatives: 1168 2.48%
# TCR(l=50): 11.312620 SpamRecall: 97.523% SpamPrec: 99.870%
scores:
# SUMMARY for threshold 5.0:
# Correctly non-spam: 287639 43.173% (99.873% of non-spam corpus)
# Correctly spam: 368783 55.352% (97.498% of spam corpus)
# False positives: 366 0.055% (0.127% of nonspam, 27040 weighted)
# False negatives: 9463 1.420% (2.502% of spam, 29645 weighted)
# Average score for spam: 20.3 nonspam: 0.2
# Average for false-pos: 5.6 false-neg: 3.1
# TOTAL: 666251 100.00%
gen-set2-10-5.0-10000-ga
test:
# SUMMARY for threshold 5.0:
# Correctly non-spam: 35949 99.85%
# Correctly spam: 44538 94.46%
# False positives: 53 0.15%
# False negatives: 2613 5.54%
# TCR(l=50): 8.958959 SpamRecall: 94.458% SpamPrec: 99.881%
scores:
# SUMMARY for threshold 5.0:
# Correctly non-spam: 287557 43.160% (99.844% of non-spam corpus)
# Correctly spam: 357656 53.682% (94.556% of spam corpus)
# False positives: 448 0.067% (0.156% of nonspam, 33456 weighted)
# False negatives: 20590 3.090% (5.444% of spam, 73371 weighted)
# Average score for spam: 12.3 nonspam: 0.8
# Average for false-pos: 5.7 false-neg: 3.6
# TOTAL: 666251 100.00%
gen-set3-20-5.0-10000-ga
test:
# SUMMARY for threshold 5.0:
# Correctly non-spam: 21173 99.92%
# Correctly spam: 43749 99.08%
# False positives: 17 0.08%
# False negatives: 404 0.92%
# TCR(l=50): 35.209729 SpamRecall: 99.085% SpamPrec: 99.961%
scores:
# SUMMARY for threshold 5.0:
# Correctly non-spam: 168159 32.186% (99.976% of non-spam corpus)
# Correctly spam: 350875 67.159% (99.046% of spam corpus)
# False positives: 40 0.008% (0.024% of nonspam, 9039 weighted)
# False negatives: 3379 0.647% (0.954% of spam, 11476 weighted)
# Average score for spam: 19.3 nonspam: -0.8
# Average for false-pos: 5.4 false-neg: 3.4
# TOTAL: 522453 100.00%
===========
In summary, the essential data:
score set 0 (no net, no bayes):
# False positives: 4886 0.733% (1.696% of nonspam, 179777 weighted)
# False negatives: 71879 10.789% (19.003% of spam, 231331 weighted)
score set 1 (net, no bayes):
# False positives: 366 0.055% (0.127% of nonspam, 27040 weighted)
# False negatives: 9463 1.420% (2.502% of spam, 29645 weighted)
score set 2 (no net, bayes):
# False positives: 448 0.067% (0.156% of nonspam, 33456 weighted)
# False negatives: 20590 3.090% (5.444% of spam, 73371 weighted)
score set 3 (net, bayes):
# False positives: 40 0.008% (0.024% of nonspam, 9039 weighted)
# False negatives: 3379 0.647% (0.954% of spam, 11476 weighted)
--
Configure bugmail: https://issues.apache.org/SpamAssassin/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
|
