Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: SpamAssassin: devel
[Bug 6793] New: PATCH reduce sa-awl memory usage
 

Index | Next | Previous | View Flat


bugzilla-daemon at bugzilla

Apr 23, 2012, 12:32 PM


Views: 136
Permalink
[Bug 6793] New: PATCH reduce sa-awl memory usage

https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6793

Bug #: 6793
Summary: PATCH reduce sa-awl memory usage
Product: Spamassassin
Version: unspecified
Platform: PC
OS/Version: All
Status: NEW
Severity: normal
Priority: P2
Component: Tools
AssignedTo: dev [at] spamassassin
ReportedBy: vitalyb [at] telenet
Classification: Unclassified


Created attachment 5050
--> https://issues.apache.org/SpamAssassin/attachment.cgi?id=5050
patch

Hello,

current version of sa-awl loads full database key list to memory before showing
any
stats or performing maintenance. I believe it's obvious that this behavior is
undesirable and makes large databases impossible to handle.

The patch below improves sa-awl scaling and responsiveness by scanning database
row-by-row basis instead of loading all keys to memory first.

Tested cleaning db with over 8 million rows.

For a cached db with 850K rows memory usage lowers from 1G to 6M, execution
time
is around 12% slower (26 vs. 29 sec), though.

I'm not a perl expert, please review.

Thanks.

--
Configure bugmail: https://issues.apache.org/SpamAssassin/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

Subject User Time
[Bug 6793] New: PATCH reduce sa-awl memory usage bugzilla-daemon at bugzilla Apr 23, 2012, 12:32 PM

  Index | Next | Previous | View Flat
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.