Process Growth over time

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
MK
Reply | Threaded
Open this post in threaded view
|

Process Growth over time

MK
Using the last few CVS/test builds, we're seeing about 400-500MB/10 minutes in growth in the perl process.  Eventually, the process runs out of memory, gets killed by the OS, and starts all over again.
Everything is stored in a MySQL database alongside ASSP.  Tried in a server with 12GB of RAM and one with 32GB of RAM with the same results.  Setting [$main::showMEM = 1] during bootup or while running stops ASSP and simply prints thousands of lines of [got unexpected signal SEGV in Worker_4: package - main, file - /usr/local/assp/assp.pl, line - 5435]
Looking for a starting point to help debug, as rebooting ASSP three times a day of course shouldn't be the norm.
=======
Time Process Size MB Growth in 10min Percentage Growth
1:50:01 1317
2:00:00 1731  414  31.44%
2:10:00 2115  384  22.18%
2:20:04 2435  320  15.13%
2:30:03 2691  256  10.51%
2:40:02 3075  384  14.27%
2:50:01 3397  322  10.47%
3:00:00 3845  448  13.19%
3:10:05 4229  384  9.99%
3:20:04 4742  513  12.13%
3:30:03 5126  384  8.10%
3:40:04 5638  512  9.99%
3:50:00 6022  384  6.81%
4:00:00 6406  384  6.38%
4:10:04 6792  386  6.03%
4:20:03 7240  448  6.60%
4:30:02 7752  512  7.07%
4:40:01 8205  453  5.84%
4:50:00 8529  324  3.95%
5:00:05 9111  582  6.82%
5:10:04 9495  384  4.21%
5:20:03 9879  384  4.04%
5:30:02 10327  448  4.53%
5:40:03 10711  384  3.72%
5:50:02 11223  512  4.78%
6:00:01 11607  384  3.42%
6:10:00 12055  448  3.86%
6:20:04 12503  448  3.72%
6:30:04 12951  448  3.58%
6:40:04 13343  392  3.03%
6:50:03 13791  448  3.36%
7:00:02 14243  452  3.28%
7:10:03 14819  576  4.04%
7:20:02 15267  448  3.02%
7:30:01 15779  512  3.35%
7:40:01 16419  640  4.06%
7:50:05 16867  448  2.73%
8:00:04 17379  512  3.04%
8:10:03 17771  392  2.26%
8:20:02 18347  576  3.24%
8:30:01 18859  512  2.79%
8:40:00 19243  384  2.04%
8:50:05 19757  514  2.67%
9:00:04 20269  512  2.59%
9:10:03 20845  576  2.84%
9:20:02 21358  513  2.46%
9:30:01 21934  576  2.70%
9:40:02 22574  640  2.92%
9:50:02 23214  640  2.84%
10:00:02 23982  768  3.31%
10:10:01 24686  704  2.94%
10:20:00 25262  576  2.33%
10:30:04 25966  704  2.79%
10:40:04 27182  1,216  4.68%
10:50:03 28270  1,088  4.00%
11:00:05 28848  578  2.04%
======

Modules seem up to date as well
====
I'm mostly up to date with my modules, with the only things slightly older are Digest:MD5 and MIME::Types and Net::LDAP which I've since updated and see the same issue.
Module Name Module Version 
ASSP_FC 1.05 / 1.05 
ASSP_SVG 1.03 / 1.03 
ASSP_WordStem 2.02 / 1.27 
AsspSelfLoader 2.03 / 2.03 
Authen::SASL 2.16 / 2.16 
BerkeleyDB 0.54 / 0.42 
BerkeleyDB_DBEngine 5.3 / 4.5 
Compress::Zlib 2.074 / 2.069 
Convert::TNEF disabled by Module Setup / 0.17 
Crypt::SMIME 0.19 / 0.13 
DB_File disabled by Module Setup / 1.816 
Digest::MD5 2.53 / 2.54 
Digest::SHA1 2.13 / 2.13 
Email::MIME 1.940 / 1.936 
Email::Send 2.201 / 2.201 
File::ReadBackwards 1.05 / 1.05 
File::Scan::ClamAV 1.95 / 1.93 
File::Which 1.21 / 0.05 
IO::Poll 0.09 / 0.07 
IO::Select 1.22 / 1.21 
IO::Socket::INET6 not installed / 2.67 
IO::Socket::SSL 2.049 / 2.020 
Image::OCR::Tesseract / 1.22 
LWP::Simple 6.26 / 6.13 
MIME::Types 2.09 / 2.11 
Mail::DKIM::Verifier 0.4 / 0.38 
Mail::SPF 2.009 / 2.009 
Mail::SPF::Query disabled by Module Setup / 1.999001 
Mail::SRS disabled by Module Setup / 0.31 
Net::CIDR::Lite 0.21 / 0.21 
Net::DNS 1.11 / 1.06 
Net::IP 1.57 / 1.56 
Net::LDAP 0.64 / 0.65 
Net::SMTP 3.10 / 3.07 
Net::SMTP::SSL 1.02 / 1.01 
Net::SSLeay 1.81 / 1.72 
NetAddr::IP::Lite 1.57 / 1.56 
NetSNMP::agent disabled by Module Setup / 5.05 
OpenSSL 1.0.1t 1.0.1t / 0.9.8 
OpenSSL-lib 1.0.1t 3 May 2016 1.0.1t / 1.0.1h 
PDF::OCR / 1.11 
PDF::OCR2 / 1.20 
PerlIO::scalar 0.18_01 / 0.14_01 
Plugins::ASSP_AFC 4.55 / 4.55 
Plugins::ASSP_ARC 2.05 / 2.05 
Plugins::ASSP_DCC 2.01 / 2.01 
Plugins::ASSP_FakeMX 1.02 / 1.02 
Plugins::ASSP_OCR 2.22 / 2.22 
Plugins::ASSP_Razor 1.09 / 1.09 
Regexp::Optimizer 0.23 / 0.23 
Schedule::Cron 1.01 / 1.01 
Sys::CpuAffinity 1.12 / 1.06 
Sys::MemInfo 0.99 / 0.91 
Sys::Syslog 0.33 / 0.25 
Text::Unidecode 1.30 / 1.27 
Thread::Queue 3.12 / 3.07 
Thread::Semaphore 2.12 / 2.11 
Thread::State 0.09 / 0.09 
Tie::RDBM 0.73 / 0.73 
Time::HiRes 1.9726 / 1.9726 
Unicode::GCString 2013.10 / 2013.10 
threads 2.16 / 2.02 
threads::shared 1.57 / 1.48 
===

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test