fixes in assp 2.5.6 build 17060

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

fixes in assp 2.5.6 build 17060

Thomas Eckardt/eck
Hi all,

fixed in assp 2.5.6 build 17060:

- ASSP_AFC v4.46 fixes a problem where mail above 'npSize' were not processed by the plugin

- the description of 'UserAttach' in relation to the level definitions was wrong
...   This feature replaces all of the above level definitions, if at least one valid
      (not zip:... from the ASSP_AFC Plugin) attachment blocking or allow rule is found for the sender or
      recipient of a mail!.....

- the PTR and MX record check returned 'OK' if a non authoritive DNS-Server answer has set the 'SERVFAIL'
  error flag in case a record was not found. The checks fail now if this happens.
 

added:

'DoReversedSPFOK','Do Reversed Lookup for SPF passed Mails'
'Do reversed lookup also for mails that have passed the SPF check. Default is unchecked.
Which means, that the PTR check will be skipped, if the mail has passed the SPF check'


Thomas


DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|

Memory Leak? in 2.5.6(17013)

Robert K Coffman Jr. -Info From Data Corp.
I'm having this issue show up in the ASSP maillog:

Mar-02-17 04:12:33 [Worker_10000] SSLfailedCache: cleaning cache
finished: IP's before=8, deleted=0
Mar-02-17 04:12:33 [Worker_10000] RFC822dom: cleaning cache finished:
domains's before=1, deleted=0
Mar-02-17 04:12:43 [Worker_10000] Info: saving Stats in file asspstats.sav
Mar-02-17 04:12:43 [Worker_10000] Info: saving ScoreStats in file
asspscorestats.sav
Mar-02-17 04:12:43 [Worker_10000] Info: saving internal Caches in to
folder /usr/share/assp/tmpDB/files
Mar-02-17 04:13:18 [Worker_1] 190.40.102.101 info: authentication -
login is used
Mar-02-17 04:13:18 [Worker_1] 190.40.102.101 [SMTP Error] 503 5.5.1
Error: authentication not enabled
Mar-02-17 04:13:42 [Worker_5] Warning: Worker_5 - check the database
connections has taken 6.043 seconds (max=1.000s)
Mar-02-17 04:13:42 [Worker_4] Warning: Worker_4 - check the database
connections has taken 6.043 seconds (max=1.000s)
Mar-02-17 04:14:08 [Main_Thread] Warning: Main_Thread - check the
database connections has taken 4.311 seconds (max=1.000s)
Mar-02-17 04:14:08 [Worker_3] Warning: Worker_3 - check the database
connections has taken 4.711 seconds (max=1.000s)

Then nothing logged for almost an hour, before my restart script notices
ASSP isn't running and restarts it (it checks every 5 minutes):

Mar-02-17 05:05:41 [startup] Info: lib/CorrectASSPcfg.pm loaded




And I see this in kern.log, ASSP using 2.3GB:

Mar  2 05:05:20 spam02 kernel: [68825.050861] Out of memory: Kill
process 2071 (perl) score 497 or sacrifice child
Mar  2 05:05:20 spam02 kernel: [68825.051024] Killed process 2071 (perl)
total-vm:2315228kB, anon-rss:848272kB, file-rss:0kB

Not sure how to start finding this problem.

- Bob Coffman


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|

Re: Memory Leak? in 2.5.6(17013)

Robert K Coffman Jr. -Info From Data Corp.
Nobody can even hazard a guess?

On 3/2/2017 1:58 PM, Robert K Coffman Jr. -Info From Data Corp. wrote:

> I'm having this issue show up in the ASSP maillog:
>
> Mar-02-17 04:12:33 [Worker_10000] SSLfailedCache: cleaning cache
> finished: IP's before=8, deleted=0
> Mar-02-17 04:12:33 [Worker_10000] RFC822dom: cleaning cache finished:
> domains's before=1, deleted=0
> Mar-02-17 04:12:43 [Worker_10000] Info: saving Stats in file asspstats.sav
> Mar-02-17 04:12:43 [Worker_10000] Info: saving ScoreStats in file
> asspscorestats.sav
> Mar-02-17 04:12:43 [Worker_10000] Info: saving internal Caches in to
> folder /usr/share/assp/tmpDB/files
> Mar-02-17 04:13:18 [Worker_1] 190.40.102.101 info: authentication -
> login is used
> Mar-02-17 04:13:18 [Worker_1] 190.40.102.101 [SMTP Error] 503 5.5.1
> Error: authentication not enabled
> Mar-02-17 04:13:42 [Worker_5] Warning: Worker_5 - check the database
> connections has taken 6.043 seconds (max=1.000s)
> Mar-02-17 04:13:42 [Worker_4] Warning: Worker_4 - check the database
> connections has taken 6.043 seconds (max=1.000s)
> Mar-02-17 04:14:08 [Main_Thread] Warning: Main_Thread - check the
> database connections has taken 4.311 seconds (max=1.000s)
> Mar-02-17 04:14:08 [Worker_3] Warning: Worker_3 - check the database
> connections has taken 4.711 seconds (max=1.000s)
>
> Then nothing logged for almost an hour, before my restart script notices
> ASSP isn't running and restarts it (it checks every 5 minutes):
>
> Mar-02-17 05:05:41 [startup] Info: lib/CorrectASSPcfg.pm loaded
>
>
>
>
> And I see this in kern.log, ASSP using 2.3GB:
>
> Mar  2 05:05:20 spam02 kernel: [68825.050861] Out of memory: Kill
> process 2071 (perl) score 497 or sacrifice child
> Mar  2 05:05:20 spam02 kernel: [68825.051024] Killed process 2071 (perl)
> total-vm:2315228kB, anon-rss:848272kB, file-rss:0kB
>
> Not sure how to start finding this problem.
>
> - Bob Coffman
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
> _______________________________________________
> Assp-test mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/assp-test
>
>


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|

Re: Memory Leak? in 2.5.6(17013)

Colin Waring
Each of my running ASSP instances uses approx. 4GB Ram and then I have nearly 8GB being used by the system for filesystem caching plus some for tmpDB.

I haven't checked but I suspect it uses more when rebuildspamdb is running.

My suspicion is that 2GB just isn't enough because ASSP has a lot of work to do.

You need to do a couple of things.

1) monitor your normal level of memory usage
2) Find out what is happening when the OOM killer kicks in. It sounds to me like this is being triggered either by the restart script or when ASSP is attempting to start up, maybe it is using more memory at startup and takes a couple of goes to come in under the limit?
3) Set up better monitoring so you can look at the system in that hour period before the script kicks in.

You can't find out what ASSP was doing after the fact if it didn't log. I'd suggest turning debugging up, but you'll need more resources to handle that. I often do an strace on a process to look at what it is doing but you'll need to understand how to do that for it to be of any use.

All the best,
Colin.

-----Original Message-----
From: Robert K Coffman Jr. -Info From Data Corp. [mailto:[hidden email]]
Sent: 06 March 2017 13:38
To: [hidden email]
Subject: Re: [Assp-test] Memory Leak? in 2.5.6(17013)

Nobody can even hazard a guess?

On 3/2/2017 1:58 PM, Robert K Coffman Jr. -Info From Data Corp. wrote:

> I'm having this issue show up in the ASSP maillog:
>
> Mar-02-17 04:12:33 [Worker_10000] SSLfailedCache: cleaning cache
> finished: IP's before=8, deleted=0
> Mar-02-17 04:12:33 [Worker_10000] RFC822dom: cleaning cache finished:
> domains's before=1, deleted=0
> Mar-02-17 04:12:43 [Worker_10000] Info: saving Stats in file
> asspstats.sav
> Mar-02-17 04:12:43 [Worker_10000] Info: saving ScoreStats in file
> asspscorestats.sav
> Mar-02-17 04:12:43 [Worker_10000] Info: saving internal Caches in to
> folder /usr/share/assp/tmpDB/files
> Mar-02-17 04:13:18 [Worker_1] 190.40.102.101 info: authentication -
> login is used
> Mar-02-17 04:13:18 [Worker_1] 190.40.102.101 [SMTP Error] 503 5.5.1
> Error: authentication not enabled
> Mar-02-17 04:13:42 [Worker_5] Warning: Worker_5 - check the database
> connections has taken 6.043 seconds (max=1.000s)
> Mar-02-17 04:13:42 [Worker_4] Warning: Worker_4 - check the database
> connections has taken 6.043 seconds (max=1.000s)
> Mar-02-17 04:14:08 [Main_Thread] Warning: Main_Thread - check the
> database connections has taken 4.311 seconds (max=1.000s)
> Mar-02-17 04:14:08 [Worker_3] Warning: Worker_3 - check the database
> connections has taken 4.711 seconds (max=1.000s)
>
> Then nothing logged for almost an hour, before my restart script
> notices ASSP isn't running and restarts it (it checks every 5 minutes):
>
> Mar-02-17 05:05:41 [startup] Info: lib/CorrectASSPcfg.pm loaded
>
>
>
>
> And I see this in kern.log, ASSP using 2.3GB:
>
> Mar  2 05:05:20 spam02 kernel: [68825.050861] Out of memory: Kill
> process 2071 (perl) score 497 or sacrifice child Mar  2 05:05:20
> spam02 kernel: [68825.051024] Killed process 2071 (perl)
> total-vm:2315228kB, anon-rss:848272kB, file-rss:0kB
>
> Not sure how to start finding this problem.
>
> - Bob Coffman
>
>
> ----------------------------------------------------------------------
> -------- Check out the vibrant tech community on one of the world's
> most engaging tech sites, SlashDot.org! http://sdm.link/slashdot 
> _______________________________________________
> Assp-test mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/assp-test
>
>


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot _______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test



------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|

Re: Memory Leak? in 2.5.6(17013)

Robert K Coffman Jr. -Info From Data Corp.
> My suspicion is that 2GB just isn't enough because ASSP has a lot of work to do.

Thanks Colin, I will look into your suggestions.

I bumped the RAM on the ASSP server slightly, and I have not had a
repeat.  I agree with your line above - I suspect the RAM requirements
of my ASSP process have been increasing and I haven't paid attention to
it.  The VM I have this hosted on is lightly used (ASSP is the biggest
resource consumer) but I don't have a lot of RAM to give that box.  I
think it is time for an upgrade.

- Bob




------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test