ASSP keeps losing network connections

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

ASSP keeps losing network connections

James Brown
I mentioned this a while ago, and even after upgrading to 16280 the problem still exists.

Running Perl 5.018002

Can anyone help me? I’m getting desperate as I can’t work out what is causing the problem. Everything else on the box (Postfix, Dovecot, etc) continues to run fine when ASSP has the connection issue.

Thanks in advance,

James.

Original post:

I have an annoying problem. I think it started after upgrading to 16236, but can’t be sure. ASSP runs fine for a few days, then can’t connect to anything. For example it can’t connect to ClamAV, the SMTP destination or any of the DNS that I have set.

Log looks like this:

Sep-05-16 11:06:01 [Worker_1] ClamAV Up
Sep-05-16 11:06:01 id-37560-20112 [Worker_1] 192.168.1.2 [OIP: 12.130.153.159] <[hidden email]> to: [hidden email] ClamAV: scanned 49122 bytes in file /Applications/assp/spam/55_4K_Smart_TV_with_Chromecast_Only_789--83789.eml -  
Sep-05-16 11:06:01 [Worker_1] ClamAV Temporary Off : Cannot connect to 'localhost:1937': IO::Socket::INET: connect: timeout
Sep-05-16 11:06:12 [Worker_1] *** 127.0.0.1:10026 didn't work, trying others...
Sep-05-16 11:06:12 [Worker_1] Error: couldn't create server socket to 127.0.0.1:10026 -- aborting connection
Sep-05-16 11:06:12 [Worker_1] *** 127.0.0.1:10026 didn't work, trying others...
Sep-05-16 11:06:51 [Main_Thread] Admin connection from user root on host ::1:55453; page:/shutdown;
Sep-05-16 11:07:00 [Worker_1] *** 127.0.0.1:10026 didn't work, trying others...
Error: couldn't create server socket to 127.0.0.1:10026 -- aborting connection (suppressed 3 concurrent equal 'Error' loglines from all Workers)
Sep-05-16 11:07:03 [Worker_10000] Warning: Name Server mynameserverlocalIP: does not respond or timed out
Sep-05-16 11:07:03 [Worker_10000] Warning: Name Server 208.67.222.222: does not respond or timed out
Sep-05-16 11:07:03 [Worker_10000] ERROR: !!!! no answering DNS-SERVER found !!!!
Sep-05-16 11:07:06 [Worker_10000] DMARCpol: searching for DMARC-agregate-reports to generate in 9 stored DMARC policy records
Sep-05-16 11:07:06 [Worker_10000] Info: saving Stats in file asspstats.sav
Sep-05-16 11:07:06 [Worker_10000] Info: saving ScoreStats in file asspscorestats.sav
Sep-05-16 11:07:07 [Worker_10000] Info: looking for files to (re)send
Sep-05-16 11:07:07 [Worker_10000] (re)send - try to open: /Applications/assp/resendmail/dmarc_a1473037324.51500607.eml
Sep-05-16 11:07:07 [Worker_10000] (re)send - process: /Applications/assp/resendmail/dmarc_a1473037324.51500607.eml (try 1
Sep-05-16 11:07:07 [Worker_10000] (re)send - /Applications/assp/resendmail/dmarc_a1473037324.51500607.eml - From: [hidden email] - To: [hidden email]
Sep-05-16 11:07:07 [Worker_10000] (re)send /Applications/assp/resendmail/dmarc_a1473037324.51500607.eml to host: 127.0.0.1:10026 (smtpDestination)
Sep-05-16 11:07:07 [Worker_10000] Couldn't connect to 127.0.0.1:10026 using 'Net::SMTP'
Sep-05-16 11:07:07 [Worker_10000] *** send to 127.0.0.1:10026 (smtpDestination) didn't work, trying others…

Restarting ASSP (from the GUI) gets it to work again.

ASSP version 2.5.2(16236)

IO::Socket::INET is version 2.72

Any ideas?

Thanks,

James.


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|

Re: ASSP keeps losing network connections

Thomas Eckardt/eck
Seems that assp/perl is unable to establish any new outgoing connection
using TCP or UDP.
Possibly any OS limit is reached.

Thomas






Von:    James Brown <[hidden email]>
An:     ASSP development mailing list <[hidden email]>
Datum:  07.10.2016 07:33
Betreff:        [Assp-test] ASSP keeps losing network connections



I mentioned this a while ago, and even after upgrading to 16280 the
problem still exists.

Running Perl 5.018002

Can anyone help me? I’m getting desperate as I can’t work out what is
causing the problem. Everything else on the box (Postfix, Dovecot, etc)
continues to run fine when ASSP has the connection issue.

Thanks in advance,

James.

Original post:

I have an annoying problem. I think it started after upgrading to 16236,
but can’t be sure. ASSP runs fine for a few days, then can’t connect to
anything. For example it can’t connect to ClamAV, the SMTP destination or
any of the DNS that I have set.

Log looks like this:

Sep-05-16 11:06:01 [Worker_1] ClamAV Up
Sep-05-16 11:06:01 id-37560-20112 [Worker_1] 192.168.1.2 [OIP:
12.130.153.159] <[hidden email]> to: [hidden email] ClamAV:
scanned 49122 bytes in file
/Applications/assp/spam/55_4K_Smart_TV_with_Chromecast_Only_789--83789.eml
-
Sep-05-16 11:06:01 [Worker_1] ClamAV Temporary Off : Cannot connect to
'localhost:1937': IO::Socket::INET: connect: timeout
Sep-05-16 11:06:12 [Worker_1] *** 127.0.0.1:10026 didn't work, trying
others...
Sep-05-16 11:06:12 [Worker_1] Error: couldn't create server socket to
127.0.0.1:10026 -- aborting connection
Sep-05-16 11:06:12 [Worker_1] *** 127.0.0.1:10026 didn't work, trying
others...
Sep-05-16 11:06:51 [Main_Thread] Admin connection from user root on host
::1:55453; page:/shutdown;
Sep-05-16 11:07:00 [Worker_1] *** 127.0.0.1:10026 didn't work, trying
others...
Error: couldn't create server socket to 127.0.0.1:10026 -- aborting
connection (suppressed 3 concurrent equal 'Error' loglines from all
Workers)
Sep-05-16 11:07:03 [Worker_10000] Warning: Name Server
mynameserverlocalIP: does not respond or timed out
Sep-05-16 11:07:03 [Worker_10000] Warning: Name Server 208.67.222.222:
does not respond or timed out
Sep-05-16 11:07:03 [Worker_10000] ERROR: !!!! no answering DNS-SERVER
found !!!!
Sep-05-16 11:07:06 [Worker_10000] DMARCpol: searching for
DMARC-agregate-reports to generate in 9 stored DMARC policy records
Sep-05-16 11:07:06 [Worker_10000] Info: saving Stats in file asspstats.sav
Sep-05-16 11:07:06 [Worker_10000] Info: saving ScoreStats in file
asspscorestats.sav
Sep-05-16 11:07:07 [Worker_10000] Info: looking for files to (re)send
Sep-05-16 11:07:07 [Worker_10000] (re)send - try to open:
/Applications/assp/resendmail/dmarc_a1473037324.51500607.eml
Sep-05-16 11:07:07 [Worker_10000] (re)send - process:
/Applications/assp/resendmail/dmarc_a1473037324.51500607.eml (try 1
Sep-05-16 11:07:07 [Worker_10000] (re)send -
/Applications/assp/resendmail/dmarc_a1473037324.51500607.eml - From:
[hidden email] - To: [hidden email]
Sep-05-16 11:07:07 [Worker_10000] (re)send
/Applications/assp/resendmail/dmarc_a1473037324.51500607.eml to host:
127.0.0.1:10026 (smtpDestination)
Sep-05-16 11:07:07 [Worker_10000] Couldn't connect to 127.0.0.1:10026
using 'Net::SMTP'
Sep-05-16 11:07:07 [Worker_10000] *** send to 127.0.0.1:10026
(smtpDestination) didn't work, trying others…

Restarting ASSP (from the GUI) gets it to work again.

ASSP version 2.5.2(16236)

IO::Socket::INET is version 2.72

Any ideas?

Thanks,

James.


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally
privileged and protected in law and are intended solely for the use of the

individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no
known virus in this email!
*******************************************************



------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|

Re: ASSP keeps losing network connections

Colin
Hi James,

You said IO::Socket::INET is 2.72 - are you sure this isn't
IO::Socket::INET6? The current IO::Socket::INET for me is 1.35

You've an admin connection opening during those logs indicating that in
fact ASSP is not completely losing its network connection. Can you confirm
this? Are you just losing IPV4?

Sep-05-16 11:06:51 [Main_Thread] Admin connection from user root on host
::1:55453; page:/shutdown;

I'm not sure if you previously posted OS version and whether you're using
OS bundled perl or something you've installed yourself. For Linux I'd say
make sure you've run mod_inst.pl recently and also updated perl modules. I
find the following gets some pre-requisites installed and avoids having to
re-run things:

cpan -i "YAML" "LWP" "CPAN" "App::cpanoutdated" "Test::Pod"
"Test::Pod::Coverage" "Email::Outlook::Message" "DateTime"
"Module::Signature" "File::PathInfo::Ext" "Crypt::CBC" "Crypt::DES"
"Crypt::Rijndael" "Net::SNMP" "NetSNMP::agent" "PDF::OCR2" "NetSNMP::agent"
"Date::Manip::Obj" "Date::Manip::TZ_Base" "Mail::SPF::Test"
"Pod::Text::Termcap"
ctrl+d/su-
perl -MCPAN -e shell
o conf prerequisites_policy follow
o conf commit
upgrade
quit

I also have cpanoutdated and cpanm and they tend to do 2-3 modules that
cpan doesn't:

cpan-outdated -p|cpanm

Then for current mod_inst.pl:

wget http://assp.cvs.sourceforge.net/viewvc/assp/assp2/mod_inst.pl.1.85.zip
unzip mod_inst.pl.1.85.zip
perl mod_inst.pl

I find on Ubuntu I have to answer yes to external tests otherwise the build
process of one of the ssl modules dies.

If all underlying OS and dependant software packages are up to date as well
as Perl and the modules I would start looking back further in the logs to
see what happened immediately before. The only thing I can see from the
snippet you posted is clam scanning so as well as checking OS logs check
the clam logs.

Other questions - do other things on the server carry on working fine? Does
restarting ASSP fix it or do you have to restart the whole server?



On Fri, Oct 7, 2016 at 9:07 AM, Thomas Eckardt <[hidden email]>
wrote:

> Seems that assp/perl is unable to establish any new outgoing connection
> using TCP or UDP.
> Possibly any OS limit is reached.
>
> Thomas
>
>
>
>
>
>
> Von:    James Brown <[hidden email]>
> An:     ASSP development mailing list <[hidden email]>
> Datum:  07.10.2016 07:33
> Betreff:        [Assp-test] ASSP keeps losing network connections
>
>
>
> I mentioned this a while ago, and even after upgrading to 16280 the
> problem still exists.
>
> Running Perl 5.018002
>
> Can anyone help me? I’m getting desperate as I can’t work out what is
> causing the problem. Everything else on the box (Postfix, Dovecot, etc)
> continues to run fine when ASSP has the connection issue.
>
> Thanks in advance,
>
> James.
>
> Original post:
>
> I have an annoying problem. I think it started after upgrading to 16236,
> but can’t be sure. ASSP runs fine for a few days, then can’t connect to
> anything. For example it can’t connect to ClamAV, the SMTP destination or
> any of the DNS that I have set.
>
> Log looks like this:
>
> Sep-05-16 11:06:01 [Worker_1] ClamAV Up
> Sep-05-16 11:06:01 id-37560-20112 [Worker_1] 192.168.1.2 [OIP:
> 12.130.153.159] <[hidden email]> to: [hidden email] ClamAV:
> scanned 49122 bytes in file
> /Applications/assp/spam/55_4K_Smart_TV_with_Chromecast_Only_789--83789.eml
> -
> Sep-05-16 11:06:01 [Worker_1] ClamAV Temporary Off : Cannot connect to
> 'localhost:1937': IO::Socket::INET: connect: timeout
> Sep-05-16 11:06:12 [Worker_1] *** 127.0.0.1:10026 didn't work, trying
> others...
> Sep-05-16 11:06:12 [Worker_1] Error: couldn't create server socket to
> 127.0.0.1:10026 -- aborting connection
> Sep-05-16 11:06:12 [Worker_1] *** 127.0.0.1:10026 didn't work, trying
> others...
> Sep-05-16 11:06:51 [Main_Thread] Admin connection from user root on host
> ::1:55453; page:/shutdown;
> Sep-05-16 11:07:00 [Worker_1] *** 127.0.0.1:10026 didn't work, trying
> others...
> Error: couldn't create server socket to 127.0.0.1:10026 -- aborting
> connection (suppressed 3 concurrent equal 'Error' loglines from all
> Workers)
> Sep-05-16 11:07:03 [Worker_10000] Warning: Name Server
> mynameserverlocalIP: does not respond or timed out
> Sep-05-16 11:07:03 [Worker_10000] Warning: Name Server 208.67.222.222:
> does not respond or timed out
> Sep-05-16 11:07:03 [Worker_10000] ERROR: !!!! no answering DNS-SERVER
> found !!!!
> Sep-05-16 11:07:06 [Worker_10000] DMARCpol: searching for
> DMARC-agregate-reports to generate in 9 stored DMARC policy records
> Sep-05-16 11:07:06 [Worker_10000] Info: saving Stats in file asspstats.sav
> Sep-05-16 11:07:06 [Worker_10000] Info: saving ScoreStats in file
> asspscorestats.sav
> Sep-05-16 11:07:07 [Worker_10000] Info: looking for files to (re)send
> Sep-05-16 11:07:07 [Worker_10000] (re)send - try to open:
> /Applications/assp/resendmail/dmarc_a1473037324.51500607.eml
> Sep-05-16 11:07:07 [Worker_10000] (re)send - process:
> /Applications/assp/resendmail/dmarc_a1473037324.51500607.eml (try 1
> Sep-05-16 11:07:07 [Worker_10000] (re)send -
> /Applications/assp/resendmail/dmarc_a1473037324.51500607.eml - From:
> [hidden email] - To: [hidden email]
> Sep-05-16 11:07:07 [Worker_10000] (re)send
> /Applications/assp/resendmail/dmarc_a1473037324.51500607.eml to host:
> 127.0.0.1:10026 (smtpDestination)
> Sep-05-16 11:07:07 [Worker_10000] Couldn't connect to 127.0.0.1:10026
> using 'Net::SMTP'
> Sep-05-16 11:07:07 [Worker_10000] *** send to 127.0.0.1:10026
> (smtpDestination) didn't work, trying others…
>
> Restarting ASSP (from the GUI) gets it to work again.
>
> ASSP version 2.5.2(16236)
>
> IO::Socket::INET is version 2.72
>
> Any ideas?
>
> Thanks,
>
> James.
>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
> _______________________________________________
> Assp-test mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/assp-test
>
>
>
>
> DISCLAIMER:
> *******************************************************
> This email and any files transmitted with it may be confidential, legally
> privileged and protected in law and are intended solely for the use of the
>
> individual to whom it is addressed.
> This email was multiple times scanned for viruses. There should be no
> known virus in this email!
> *******************************************************
>
>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
> _______________________________________________
> Assp-test mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/assp-test
>
>

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|

Re: ASSP keeps losing network connections

James Brown
Hi Colin & Thomas.

Thanks for your replies.

Sorry, IO::Select is version 1.21, IO::Socket::INET6 is 2.72.
IO::Socket::INET isn’t listed in the Perl Modules section of the GUI’s Info and Stats page.

OS is Mac OS X 10.7.5

Only use iPv4 normally. Usually I can restart ASSP from the GUI, but sometimes I have to kill Perl.

Everything else seems to work fine. Dovecot keeps handling new IMAP connections, FreshClam can download new virus definitions, etc.

System log does show any non-ASSP errors.

One thing I have just noticed in the Info & Stats page, it has CPU Usage over the last 384 days as 97.79% average, but for the last five hours it has only been 0.44% average. Those 5 hours are after-hours times though, but I’m surprised at the scale of the difference. But that’s unrelated I’d assume.

Looks like I have a few different versions of Perl on my system:

/usr/bin/perl
/usr/bin/perl5.10
/usr/bin/perl5.12
/usr/local/bin/perl
/usr/local/bin/perl5.18.2

/usr/local/bin/perl -v
This is perl 5, version 18, subversion 2 (v5.18.2) built for darwin-thread-multi-ld-2level

which is same as /usr/bin/perl

Should I run mod_inst.pl?

Re limits, I’ve increased them way above the defaults for Mac OS X, as otherwise I get resource unavailable errors. Current limits are:

sudo launchctl limit

        cpu         unlimited      unlimited      
        filesize    unlimited      unlimited      
        data        unlimited      unlimited      
        stack       8388608        67104768      
        core        0              unlimited      
        rss         unlimited      unlimited      
        memlock     unlimited      unlimited      
        maxproc     1064           1064          
        maxfiles    65536          65536

and as far as I can tell never hit these limits.

All I have to do is restart ASSP - never have to restart the whole server.

Thanks again for your help,

James.

> On 7 Oct. 2016, at 7:59 pm, cw <[hidden email]> wrote:
>
> Hi James,
>
> You said IO::Socket::INET is 2.72 - are you sure this isn't
> IO::Socket::INET6? The current IO::Socket::INET for me is 1.35
>
> You've an admin connection opening during those logs indicating that in
> fact ASSP is not completely losing its network connection. Can you confirm
> this? Are you just losing IPV4?
>
> Sep-05-16 11:06:51 [Main_Thread] Admin connection from user root on host
> ::1:55453; page:/shutdown;
>
> I'm not sure if you previously posted OS version and whether you're using
> OS bundled perl or something you've installed yourself. For Linux I'd say
> make sure you've run mod_inst.pl recently and also updated perl modules. I
> find the following gets some pre-requisites installed and avoids having to
> re-run things:
>
> cpan -i "YAML" "LWP" "CPAN" "App::cpanoutdated" "Test::Pod"
> "Test::Pod::Coverage" "Email::Outlook::Message" "DateTime"
> "Module::Signature" "File::PathInfo::Ext" "Crypt::CBC" "Crypt::DES"
> "Crypt::Rijndael" "Net::SNMP" "NetSNMP::agent" "PDF::OCR2" "NetSNMP::agent"
> "Date::Manip::Obj" "Date::Manip::TZ_Base" "Mail::SPF::Test"
> "Pod::Text::Termcap"
> ctrl+d/su-
> perl -MCPAN -e shell
> o conf prerequisites_policy follow
> o conf commit
> upgrade
> quit
>
> I also have cpanoutdated and cpanm and they tend to do 2-3 modules that
> cpan doesn't:
>
> cpan-outdated -p|cpanm
>
> Then for current mod_inst.pl:
>
> wget http://assp.cvs.sourceforge.net/viewvc/assp/assp2/mod_inst.pl.1.85.zip
> unzip mod_inst.pl.1.85.zip
> perl mod_inst.pl
>
> I find on Ubuntu I have to answer yes to external tests otherwise the build
> process of one of the ssl modules dies.
>
> If all underlying OS and dependant software packages are up to date as well
> as Perl and the modules I would start looking back further in the logs to
> see what happened immediately before. The only thing I can see from the
> snippet you posted is clam scanning so as well as checking OS logs check
> the clam logs.
>
> Other questions - do other things on the server carry on working fine? Does
> restarting ASSP fix it or do you have to restart the whole server?
>
>
>
> On Fri, Oct 7, 2016 at 9:07 AM, Thomas Eckardt <[hidden email]>
> wrote:
>
>> Seems that assp/perl is unable to establish any new outgoing connection
>> using TCP or UDP.
>> Possibly any OS limit is reached.
>>
>> Thomas
>>
>>
>>
>>
>>
>>
>> Von:    James Brown <[hidden email]>
>> An:     ASSP development mailing list <[hidden email]>
>> Datum:  07.10.2016 07:33
>> Betreff:        [Assp-test] ASSP keeps losing network connections
>>
>>
>>
>> I mentioned this a while ago, and even after upgrading to 16280 the
>> problem still exists.
>>
>> Running Perl 5.018002
>>
>> Can anyone help me? I’m getting desperate as I can’t work out what is
>> causing the problem. Everything else on the box (Postfix, Dovecot, etc)
>> continues to run fine when ASSP has the connection issue.
>>
>> Thanks in advance,
>>
>> James.
>>
>> Original post:
>>
>> I have an annoying problem. I think it started after upgrading to 16236,
>> but can’t be sure. ASSP runs fine for a few days, then can’t connect to
>> anything. For example it can’t connect to ClamAV, the SMTP destination or
>> any of the DNS that I have set.
>>
>> Log looks like this:
>>
>> Sep-05-16 11:06:01 [Worker_1] ClamAV Up
>> Sep-05-16 11:06:01 id-37560-20112 [Worker_1] 192.168.1.2 [OIP:
>> 12.130.153.159] <[hidden email]> to: [hidden email] ClamAV:
>> scanned 49122 bytes in file
>> /Applications/assp/spam/55_4K_Smart_TV_with_Chromecast_Only_789--83789.eml
>> -
>> Sep-05-16 11:06:01 [Worker_1] ClamAV Temporary Off : Cannot connect to
>> 'localhost:1937': IO::Socket::INET: connect: timeout
>> Sep-05-16 11:06:12 [Worker_1] *** 127.0.0.1:10026 didn't work, trying
>> others...
>> Sep-05-16 11:06:12 [Worker_1] Error: couldn't create server socket to
>> 127.0.0.1:10026 -- aborting connection
>> Sep-05-16 11:06:12 [Worker_1] *** 127.0.0.1:10026 didn't work, trying
>> others...
>> Sep-05-16 11:06:51 [Main_Thread] Admin connection from user root on host
>> ::1:55453; page:/shutdown;
>> Sep-05-16 11:07:00 [Worker_1] *** 127.0.0.1:10026 didn't work, trying
>> others...
>> Error: couldn't create server socket to 127.0.0.1:10026 -- aborting
>> connection (suppressed 3 concurrent equal 'Error' loglines from all
>> Workers)
>> Sep-05-16 11:07:03 [Worker_10000] Warning: Name Server
>> mynameserverlocalIP: does not respond or timed out
>> Sep-05-16 11:07:03 [Worker_10000] Warning: Name Server 208.67.222.222:
>> does not respond or timed out
>> Sep-05-16 11:07:03 [Worker_10000] ERROR: !!!! no answering DNS-SERVER
>> found !!!!
>> Sep-05-16 11:07:06 [Worker_10000] DMARCpol: searching for
>> DMARC-agregate-reports to generate in 9 stored DMARC policy records
>> Sep-05-16 11:07:06 [Worker_10000] Info: saving Stats in file asspstats.sav
>> Sep-05-16 11:07:06 [Worker_10000] Info: saving ScoreStats in file
>> asspscorestats.sav
>> Sep-05-16 11:07:07 [Worker_10000] Info: looking for files to (re)send
>> Sep-05-16 11:07:07 [Worker_10000] (re)send - try to open:
>> /Applications/assp/resendmail/dmarc_a1473037324.51500607.eml
>> Sep-05-16 11:07:07 [Worker_10000] (re)send - process:
>> /Applications/assp/resendmail/dmarc_a1473037324.51500607.eml (try 1
>> Sep-05-16 11:07:07 [Worker_10000] (re)send -
>> /Applications/assp/resendmail/dmarc_a1473037324.51500607.eml - From:
>> [hidden email] - To: [hidden email]
>> Sep-05-16 11:07:07 [Worker_10000] (re)send
>> /Applications/assp/resendmail/dmarc_a1473037324.51500607.eml to host:
>> 127.0.0.1:10026 (smtpDestination)
>> Sep-05-16 11:07:07 [Worker_10000] Couldn't connect to 127.0.0.1:10026
>> using 'Net::SMTP'
>> Sep-05-16 11:07:07 [Worker_10000] *** send to 127.0.0.1:10026
>> (smtpDestination) didn't work, trying others…
>>
>> Restarting ASSP (from the GUI) gets it to work again.
>>
>> ASSP version 2.5.2(16236)
>>
>> IO::Socket::INET is version 2.72
>>
>> Any ideas?
>>
>> Thanks,
>>
>> James.
>>
>>
>> ------------------------------------------------------------
>> ------------------
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
>> _______________________________________________
>> Assp-test mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/assp-test
>>
>>
>>
>>
>> DISCLAIMER:
>> *******************************************************
>> This email and any files transmitted with it may be confidential, legally
>> privileged and protected in law and are intended solely for the use of the
>>
>> individual to whom it is addressed.
>> This email was multiple times scanned for viruses. There should be no
>> known virus in this email!
>> *******************************************************
>>
>>
>>
>> ------------------------------------------------------------
>> ------------------
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
>> _______________________________________________
>> Assp-test mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/assp-test
>>
>>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot_______________________________________________
> Assp-test mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/assp-test



------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|

Re: ASSP keeps losing network connections

Colin Waring
Hi James,

ASSP needs lots of modules installing to run, so if you've never run mod_inst.pl or been through the list of modules and installed them manually it is worth doing it. I don't know enough about MacOS X to say if mod_inst.pl is the best way of managing the modules but if it is run with the same version of perl that ASSP is using I would have thought it would work.

If you're able to access the GUI then that means that it is not losing connection completely. It looks to me like you're accessing the GUI via an IPV6 loopback address so it may be IPV4 that is dying. Alternatively it might just be outbound connections from the process. Does ASSP still log inbound connections to port 25 when it is faulted? They will presumably fail as it can't contact the MTA but if it is seeing them coming in then it might help track down the issue.

Other than that, standard testing applies. Monitor performance, check through all your settings and turn up any necessary logging. Make sure nothing like a firewall, denyhosts or other antivirus is getting in the way.

The high CPU average is definitely a concern, especially over that time period so I'm surprised you've not spotted it before. My normal average is <1% except for the past week where I've had no end of issues - some largely caused by my settings whilst trying to figure out other problems. Thomas pointed out to me that there's no need to set EnableHighPerformance to anything other than off if things are running fine.

If you've been running for a while, make sure all ASSP files are up to date not just the main assp.pl and go through every single one of your settings. Make sure you've a good reason for anything that isn't set to default otherwise change it back. Be aware that the default recommendations may change as new versions come out.

All the best,
Colin Waring.


Colin Waring
Technical Manager
Dolphin ICT Limited
T
+44 (0)151 438 2246 Ext 2003
www.dolphinict.co.uk
[hidden email]
US15a, Armstrong House, First Avenue, Robin Hood Airport, Doncaster, DN9 3GA





Dolphin ICT Limited. NOTICE & DISCLAIMER
Dolphin ICT Limited, a private limited company, with company registration number 6206916,
registered in the United Kingdom, the registered office of which is at US15a, Armstrong House, First Avenue, Robin Hood Airport, Doncaster, DN9 3GA
VAT registration number GB 918 1896 88.



-----Original Message-----
From: James Brown [mailto:[hidden email]]
Sent: 07 October 2016 14:02
To: ASSP development mailing list <[hidden email]>
Subject: Re: [Assp-test] ASSP keeps losing network connections

Hi Colin & Thomas.

Thanks for your replies.

Sorry, IO::Select is version 1.21, IO::Socket::INET6 is 2.72.
IO::Socket::INET isn’t listed in the Perl Modules section of the GUI’s Info and Stats page.

OS is Mac OS X 10.7.5

Only use iPv4 normally. Usually I can restart ASSP from the GUI, but sometimes I have to kill Perl.

Everything else seems to work fine. Dovecot keeps handling new IMAP connections, FreshClam can download new virus definitions, etc.

System log does show any non-ASSP errors.

One thing I have just noticed in the Info & Stats page, it has CPU Usage over the last 384 days as 97.79% average, but for the last five hours it has only been 0.44% average. Those 5 hours are after-hours times though, but I’m surprised at the scale of the difference. But that’s unrelated I’d assume.

Looks like I have a few different versions of Perl on my system:

/usr/bin/perl
/usr/bin/perl5.10
/usr/bin/perl5.12
/usr/local/bin/perl
/usr/local/bin/perl5.18.2

/usr/local/bin/perl -v
This is perl 5, version 18, subversion 2 (v5.18.2) built for darwin-thread-multi-ld-2level

which is same as /usr/bin/perl

Should I run mod_inst.pl?

Re limits, I’ve increased them way above the defaults for Mac OS X, as otherwise I get resource unavailable errors. Current limits are:

sudo launchctl limit

        cpu         unlimited      unlimited      
        filesize    unlimited      unlimited      
        data        unlimited      unlimited      
        stack       8388608        67104768      
        core        0              unlimited      
        rss         unlimited      unlimited      
        memlock     unlimited      unlimited      
        maxproc     1064           1064          
        maxfiles    65536          65536

and as far as I can tell never hit these limits.

All I have to do is restart ASSP - never have to restart the whole server.

Thanks again for your help,

James.

> On 7 Oct. 2016, at 7:59 pm, cw <[hidden email]> wrote:
>
> Hi James,
>
> You said IO::Socket::INET is 2.72 - are you sure this isn't
> IO::Socket::INET6? The current IO::Socket::INET for me is 1.35
>
> You've an admin connection opening during those logs indicating that
> in fact ASSP is not completely losing its network connection. Can you
> confirm this? Are you just losing IPV4?
>
> Sep-05-16 11:06:51 [Main_Thread] Admin connection from user root on
> host ::1:55453; page:/shutdown;
>
> I'm not sure if you previously posted OS version and whether you're
> using OS bundled perl or something you've installed yourself. For
> Linux I'd say make sure you've run mod_inst.pl recently and also
> updated perl modules. I find the following gets some pre-requisites
> installed and avoids having to re-run things:
>
> cpan -i "YAML" "LWP" "CPAN" "App::cpanoutdated" "Test::Pod"
> "Test::Pod::Coverage" "Email::Outlook::Message" "DateTime"
> "Module::Signature" "File::PathInfo::Ext" "Crypt::CBC" "Crypt::DES"
> "Crypt::Rijndael" "Net::SNMP" "NetSNMP::agent" "PDF::OCR2" "NetSNMP::agent"
> "Date::Manip::Obj" "Date::Manip::TZ_Base" "Mail::SPF::Test"
> "Pod::Text::Termcap"
> ctrl+d/su-
> perl -MCPAN -e shell
> o conf prerequisites_policy follow
> o conf commit
> upgrade
> quit
>
> I also have cpanoutdated and cpanm and they tend to do 2-3 modules
> that cpan doesn't:
>
> cpan-outdated -p|cpanm
>
> Then for current mod_inst.pl:
>
> wget
> http://assp.cvs.sourceforge.net/viewvc/assp/assp2/mod_inst.pl.1.85.zip
> unzip mod_inst.pl.1.85.zip
> perl mod_inst.pl
>
> I find on Ubuntu I have to answer yes to external tests otherwise the
> build process of one of the ssl modules dies.
>
> If all underlying OS and dependant software packages are up to date as
> well as Perl and the modules I would start looking back further in the
> logs to see what happened immediately before. The only thing I can see
> from the snippet you posted is clam scanning so as well as checking OS
> logs check the clam logs.
>
> Other questions - do other things on the server carry on working fine?
> Does restarting ASSP fix it or do you have to restart the whole server?
>
>
>
> On Fri, Oct 7, 2016 at 9:07 AM, Thomas Eckardt
> <[hidden email]>
> wrote:
>
>> Seems that assp/perl is unable to establish any new outgoing
>> connection using TCP or UDP.
>> Possibly any OS limit is reached.
>>
>> Thomas
>>
>>
>>
>>
>>
>>
>> Von:    James Brown <[hidden email]>
>> An:     ASSP development mailing list <[hidden email]>
>> Datum:  07.10.2016 07:33
>> Betreff:        [Assp-test] ASSP keeps losing network connections
>>
>>
>>
>> I mentioned this a while ago, and even after upgrading to 16280 the
>> problem still exists.
>>
>> Running Perl 5.018002
>>
>> Can anyone help me? I’m getting desperate as I can’t work out what is
>> causing the problem. Everything else on the box (Postfix, Dovecot,
>> etc) continues to run fine when ASSP has the connection issue.
>>
>> Thanks in advance,
>>
>> James.
>>
>> Original post:
>>
>> I have an annoying problem. I think it started after upgrading to
>> 16236, but can’t be sure. ASSP runs fine for a few days, then can’t
>> connect to anything. For example it can’t connect to ClamAV, the SMTP
>> destination or any of the DNS that I have set.
>>
>> Log looks like this:
>>
>> Sep-05-16 11:06:01 [Worker_1] ClamAV Up
>> Sep-05-16 11:06:01 id-37560-20112 [Worker_1] 192.168.1.2 [OIP:
>> 12.130.153.159] <[hidden email]> to: [hidden email] ClamAV:
>> scanned 49122 bytes in file
>> /Applications/assp/spam/55_4K_Smart_TV_with_Chromecast_Only_789--8378
>> 9.eml
>> -
>> Sep-05-16 11:06:01 [Worker_1] ClamAV Temporary Off : Cannot connect
>> to
>> 'localhost:1937': IO::Socket::INET: connect: timeout
>> Sep-05-16 11:06:12 [Worker_1] *** 127.0.0.1:10026 didn't work, trying
>> others...
>> Sep-05-16 11:06:12 [Worker_1] Error: couldn't create server socket to
>> 127.0.0.1:10026 -- aborting connection
>> Sep-05-16 11:06:12 [Worker_1] *** 127.0.0.1:10026 didn't work, trying
>> others...
>> Sep-05-16 11:06:51 [Main_Thread] Admin connection from user root on
>> host ::1:55453; page:/shutdown;
>> Sep-05-16 11:07:00 [Worker_1] *** 127.0.0.1:10026 didn't work, trying
>> others...
>> Error: couldn't create server socket to 127.0.0.1:10026 -- aborting
>> connection (suppressed 3 concurrent equal 'Error' loglines from all
>> Workers)
>> Sep-05-16 11:07:03 [Worker_10000] Warning: Name Server
>> mynameserverlocalIP: does not respond or timed out
>> Sep-05-16 11:07:03 [Worker_10000] Warning: Name Server 208.67.222.222:
>> does not respond or timed out
>> Sep-05-16 11:07:03 [Worker_10000] ERROR: !!!! no answering DNS-SERVER
>> found !!!!
>> Sep-05-16 11:07:06 [Worker_10000] DMARCpol: searching for
>> DMARC-agregate-reports to generate in 9 stored DMARC policy records
>> Sep-05-16 11:07:06 [Worker_10000] Info: saving Stats in file
>> asspstats.sav
>> Sep-05-16 11:07:06 [Worker_10000] Info: saving ScoreStats in file
>> asspscorestats.sav
>> Sep-05-16 11:07:07 [Worker_10000] Info: looking for files to (re)send
>> Sep-05-16 11:07:07 [Worker_10000] (re)send - try to open:
>> /Applications/assp/resendmail/dmarc_a1473037324.51500607.eml
>> Sep-05-16 11:07:07 [Worker_10000] (re)send - process:
>> /Applications/assp/resendmail/dmarc_a1473037324.51500607.eml (try 1
>> Sep-05-16 11:07:07 [Worker_10000] (re)send -
>> /Applications/assp/resendmail/dmarc_a1473037324.51500607.eml - From:
>> [hidden email] - To: [hidden email]
>> Sep-05-16 11:07:07 [Worker_10000] (re)send
>> /Applications/assp/resendmail/dmarc_a1473037324.51500607.eml to host:
>> 127.0.0.1:10026 (smtpDestination)
>> Sep-05-16 11:07:07 [Worker_10000] Couldn't connect to 127.0.0.1:10026
>> using 'Net::SMTP'
>> Sep-05-16 11:07:07 [Worker_10000] *** send to 127.0.0.1:10026
>> (smtpDestination) didn't work, trying others…
>>
>> Restarting ASSP (from the GUI) gets it to work again.
>>
>> ASSP version 2.5.2(16236)
>>
>> IO::Socket::INET is version 2.72
>>
>> Any ideas?
>>
>> Thanks,
>>
>> James.
>>
>>
>> ------------------------------------------------------------
>> ------------------
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, SlashDot.org! http://sdm.link/slashdot 
>> _______________________________________________
>> Assp-test mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/assp-test
>>
>>
>>
>>
>> DISCLAIMER:
>> *******************************************************
>> This email and any files transmitted with it may be confidential,
>> legally privileged and protected in law and are intended solely for
>> the use of the
>>
>> individual to whom it is addressed.
>> This email was multiple times scanned for viruses. There should be no
>> known virus in this email!
>> *******************************************************
>>
>>
>>
>> ------------------------------------------------------------
>> ------------------
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, SlashDot.org! http://sdm.link/slashdot 
>> _______________________________________________
>> Assp-test mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/assp-test
>>
>>
> ----------------------------------------------------------------------
> -------- Check out the vibrant tech community on one of the world's
> most engaging tech sites, SlashDot.org!
> http://sdm.link/slashdot______________________________________________
> _
> Assp-test mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/assp-test



------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot _______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|

Re: ASSP keeps losing network connections

James Brown

> On 8 Oct. 2016, at 1:55 am, Colin Waring <[hidden email]> wrote:
>
> Hi James,
>
> ASSP needs lots of modules installing to run, so if you've never run mod_inst.pl or been through the list of modules and installed them manually it is worth doing it. I don't know enough about MacOS X to say if mod_inst.pl is the best way of managing the modules but if it is run with the same version of perl that ASSP is using I would have thought it would work.
>
> If you're able to access the GUI then that means that it is not losing connection completely. It looks to me like you're accessing the GUI via an IPV6 loopback address so it may be IPV4 that is dying. Alternatively it might just be outbound connections from the process. Does ASSP still log inbound connections to port 25 when it is faulted? They will presumably fail as it can't contact the MTA but if it is seeing them coming in then it might help track down the issue.
>
> Other than that, standard testing applies. Monitor performance, check through all your settings and turn up any necessary logging. Make sure nothing like a firewall, denyhosts or other antivirus is getting in the way.
>
> The high CPU average is definitely a concern, especially over that time period so I'm surprised you've not spotted it before. My normal average is <1% except for the past week where I've had no end of issues - some largely caused by my settings whilst trying to figure out other problems. Thomas pointed out to me that there's no need to set EnableHighPerformance to anything other than off if things are running fine.
>
> If you've been running for a while, make sure all ASSP files are up to date not just the main assp.pl and go through every single one of your settings. Make sure you've a good reason for anything that isn't set to default otherwise change it back. Be aware that the default recommendations may change as new versions come out.
>
> All the best,
> Colin Waring.
>
>
> Colin Waring
Thanks Colin.

I’ve had it running since Friday evening with no problems.

This morning I notice that it is having problems connecting to ClamAV.

Eg, ASSP log says:

Oct-10-16 10:16:04 id-54963-13162 [Worker_1] [TLS-out] 192.168.1.2 [OIP: 12.130.153.25] <[hidden email]> to: [hidden email] [Plugin] calling plugin ASSP_AFC
Oct-10-16 10:16:04 id-54963-13162 [Worker_1] [TLS-out] 192.168.1.2 [OIP: 12.130.153.25] <[hidden email]> to: [hidden email] <mailto:[hidden email]> ClamAV: scanned 137424 bytes in message -  
Oct-10-16 10:16:04 [Worker_1] Warning: ClamAV Temporary Off : Cannot connect to 'localhost:1864': IO::Socket::INET: connect: timeout

And 5 seconds later I see this in clamd.log:

Mon Oct 10 10:16:09 2016 -> ERROR: ScanStream 1864: accept timeout.

Actually, now it’s started again:

Oct-10-16 10:22:21 id-55340-18830 [Worker_1] [TLS-out] 192.168.1.2 [OIP: 121.200.228.218] <[hidden email]> to: [hidden email] ClamAV: scanned 2 bytes in whitelisted message -  
Oct-10-16 10:22:21 [Worker_1] Warning: ClamAV Temporary Off : Cannot connect to 'localhost:1815': IO::Socket::INET: connect: timeout
Oct-10-16 10:22:21 [Worker_1] ClamAV Up
Oct-10-16 10:22:21 id-55340-18830 [Worker_1] [TLS-out] 192.168.1.2 [OIP: 121.200.228.218] <[hidden email]> to: [hidden email] ClamAV: scanned 719 bytes in whitelisted message -  
Oct-10-16 10:22:21 [Worker_1] Warning: ClamAV Temporary Off : Cannot connect to 'localhost:1220': IO::Socket::INET: connect: timeout
Oct-10-16 10:22:21 [Worker_1] ClamAV Up
Oct-10-16 10:22:21 id-55340-18830 [Worker_1] [TLS-out] 192.168.1.2 [OIP: 121.200.228.218] <[hidden email]> to: [hidden email] ClamAV: scanned 1029 bytes in whitelisted message -  
Oct-10-16 10:22:21 [Worker_1] Warning: ClamAV Temporary Off : Cannot connect to 'localhost:1337': IO::Socket::INET: connect: timeout
Oct-10-16 10:22:21 [Worker_1] ClamAV Up
Oct-10-16 10:22:21 id-55340-18830 [Worker_1] [TLS-out] 192.168.1.2 [OIP: 121.200.228.218] <[hidden email]> to: [hidden email] ClamAV: scanned 18149 bytes in whitelisted message -  
Oct-10-16 10:22:21 [Worker_1] Warning: ClamAV Temporary Off : Cannot connect to 'localhost:1107': IO::Socket::INET: connect: timeout
Oct-10-16 10:22:21 id-55340-18830 [Worker_1] [TLS-out] 192.168.1.2 [OIP: 121.200.228.218] <[hidden email]> to: [hidden email] whitelisted (no bad attachments)
Oct-10-16 10:22:21 id-55340-18830 [Worker_1] [TLS-out] [MessageOK] 192.168.1.2 [OIP: 121.200.228.218] <[hidden email]> to: [hidden email] message ok - (whitelistdb) - [INV REQUEST]
Oct-10-16 10:22:47 [Worker_1] [TLS-out] 127.0.0.1 info: authentication - plain is used
Oct-10-16 10:22:47 [Worker_1] [TLS-out] 127.0.0.1 info: authentication (PLAIN) realms - foruser:, user:[hidden email]
Oct-10-16 10:22:56 [Worker_2] *** 127.0.0.1:10026 didn't work, trying others...
Oct-10-16 10:22:56 [Worker_2] Error: couldn't create server socket to 127.0.0.1:10026 -- aborting connection
Oct-10-16 10:22:56 id-55367-14617 [Worker_1] [TLS-out] 127.0.0.1 <[hidden email]> to: [hidden email] [Plugin] calling plugin ASSP_AFC
Oct-10-16 10:22:56 id-55367-14617 [Worker_1] [TLS-out] 127.0.0.1 <[hidden email]> to: [hidden email] info: 1 attachment found for Level-0
Oct-10-16 10:22:56 id-55367-14617 [Worker_1] [TLS-out] 127.0.0.1 <[hidden email]> to: [hidden email] message proxied without processing (no bad attachments)
Oct-10-16 10:22:56 id-55367-14617 [Worker_1] [TLS-out] [MessageOK] 127.0.0.1 <[hidden email]> to: [hidden email] message ok [Grays tractor services] -> /Applications/assp/notspam/Grays_tractor_services--91742.eml
Oct-10-16 10:23:00 [Worker_3] *** 127.0.0.1:10026 didn't work, trying others...
Oct-10-16 10:23:23 [Worker_10000] Cleaning penalty records...
Oct-10-16 10:23:23 [Worker_10000] PenaltyBox: cleaning BlackBox (PBBlack) finished: IP's before=7, deleted=2
Oct-10-16 10:23:24 [Worker_10000] PenaltyBox: cleaning WhiteBox (PBWhite) finished: IP's before=3691, deleted=19
Oct-10-16 10:23:24 [Worker_10000] PBTrap: cleaning finished: before=17, deleted=4
Oct-10-16 10:23:26 [Worker_2] [TLS-out] 127.0.0.1 info: authentication - plain is used
Oct-10-16 10:23:26 [Worker_2] [TLS-out] 127.0.0.1 info: authentication (PLAIN) realms - foruser:[hidden email], user:[hidden email]
Oct-10-16 10:23:26 id-55406-08594 [Worker_2] [TLS-out] 127.0.0.1 <[hidden email]> to: [hidden email] [Plugin] calling plugin ASSP_AFC
Oct-10-16 10:23:26 id-55406-08594 [Worker_2] [TLS-out] 127.0.0.1 <[hidden email]> to: [hidden email] local (no bad attachments)
Oct-10-16 10:23:26 id-55406-08594 [Worker_2] [TLS-out] [Plugin] 127.0.0.1 <[hidden email]> to: [hidden email] ASSP_OCR: OCR(2.21) (TextFile(text2.cat)) data extracted
Oct-10-16 10:23:26 id-55406-08594 [Worker_2] [TLS-out] [MessageOK] 127.0.0.1 <[hidden email]> to: [hidden email] message ok [Re WorkCover Monthly Reports Bordo International September 2016]
Error: couldn't create server socket to 127.0.0.1:10026 -- aborting connection (suppressed 2 concurrent equal 'Error' loglines from all Workers)
Oct-10-16 10:23:38 [Worker_10000] Warning: Name Server 192.168.1.29: does not respond or timed out
Oct-10-16 10:23:38 [Worker_10000] Warning: Name Server 208.67.222.222: does not respond or timed out
Oct-10-16 10:23:38 [Worker_10000] ERROR: !!!! no answering DNS-SERVER found !!!!
Oct-10-16 10:23:59 [Worker_1] ClamAV Up
Oct-10-16 10:23:59 id-55367-14617 [Worker_1] 127.0.0.1 <[hidden email]> to: [hidden email] ClamAV: scanned 100485 bytes in file /Applications/assp/notspam/Grays_tractor_services--91742.eml -  
Oct-10-16 10:23:59 [Worker_1] Warning: ClamAV Temporary Off : Cannot connect to 'localhost:1155': IO::Socket::INET: connect: timeout
Oct-10-16 10:24:12 [Worker_1] [TLS-out] 127.0.0.1 info: authentication - plain is used
Oct-10-16 10:24:12 [Worker_1] [TLS-out] 127.0.0.1 info: authentication (PLAIN) realms - foruser:[hidden email], user:[hidden email]
Oct-10-16 10:24:15 [Worker_10000] DMARCpol: searching for DMARC-agregate-reports to generate in 16 stored DMARC policy records
Oct-10-16 10:24:16 [Worker_10000] Info: looking for files to (re)send
Oct-10-16 10:24:20 [Worker_1] *** 127.0.0.1:10026 didn't work, trying others...
Oct-10-16 10:24:20 [Worker_1] Error: couldn't create server socket to 127.0.0.1:10026 -- aborting connection
Oct-10-16 10:24:20 [Worker_1] *** 127.0.0.1:10026 didn't work, trying others...
Oct-10-16 10:24:28 [Worker_1] [TLS-out] 192.168.1.51 info: authentication - plain is used
Oct-10-16 10:24:28 [Worker_1] [TLS-out] 192.168.1.51 info: authentication (PLAIN) realms - foruser:[hidden email], user:[hidden email]
Oct-10-16 10:24:28 id-55468-19176 [Worker_1] [TLS-out] 192.168.1.51 <[hidden email]> to: [hidden email] [Plugin] calling plugin ASSP_AFC
Oct-10-16 10:24:28 id-55468-19176 [Worker_1] [TLS-out] 192.168.1.51 <[hidden email]> to: [hidden email] info: 1 attachment found for Level-0
Oct-10-16 10:24:28 id-55468-19176 [Worker_1] [TLS-out] 192.168.1.51 <[hidden email]> to: [hidden email] local (no bad attachments)
Oct-10-16 10:24:28 id-55468-19176 [Worker_1] [TLS-out] [Plugin] 192.168.1.51 <[hidden email]> to: [hidden email] ASSP_OCR: OCR(2.21) (TextFile(text5.cat)) data extracted
Oct-10-16 10:24:28 id-55468-19176 [Worker_1] [TLS-out] [MessageOK] 192.168.1.51 <[hidden email]> to: [hidden email] message ok [Re RFQ]
Error: couldn't create server socket to 127.0.0.1:10026 -- aborting connection (suppressed 2 concurrent equal 'Error' loglines from all Workers)
Oct-10-16 10:24:31 [Worker_10000] Info: saving Stats in file asspstats.sav
Oct-10-16 10:24:31 [Worker_10000] Info: saving ScoreStats in file asspscorestats.sav

I’ll restart ASSP.

James.
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|

Re: ASSP keeps losing network connections

James Brown
Hopefully this fixes my problem:

> fixed in assp 2.5.4 build 16290:
>
> - uncleaned DNS UDP sockets may caused a file descriptor overload in perl.
> This caused assp to become
>  unresponsive for IPv4 on some linux/mac systems. This applies to
> Net::DNS 1.03 and higher.


James.


> On 10 Oct. 2016, at 10:36 am, James Brown <[hidden email]> wrote:
>
>>
>> On 8 Oct. 2016, at 1:55 am, Colin Waring <[hidden email]> wrote:
>>
>> Hi James,
>>
>> ASSP needs lots of modules installing to run, so if you've never run mod_inst.pl or been through the list of modules and installed them manually it is worth doing it. I don't know enough about MacOS X to say if mod_inst.pl is the best way of managing the modules but if it is run with the same version of perl that ASSP is using I would have thought it would work.
>>
>> If you're able to access the GUI then that means that it is not losing connection completely. It looks to me like you're accessing the GUI via an IPV6 loopback address so it may be IPV4 that is dying. Alternatively it might just be outbound connections from the process. Does ASSP still log inbound connections to port 25 when it is faulted? They will presumably fail as it can't contact the MTA but if it is seeing them coming in then it might help track down the issue.
>>
>> Other than that, standard testing applies. Monitor performance, check through all your settings and turn up any necessary logging. Make sure nothing like a firewall, denyhosts or other antivirus is getting in the way.
>>
>> The high CPU average is definitely a concern, especially over that time period so I'm surprised you've not spotted it before. My normal average is <1% except for the past week where I've had no end of issues - some largely caused by my settings whilst trying to figure out other problems. Thomas pointed out to me that there's no need to set EnableHighPerformance to anything other than off if things are running fine.
>>
>> If you've been running for a while, make sure all ASSP files are up to date not just the main assp.pl and go through every single one of your settings. Make sure you've a good reason for anything that isn't set to default otherwise change it back. Be aware that the default recommendations may change as new versions come out.
>>
>> All the best,
>> Colin Waring.
>>
>>
>> Colin Waring
>
> Thanks Colin.
>
> I’ve had it running since Friday evening with no problems.
>
> This morning I notice that it is having problems connecting to ClamAV.
>
> Eg, ASSP log says:
>
> Oct-10-16 10:16:04 id-54963-13162 [Worker_1] [TLS-out] 192.168.1.2 [OIP: 12.130.153.25] <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> [Plugin] calling plugin ASSP_AFC
> Oct-10-16 10:16:04 id-54963-13162 [Worker_1] [TLS-out] 192.168.1.2 [OIP: 12.130.153.25] <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> <mailto:[hidden email] <mailto:[hidden email]>> ClamAV: scanned 137424 bytes in message -  
> Oct-10-16 10:16:04 [Worker_1] Warning: ClamAV Temporary Off : Cannot connect to 'localhost:1864': IO::Socket::INET: connect: timeout
>
> And 5 seconds later I see this in clamd.log:
>
> Mon Oct 10 10:16:09 2016 -> ERROR: ScanStream 1864: accept timeout.
>
> Actually, now it’s started again:
>
> Oct-10-16 10:22:21 id-55340-18830 [Worker_1] [TLS-out] 192.168.1.2 [OIP: 121.200.228.218] <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> ClamAV: scanned 2 bytes in whitelisted message -  
> Oct-10-16 10:22:21 [Worker_1] Warning: ClamAV Temporary Off : Cannot connect to 'localhost:1815': IO::Socket::INET: connect: timeout
> Oct-10-16 10:22:21 [Worker_1] ClamAV Up
> Oct-10-16 10:22:21 id-55340-18830 [Worker_1] [TLS-out] 192.168.1.2 [OIP: 121.200.228.218] <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> ClamAV: scanned 719 bytes in whitelisted message -  
> Oct-10-16 10:22:21 [Worker_1] Warning: ClamAV Temporary Off : Cannot connect to 'localhost:1220': IO::Socket::INET: connect: timeout
> Oct-10-16 10:22:21 [Worker_1] ClamAV Up
> Oct-10-16 10:22:21 id-55340-18830 [Worker_1] [TLS-out] 192.168.1.2 [OIP: 121.200.228.218] <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> ClamAV: scanned 1029 bytes in whitelisted message -  
> Oct-10-16 10:22:21 [Worker_1] Warning: ClamAV Temporary Off : Cannot connect to 'localhost:1337': IO::Socket::INET: connect: timeout
> Oct-10-16 10:22:21 [Worker_1] ClamAV Up
> Oct-10-16 10:22:21 id-55340-18830 [Worker_1] [TLS-out] 192.168.1.2 [OIP: 121.200.228.218] <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> ClamAV: scanned 18149 bytes in whitelisted message -  
> Oct-10-16 10:22:21 [Worker_1] Warning: ClamAV Temporary Off : Cannot connect to 'localhost:1107': IO::Socket::INET: connect: timeout
> Oct-10-16 10:22:21 id-55340-18830 [Worker_1] [TLS-out] 192.168.1.2 [OIP: 121.200.228.218] <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> whitelisted (no bad attachments)
> Oct-10-16 10:22:21 id-55340-18830 [Worker_1] [TLS-out] [MessageOK] 192.168.1.2 [OIP: 121.200.228.218] <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> message ok - (whitelistdb) - [INV REQUEST]
> Oct-10-16 10:22:47 [Worker_1] [TLS-out] 127.0.0.1 info: authentication - plain is used
> Oct-10-16 10:22:47 [Worker_1] [TLS-out] 127.0.0.1 info: authentication (PLAIN) realms - foruser:, user:[hidden email] <mailto:[hidden email]>
> Oct-10-16 10:22:56 [Worker_2] *** 127.0.0.1:10026 didn't work, trying others...
> Oct-10-16 10:22:56 [Worker_2] Error: couldn't create server socket to 127.0.0.1:10026 -- aborting connection
> Oct-10-16 10:22:56 id-55367-14617 [Worker_1] [TLS-out] 127.0.0.1 <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> [Plugin] calling plugin ASSP_AFC
> Oct-10-16 10:22:56 id-55367-14617 [Worker_1] [TLS-out] 127.0.0.1 <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> info: 1 attachment found for Level-0
> Oct-10-16 10:22:56 id-55367-14617 [Worker_1] [TLS-out] 127.0.0.1 <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> message proxied without processing (no bad attachments)
> Oct-10-16 10:22:56 id-55367-14617 [Worker_1] [TLS-out] [MessageOK] 127.0.0.1 <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> message ok [Grays tractor services] -> /Applications/assp/notspam/Grays_tractor_services--91742.eml
> Oct-10-16 10:23:00 [Worker_3] *** 127.0.0.1:10026 didn't work, trying others...
> Oct-10-16 10:23:23 [Worker_10000] Cleaning penalty records...
> Oct-10-16 10:23:23 [Worker_10000] PenaltyBox: cleaning BlackBox (PBBlack) finished: IP's before=7, deleted=2
> Oct-10-16 10:23:24 [Worker_10000] PenaltyBox: cleaning WhiteBox (PBWhite) finished: IP's before=3691, deleted=19
> Oct-10-16 10:23:24 [Worker_10000] PBTrap: cleaning finished: before=17, deleted=4
> Oct-10-16 10:23:26 [Worker_2] [TLS-out] 127.0.0.1 info: authentication - plain is used
> Oct-10-16 10:23:26 [Worker_2] [TLS-out] 127.0.0.1 info: authentication (PLAIN) realms - foruser:[hidden email] <mailto:[hidden email]>, user:[hidden email] <mailto:[hidden email]>
> Oct-10-16 10:23:26 id-55406-08594 [Worker_2] [TLS-out] 127.0.0.1 <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> [Plugin] calling plugin ASSP_AFC
> Oct-10-16 10:23:26 id-55406-08594 [Worker_2] [TLS-out] 127.0.0.1 <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> local (no bad attachments)
> Oct-10-16 10:23:26 id-55406-08594 [Worker_2] [TLS-out] [Plugin] 127.0.0.1 <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> ASSP_OCR: OCR(2.21) (TextFile(text2.cat)) data extracted
> Oct-10-16 10:23:26 id-55406-08594 [Worker_2] [TLS-out] [MessageOK] 127.0.0.1 <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> message ok [Re WorkCover Monthly Reports Bordo International September 2016]
> Error: couldn't create server socket to 127.0.0.1:10026 -- aborting connection (suppressed 2 concurrent equal 'Error' loglines from all Workers)
> Oct-10-16 10:23:38 [Worker_10000] Warning: Name Server 192.168.1.29: does not respond or timed out
> Oct-10-16 10:23:38 [Worker_10000] Warning: Name Server 208.67.222.222: does not respond or timed out
> Oct-10-16 10:23:38 [Worker_10000] ERROR: !!!! no answering DNS-SERVER found !!!!
> Oct-10-16 10:23:59 [Worker_1] ClamAV Up
> Oct-10-16 10:23:59 id-55367-14617 [Worker_1] 127.0.0.1 <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> ClamAV: scanned 100485 bytes in file /Applications/assp/notspam/Grays_tractor_services--91742.eml -  
> Oct-10-16 10:23:59 [Worker_1] Warning: ClamAV Temporary Off : Cannot connect to 'localhost:1155': IO::Socket::INET: connect: timeout
> Oct-10-16 10:24:12 [Worker_1] [TLS-out] 127.0.0.1 info: authentication - plain is used
> Oct-10-16 10:24:12 [Worker_1] [TLS-out] 127.0.0.1 info: authentication (PLAIN) realms - foruser:[hidden email] <mailto:[hidden email]>, user:[hidden email] <mailto:[hidden email]>
> Oct-10-16 10:24:15 [Worker_10000] DMARCpol: searching for DMARC-agregate-reports to generate in 16 stored DMARC policy records
> Oct-10-16 10:24:16 [Worker_10000] Info: looking for files to (re)send
> Oct-10-16 10:24:20 [Worker_1] *** 127.0.0.1:10026 didn't work, trying others...
> Oct-10-16 10:24:20 [Worker_1] Error: couldn't create server socket to 127.0.0.1:10026 -- aborting connection
> Oct-10-16 10:24:20 [Worker_1] *** 127.0.0.1:10026 didn't work, trying others...
> Oct-10-16 10:24:28 [Worker_1] [TLS-out] 192.168.1.51 info: authentication - plain is used
> Oct-10-16 10:24:28 [Worker_1] [TLS-out] 192.168.1.51 info: authentication (PLAIN) realms - foruser:[hidden email] <mailto:[hidden email]>, user:[hidden email] <mailto:[hidden email]>
> Oct-10-16 10:24:28 id-55468-19176 [Worker_1] [TLS-out] 192.168.1.51 <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> [Plugin] calling plugin ASSP_AFC
> Oct-10-16 10:24:28 id-55468-19176 [Worker_1] [TLS-out] 192.168.1.51 <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> info: 1 attachment found for Level-0
> Oct-10-16 10:24:28 id-55468-19176 [Worker_1] [TLS-out] 192.168.1.51 <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> local (no bad attachments)
> Oct-10-16 10:24:28 id-55468-19176 [Worker_1] [TLS-out] [Plugin] 192.168.1.51 <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> ASSP_OCR: OCR(2.21) (TextFile(text5.cat)) data extracted
> Oct-10-16 10:24:28 id-55468-19176 [Worker_1] [TLS-out] [MessageOK] 192.168.1.51 <[hidden email] <mailto:[hidden email]>> to: [hidden email] <mailto:[hidden email]> message ok [Re RFQ]
> Error: couldn't create server socket to 127.0.0.1:10026 -- aborting connection (suppressed 2 concurrent equal 'Error' loglines from all Workers)
> Oct-10-16 10:24:31 [Worker_10000] Info: saving Stats in file asspstats.sav
> Oct-10-16 10:24:31 [Worker_10000] Info: saving ScoreStats in file asspscorestats.sav
>
> I’ll restart ASSP.
>
> James.------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org <http://slashdot.org/>! http://sdm.link/slashdot_______________________________________________ <http://sdm.link/slashdot_______________________________________________>
> Assp-test mailing list
> [hidden email] <mailto:[hidden email]>
> https://lists.sourceforge.net/lists/listinfo/assp-test <https://lists.sourceforge.net/lists/listinfo/assp-test>

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test