Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
11 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.

assp-test mailing list
Anyone know how to get these archived scanned by AFC?


Jun-07-17 12:54:17 [Worker_2] Warning: possibly virus infected file (can't read entry in archive header) '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 [Worker_2] Warning: warn - libarchive extract '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <[hidden email]> to: [hidden email] SPAM FOUND bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)'
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] 192.168.1.2 [OIP: 112.90.139.244] <[hidden email]> to: [hidden email] Message-Score: added 5 (baValencePB) for bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)', total score for this message is now -20
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <[hidden email]> to: [hidden email] mail blocked by Plugin ASSP_AFC - reason BadAttachment
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <[hidden email]> to: [hidden email] [spam found] (BadAttachment) [fwd Fw Fw 80000797 798 Shipping Documents] -> /assp/virii/fwd_Fw_Fw_80000797_798_Shipping_Documents--148368.eml;

ASSP 2.5.6(17151)

AFC 4.53

Thanks,

James.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.

Thomas Eckardt/eck
Your system does not have UTF-8 as locale setting (e.g. it uses a single byte charset).
Libarchive translates all path and file names to the used locale setting. This ZIP contains a path name with a UTF-8 character, which can be converted to the locale setting of your system.

from the libachive description:

--------
In order to get useful string data out of libarchive, this module translates
its input/output using the codeset for the current POSIX locale.  So you must
be using a POSIX locale that supports the characters in the pathnames of
the archives you are going to process, and it is highly recommend that you
use a UTF-8 locale, which should cover everything.
---------

It may also happen, that a spammer used wrong encoded characters in the path name to pass virus checks. Because AFC does not know what happens and is unable to scan the attachment, the attachment is blocked for security reasons.

Thomas




Von:        James Brown via Assp-test <[hidden email]>
An:        ASSP development mailing list <[hidden email]>
Kopie:        James Brown <[hidden email]>
Datum:        07.06.2017 08:11
Betreff:        [Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Anyone know how to get these archived scanned by AFC?


Jun-07-17 12:54:17 [Worker_2] Warning: possibly virus infected file (can't read entry in archive header) '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 [Worker_2] Warning: warn - libarchive extract '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <[hidden email]> to: [hidden email] SPAM FOUND bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)'
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] 192.168.1.2 [OIP: 112.90.139.244] <[hidden email]> to: [hidden email] Message-Score: added 5 (baValencePB) for bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)', total score for this message is now -20
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <[hidden email]> to: [hidden email] mail blocked by Plugin ASSP_AFC - reason BadAttachment
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <[hidden email]> to: [hidden email] [spam found] (BadAttachment) [fwd Fw Fw 80000797 798 Shipping Documents] -> /assp/virii/fwd_Fw_Fw_80000797_798_Shipping_Documents--148368.eml;

ASSP 2.5.6(17151)

AFC 4.53

Thanks,

James.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org!
http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test






DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.

Thomas Eckardt/eck
In reply to this post by assp-test mailing list
James,

I've just published ASSP_AFC 4.54 at SF-CVS.

Until 4.53 - if the conversion error was detected, the plugin stopped processing.
Now - the plugin tries to change the wrong path name to a valid one.

I'm unable to test this. It may work or not - but it will show why.

Thomas




Von:        James Brown via Assp-test <[hidden email]>
An:        ASSP development mailing list <[hidden email]>
Kopie:        James Brown <[hidden email]>
Datum:        07.06.2017 08:11
Betreff:        [Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Anyone know how to get these archived scanned by AFC?


Jun-07-17 12:54:17 [Worker_2] Warning: possibly virus infected file (can't read entry in archive header) '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 [Worker_2] Warning: warn - libarchive extract '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <[hidden email]> to: [hidden email] SPAM FOUND bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)'
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] 192.168.1.2 [OIP: 112.90.139.244] <[hidden email]> to: [hidden email] Message-Score: added 5 (baValencePB) for bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)', total score for this message is now -20
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <[hidden email]> to: [hidden email] mail blocked by Plugin ASSP_AFC - reason BadAttachment
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <[hidden email]> to: [hidden email] [spam found] (BadAttachment) [fwd Fw Fw 80000797 798 Shipping Documents] -> /assp/virii/fwd_Fw_Fw_80000797_798_Shipping_Documents--148368.eml;

ASSP 2.5.6(17151)

AFC 4.53

Thanks,

James.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org!
http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test






DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.

assp-test mailing list
Wow, thanks Thomas!

Have put 4.54 on now.

Will see how it goes.

Thanks again,

James.

On 7 Jun 2017, at 6:53 pm, Thomas Eckardt <[hidden email]> wrote:

James,

I've just published ASSP_AFC 4.54 at SF-CVS.

Until 4.53 - if the conversion error was detected, the plugin stopped processing.
Now - the plugin tries to change the wrong path name to a valid one.

I'm unable to test this. It may work or not - but it will show why.

Thomas




Von:        James Brown via Assp-test <[hidden email]>
An:        ASSP development mailing list <[hidden email]>
Kopie:        James Brown <[hidden email]>
Datum:        07.06.2017 08:11
Betreff:        [Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Anyone know how to get these archived scanned by AFC?


Jun-07-17 12:54:17 [Worker_2] Warning: possibly virus infected file (can't read entry in archive header) '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 [Worker_2] Warning: warn - libarchive extract '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <[hidden email]> to: [hidden email] SPAM FOUND bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)'
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] 192.168.1.2 [OIP: 112.90.139.244] <[hidden email]> to: [hidden email] Message-Score: added 5 (baValencePB) for bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)', total score for this message is now -20
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <[hidden email]> to: [hidden email] mail blocked by Plugin ASSP_AFC - reason BadAttachment
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <[hidden email]> to: [hidden email] [spam found] (BadAttachment) [fwd Fw Fw 80000797 798 Shipping Documents] -> /assp/virii/fwd_Fw_Fw_80000797_798_Shipping_Documents--148368.eml;

ASSP 2.5.6(17151)

AFC 4.53

Thanks,

James.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org!
http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test






DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.

Thomas Eckardt/eck
James, pipe the mail in question in to the analyzer (GUI or per email) and watch the maillog.txt.

Thomas





Von:        James Brown via Assp-test <[hidden email]>
An:        ASSP development mailing list <[hidden email]>
Kopie:        James Brown <[hidden email]>
Datum:        07.06.2017 11:43
Betreff:        Re: [Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Wow, thanks Thomas!

Have put 4.54 on now.

Will see how it goes.

Thanks again,

James.

On 7 Jun 2017, at 6:53 pm, Thomas Eckardt <Thomas.Eckardt@...> wrote:

James,

I've just published ASSP_AFC 4.54 at SF-CVS.


Until 4.53 - if the conversion error was detected, the plugin stopped processing.
Now - the plugin tries to change the wrong path name to a valid one.

I'm unable to test this. It may work or not - but it will show why.


Thomas





Von:        
James Brown via Assp-test <[hidden email]>
An:        
ASSP development mailing list <[hidden email]>
Kopie:        
James Brown <jlbrown@...>
Datum:        
07.06.2017 08:11
Betreff:        
[Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Anyone know how to get these archived scanned by AFC?


Jun-07-17 12:54:17 [Worker_2] Warning: possibly virus infected file (can't read entry in archive header) '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 [Worker_2] Warning: warn - libarchive extract '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
2832345@...> to: username@... SPAM FOUND bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)'
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] 192.168.1.2 [OIP: 112.90.139.244] <
2832345@...> to: username@... Message-Score: added 5 (baValencePB) for bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)', total score for this message is now -20
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
2832345@...> to: username@... mail blocked by Plugin ASSP_AFC - reason BadAttachment
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
2832345@...> to: username@... [spam found] (BadAttachment) [fwd Fw Fw 80000797 798 Shipping Documents] -> /assp/virii/fwd_Fw_Fw_80000797_798_Shipping_Documents--148368.eml;

ASSP 2.5.6(17151)

AFC 4.53

Thanks,

James.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test






DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org!
http://sdm.link/slashdot_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.

assp-test mailing list
Jun-07-17 21:50:37 [Main_Thread] Info: analyze detected: IP: '192.168.1.2' , HELO: 'astaro1.bordo.com.au' , assp-Host: 'mail.bordo.com.au'
Jun-07-17 21:50:38 [Main_Thread] [scoring] DKIM signature verified-OK - pass - sender policy is: accept - author policy is: accept
Jun-07-17 21:50:38 [Main_Thread] Info: domain qq.com has published a DMARC record
Jun-07-17 21:50:40 [Main_Thread] Warning: possibly virus infected file (can't read entry in archive header) '/assp/tmp/zip_0_1496836240/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale. - tried correction to (/assp/tmp/zip_0_1496836240/.10/) failed - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 21:50:40 [Main_Thread] Warning: warn - libarchive extract '/assp/tmp/zip_0_1496836240/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 21:50:40 [Main_Thread] HMM Check [scoring] - Prob: 0.00000 => ham - answer/query relation: 100% of 275

James.

On 7 Jun 2017, at 7:57 pm, Thomas Eckardt <[hidden email]> wrote:

James, pipe the mail in question in to the analyzer (GUI or per email) and watch the maillog.txt.

Thomas





Von:        James Brown via Assp-test <[hidden email]>
An:        ASSP development mailing list <[hidden email]>
Kopie:        James Brown <[hidden email]>
Datum:        07.06.2017 11:43
Betreff:        Re: [Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Wow, thanks Thomas!

Have put 4.54 on now.

Will see how it goes.

Thanks again,

James.

On 7 Jun 2017, at 6:53 pm, Thomas Eckardt <[hidden email]> wrote:

James,

I've just published ASSP_AFC 4.54 at SF-CVS.


Until 4.53 - if the conversion error was detected, the plugin stopped processing.
Now - the plugin tries to change the wrong path name to a valid one.

I'm unable to test this. It may work or not - but it will show why.


Thomas





Von:        
James Brown via Assp-test <[hidden email]>
An:        
ASSP development mailing list <[hidden email]>
Kopie:        
James Brown <[hidden email]>
Datum:        
07.06.2017 08:11
Betreff:        
[Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Anyone know how to get these archived scanned by AFC?


Jun-07-17 12:54:17 [Worker_2] Warning: possibly virus infected file (can't read entry in archive header) '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 [Worker_2] Warning: warn - libarchive extract '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
[hidden email]> to: [hidden email] SPAM FOUND bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)'
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] 192.168.1.2 [OIP: 112.90.139.244] <
[hidden email]> to: [hidden email] Message-Score: added 5 (baValencePB) for bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)', total score for this message is now -20
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
[hidden email]> to: [hidden email] mail blocked by Plugin ASSP_AFC - reason BadAttachment
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
[hidden email]> to: [hidden email] [spam found] (BadAttachment) [fwd Fw Fw 80000797 798 Shipping Documents] -> /assp/virii/fwd_Fw_Fw_80000797_798_Shipping_Documents--148368.eml;

ASSP 2.5.6(17151)

AFC 4.53

Thanks,

James.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test






DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org!
http://sdm.link/slashdot_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.

Thomas Eckardt/eck
It was not worth the try. But it looks like setting the pathname forces internaly (in libarchive) a read first, and this fails.

try the following before we go further

open the .eml file in your mail client and extract the attachment
try to decopmress the zip using any or multiple system tools (7z, zip, gzip ....) what ever you have on hand
is it possible to decompress the attachment?
how are the filenames of the decompressed files?

To get this solved, please forward the .eml as ZIP or the extracted attachment to my privat email address.

Thomas






Von:        James Brown via Assp-test <[hidden email]>
An:        ASSP development mailing list <[hidden email]>
Kopie:        James Brown <[hidden email]>
Datum:        07.06.2017 13:55
Betreff:        Re: [Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Jun-07-17 21:50:37 [Main_Thread] Info: analyze detected: IP: '192.168.1.2' , HELO: 'astaro1.bordo.com.au' , assp-Host: 'mail.bordo.com.au'
Jun-07-17 21:50:38 [Main_Thread] [scoring] DKIM signature verified-OK - pass - sender policy is: accept - author policy is: accept
Jun-07-17 21:50:38 [Main_Thread] Info: domain qq.com has published a DMARC record
Jun-07-17 21:50:40 [Main_Thread] Warning: possibly virus infected file (can't read entry in archive header) '/assp/tmp/zip_0_1496836240/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale. - tried correction to (/assp/tmp/zip_0_1496836240/.10/) failed - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 21:50:40 [Main_Thread] Warning: warn - libarchive extract '/assp/tmp/zip_0_1496836240/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 21:50:40 [Main_Thread] HMM Check [scoring] - Prob: 0.00000 => ham - answer/query relation: 100% of 275

James.

On 7 Jun 2017, at 7:57 pm, Thomas Eckardt <Thomas.Eckardt@...> wrote:

James, pipe the mail in question in to the analyzer (GUI or per email) and watch the maillog.txt.

Thomas





Von:        
James Brown via Assp-test <[hidden email]>
An:        
ASSP development mailing list <[hidden email]>
Kopie:        
James Brown <jlbrown@...>
Datum:        
07.06.2017 11:43
Betreff:        
Re: [Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Wow, thanks Thomas!

Have put 4.54 on now.

Will see how it goes.

Thanks again,

James.

On 7 Jun 2017, at 6:53 pm, Thomas Eckardt <
Thomas.Eckardt@...> wrote:

James,


I've just published ASSP_AFC 4.54 at SF-CVS.


Until 4.53 - if the conversion error was detected, the plugin stopped processing.
Now - the plugin tries to change the wrong path name to a valid one.

I'm unable to test this. It may work or not - but it will show why.


Thomas





Von:        
James Brown via Assp-test <[hidden email]>
An:        
ASSP development mailing list <[hidden email]>
Kopie:        
James Brown <jlbrown@...>
Datum:        
07.06.2017 08:11
Betreff:        
[Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Anyone know how to get these archived scanned by AFC?


Jun-07-17 12:54:17 [Worker_2] Warning: possibly virus infected file (can't read entry in archive header) '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 [Worker_2] Warning: warn - libarchive extract '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
2832345@...> to: username@... SPAM FOUND bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)'
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] 192.168.1.2 [OIP: 112.90.139.244] <
2832345@...> to: username@... Message-Score: added 5 (baValencePB) for bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)', total score for this message is now -20
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
2832345@...> to: username@... mail blocked by Plugin ASSP_AFC - reason BadAttachment
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
2832345@...> to: username@... [spam found] (BadAttachment) [fwd Fw Fw 80000797 798 Shipping Documents] -> /assp/virii/fwd_Fw_Fw_80000797_798_Shipping_Documents--148368.eml;

ASSP 2.5.6(17151)

AFC 4.53

Thanks,

James.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test






DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org!
http://sdm.link/slashdot_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.

Thomas Eckardt/eck
In reply to this post by assp-test mailing list
ASSP_AFC 4.55 is available at SF-CVS.

If the extraction fails with libarchive because of the conversion error, AFC now fails over to other available decompressors (Archive::Rar::Passthrough + 7z/RAR or Archive::Extract)

James, the zip in question contains a file with a wrong file name (one wrong character). Libarchive does not ignore this mistake like all other decompressors I tried.

None Asbestos Declaration for 80000797&798 .pdf  <- extracted by  Archive::Extract - the character in question was replaced by best guess
None Asbestos Declaration for 80000797&798 .pdf <- extracted by zip and 7z - the character was removed

I'll have a look in to the libarchive code. Hopefully I'll find a way to ignore those mistakes. For now (possibly for ever) the failover methode will be used.

How ever, if your system 'locale' would be set to UTF-8, the conversion error should not happen.

BUT - another issue could be:
libarchive requires to be compiled with 'iconv' to prevent the conversion error. Check if 'iconv' is installed on your system - if not:
- install it
- recompile libarchive
- reinstall Archive::Libarchive::XS

Thomas





Von:        James Brown via Assp-test <[hidden email]>
An:        ASSP development mailing list <[hidden email]>
Kopie:        James Brown <[hidden email]>
Datum:        07.06.2017 13:55
Betreff:        Re: [Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Jun-07-17 21:50:37 [Main_Thread] Info: analyze detected: IP: '192.168.1.2' , HELO: 'astaro1.bordo.com.au' , assp-Host: 'mail.bordo.com.au'
Jun-07-17 21:50:38 [Main_Thread] [scoring] DKIM signature verified-OK - pass - sender policy is: accept - author policy is: accept
Jun-07-17 21:50:38 [Main_Thread] Info: domain qq.com has published a DMARC record
Jun-07-17 21:50:40 [Main_Thread] Warning: possibly virus infected file (can't read entry in archive header) '/assp/tmp/zip_0_1496836240/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale. - tried correction to (/assp/tmp/zip_0_1496836240/.10/) failed - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 21:50:40 [Main_Thread] Warning: warn - libarchive extract '/assp/tmp/zip_0_1496836240/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 21:50:40 [Main_Thread] HMM Check [scoring] - Prob: 0.00000 => ham - answer/query relation: 100% of 275

James.

On 7 Jun 2017, at 7:57 pm, Thomas Eckardt <Thomas.Eckardt@...> wrote:

James, pipe the mail in question in to the analyzer (GUI or per email) and watch the maillog.txt.

Thomas





Von:        
James Brown via Assp-test <[hidden email]>
An:        
ASSP development mailing list <[hidden email]>
Kopie:        
James Brown <jlbrown@...>
Datum:        
07.06.2017 11:43
Betreff:        
Re: [Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Wow, thanks Thomas!

Have put 4.54 on now.

Will see how it goes.

Thanks again,

James.

On 7 Jun 2017, at 6:53 pm, Thomas Eckardt <
Thomas.Eckardt@...> wrote:

James,


I've just published ASSP_AFC 4.54 at SF-CVS.


Until 4.53 - if the conversion error was detected, the plugin stopped processing.
Now - the plugin tries to change the wrong path name to a valid one.

I'm unable to test this. It may work or not - but it will show why.


Thomas





Von:        
James Brown via Assp-test <[hidden email]>
An:        
ASSP development mailing list <[hidden email]>
Kopie:        
James Brown <jlbrown@...>
Datum:        
07.06.2017 08:11
Betreff:        
[Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Anyone know how to get these archived scanned by AFC?


Jun-07-17 12:54:17 [Worker_2] Warning: possibly virus infected file (can't read entry in archive header) '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 [Worker_2] Warning: warn - libarchive extract '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
2832345@...> to: username@... SPAM FOUND bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)'
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] 192.168.1.2 [OIP: 112.90.139.244] <
2832345@...> to: username@... Message-Score: added 5 (baValencePB) for bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)', total score for this message is now -20
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
2832345@...> to: username@... mail blocked by Plugin ASSP_AFC - reason BadAttachment
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
2832345@...> to: username@... [spam found] (BadAttachment) [fwd Fw Fw 80000797 798 Shipping Documents] -> /assp/virii/fwd_Fw_Fw_80000797_798_Shipping_Documents--148368.eml;

ASSP 2.5.6(17151)

AFC 4.53

Thanks,

James.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test






DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org!
http://sdm.link/slashdot_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.

assp-test mailing list
Thanks Thomas.

I have iconv on the system:

$ iconv --version
iconv (GNU libiconv 1.11)
Copyright (C) 2000-2006 Free Software Foundation, Inc.

So it’s not that.

Will see how it goes now.

Thanks,

James.

On 8 Jun 2017, at 1:09 am, Thomas Eckardt <[hidden email]> wrote:

ASSP_AFC 4.55 is available at SF-CVS.

If the extraction fails with libarchive because of the conversion error, AFC now fails over to other available decompressors (Archive::Rar::Passthrough + 7z/RAR or Archive::Extract)

James, the zip in question contains a file with a wrong file name (one wrong character). Libarchive does not ignore this mistake like all other decompressors I tried.

None Asbestos Declaration for 80000797&798 .pdf  <- extracted by  Archive::Extract - the character in question was replaced by best guess
None Asbestos Declaration for 80000797&798 .pdf <- extracted by zip and 7z - the character was removed

I'll have a look in to the libarchive code. Hopefully I'll find a way to ignore those mistakes. For now (possibly for ever) the failover methode will be used.

How ever, if your system 'locale' would be set to UTF-8, the conversion error should not happen.

BUT - another issue could be:
libarchive requires to be compiled with 'iconv' to prevent the conversion error. Check if 'iconv' is installed on your system - if not:
- install it
- recompile libarchive
- reinstall Archive::Libarchive::XS

Thomas





Von:        James Brown via Assp-test <[hidden email]>
An:        ASSP development mailing list <[hidden email]>
Kopie:        James Brown <[hidden email]>
Datum:        07.06.2017 13:55
Betreff:        Re: [Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Jun-07-17 21:50:37 [Main_Thread] Info: analyze detected: IP: '192.168.1.2' , HELO: 'astaro1.bordo.com.au' , assp-Host: 'mail.bordo.com.au'
Jun-07-17 21:50:38 [Main_Thread] [scoring] DKIM signature verified-OK - pass - sender policy is: accept - author policy is: accept
Jun-07-17 21:50:38 [Main_Thread] Info: domain qq.com has published a DMARC record
Jun-07-17 21:50:40 [Main_Thread] Warning: possibly virus infected file (can't read entry in archive header) '/assp/tmp/zip_0_1496836240/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale. - tried correction to (/assp/tmp/zip_0_1496836240/.10/) failed - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 21:50:40 [Main_Thread] Warning: warn - libarchive extract '/assp/tmp/zip_0_1496836240/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 21:50:40 [Main_Thread] HMM Check [scoring] - Prob: 0.00000 => ham - answer/query relation: 100% of 275

James.

On 7 Jun 2017, at 7:57 pm, Thomas Eckardt <[hidden email]> wrote:

James, pipe the mail in question in to the analyzer (GUI or per email) and watch the maillog.txt.

Thomas





Von:        
James Brown via Assp-test <[hidden email]>
An:        
ASSP development mailing list <[hidden email]>
Kopie:        
James Brown <[hidden email]>
Datum:        
07.06.2017 11:43
Betreff:        
Re: [Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Wow, thanks Thomas!

Have put 4.54 on now.

Will see how it goes.

Thanks again,

James.

On 7 Jun 2017, at 6:53 pm, Thomas Eckardt <
[hidden email]> wrote:

James,


I've just published ASSP_AFC 4.54 at SF-CVS.


Until 4.53 - if the conversion error was detected, the plugin stopped processing.
Now - the plugin tries to change the wrong path name to a valid one.

I'm unable to test this. It may work or not - but it will show why.


Thomas





Von:        
James Brown via Assp-test <[hidden email]>
An:        
ASSP development mailing list <[hidden email]>
Kopie:        
James Brown <[hidden email]>
Datum:        
07.06.2017 08:11
Betreff:        
[Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Anyone know how to get these archived scanned by AFC?


Jun-07-17 12:54:17 [Worker_2] Warning: possibly virus infected file (can't read entry in archive header) '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 [Worker_2] Warning: warn - libarchive extract '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
[hidden email]> to: [hidden email] SPAM FOUND bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)'
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] 192.168.1.2 [OIP: 112.90.139.244] <
[hidden email]> to: [hidden email] Message-Score: added 5 (baValencePB) for bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)', total score for this message is now -20
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
[hidden email]> to: [hidden email] mail blocked by Plugin ASSP_AFC - reason BadAttachment
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
[hidden email]> to: [hidden email] [spam found] (BadAttachment) [fwd Fw Fw 80000797 798 Shipping Documents] -> /assp/virii/fwd_Fw_Fw_80000797_798_Shipping_Documents--148368.eml;

ASSP 2.5.6(17151)

AFC 4.53

Thanks,

James.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test






DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org!
http://sdm.link/slashdot_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.

Thomas Eckardt/eck
Is the 'iconv-devel' package also available on your system? I think iconv is not called by libarchive, it is included in the compilation.

BTW: my libarchive is able to extract your ZIP file without any error message. But the implementation and compilation on windows is totaly different.

Thomas





Von:        James Brown via Assp-test <[hidden email]>
An:        ASSP development mailing list <[hidden email]>
Kopie:        James Brown <[hidden email]>
Datum:        08.06.2017 06:19
Betreff:        Re: [Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Thanks Thomas.

I have iconv on the system:

$ iconv --version
iconv (GNU libiconv 1.11)
Copyright (C) 2000-2006 Free Software Foundation, Inc.

So it’s not that.

Will see how it goes now.

Thanks,

James.

On 8 Jun 2017, at 1:09 am, Thomas Eckardt <Thomas.Eckardt@...> wrote:

ASSP_AFC 4.55 is available at SF-CVS.

If the extraction fails with libarchive because of the conversion error, AFC now fails over to other available decompressors (Archive::Rar::Passthrough + 7z/RAR or Archive::Extract)


James, the zip in question contains a file with a wrong file name (one wrong character). Libarchive does not ignore this mistake like all other decompressors I tried.


None Asbestos Declaration for 80000797&798 .pdf  <- extracted by  Archive::Extract - the character in question was replaced by best guess

None Asbestos Declaration for 80000797&798 .pdf <- extracted by zip and 7z - the character was removed


I'll have a look in to the libarchive code. Hopefully I'll find a way to ignore those mistakes. For now (possibly for ever) the failover methode will be used.


How ever, if your system 'locale' would be set to UTF-8, the conversion error should not happen.


BUT - another issue could be:

libarchive requires to be compiled with 'iconv' to prevent the conversion error. Check if 'iconv' is installed on your system - if not:

- install it

- recompile libarchive

- reinstall Archive::Libarchive::XS


Thomas





Von:        
James Brown via Assp-test <[hidden email]>
An:        
ASSP development mailing list <[hidden email]>
Kopie:        
James Brown <jlbrown@...>
Datum:        
07.06.2017 13:55
Betreff:        
Re: [Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Jun-07-17 21:50:37 [Main_Thread] Info: analyze detected: IP: '192.168.1.2' , HELO: '
astaro1.bordo.com.au' , assp-Host: 'mail.bordo.com.au'
Jun-07-17 21:50:38 [Main_Thread] [scoring] DKIM signature verified-OK - pass - sender policy is: accept - author policy is: accept
Jun-07-17 21:50:38 [Main_Thread] Info: domain
qq.com has published a DMARC record
Jun-07-17 21:50:40 [Main_Thread] Warning: possibly virus infected file (can't read entry in archive header) '/assp/tmp/zip_0_1496836240/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale. - tried correction to (/assp/tmp/zip_0_1496836240/.10/) failed - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 21:50:40 [Main_Thread] Warning: warn - libarchive extract '/assp/tmp/zip_0_1496836240/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 21:50:40 [Main_Thread] HMM Check [scoring] - Prob: 0.00000 => ham - answer/query relation: 100% of 275

James.

On 7 Jun 2017, at 7:57 pm, Thomas Eckardt <
Thomas.Eckardt@...> wrote:

James, pipe the mail in question in to the analyzer (GUI or per email) and watch the maillog.txt.


Thomas






Von:        
James Brown via Assp-test <[hidden email]>
An:        
ASSP development mailing list <[hidden email]>
Kopie:        
James Brown <jlbrown@...>
Datum:        
07.06.2017 11:43
Betreff:        
Re: [Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Wow, thanks Thomas!

Have put 4.54 on now.

Will see how it goes.

Thanks again,

James.

On 7 Jun 2017, at 6:53 pm, Thomas Eckardt <
Thomas.Eckardt@...> wrote:

James,


I've just published ASSP_AFC 4.54 at SF-CVS.


Until 4.53 - if the conversion error was detected, the plugin stopped processing.
Now - the plugin tries to change the wrong path name to a valid one.

I'm unable to test this. It may work or not - but it will show why.


Thomas





Von:        
James Brown via Assp-test <[hidden email]>
An:        
ASSP development mailing list <[hidden email]>
Kopie:        
James Brown <jlbrown@...>
Datum:        
07.06.2017 08:11
Betreff:        
[Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Anyone know how to get these archived scanned by AFC?


Jun-07-17 12:54:17 [Worker_2] Warning: possibly virus infected file (can't read entry in archive header) '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 [Worker_2] Warning: warn - libarchive extract '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
2832345@...> to: username@... SPAM FOUND bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)'
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] 192.168.1.2 [OIP: 112.90.139.244] <
2832345@...> to: username@... Message-Score: added 5 (baValencePB) for bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)', total score for this message is now -20
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
2832345@...> to: username@... mail blocked by Plugin ASSP_AFC - reason BadAttachment
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
2832345@...> to: username@... [spam found] (BadAttachment) [fwd Fw Fw 80000797 798 Shipping Documents] -> /assp/virii/fwd_Fw_Fw_80000797_798_Shipping_Documents--148368.eml;

ASSP 2.5.6(17151)

AFC 4.53

Thanks,

James.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test






DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org!
http://sdm.link/slashdot_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.

assp-test mailing list
Locate iconv-devel finds nothing for me.

Don’t know how to tell if iconv was compiled into my libarchive. 

Thanks,

James.

On 8 Jun 2017, at 2:29 pm, Thomas Eckardt <[hidden email]> wrote:

Is the 'iconv-devel' package also available on your system? I think iconv is not called by libarchive, it is included in the compilation.

BTW: my libarchive is able to extract your ZIP file without any error message. But the implementation and compilation on windows is totaly different.

Thomas





Von:        James Brown via Assp-test <[hidden email]>
An:        ASSP development mailing list <[hidden email]>
Kopie:        James Brown <[hidden email]>
Datum:        08.06.2017 06:19
Betreff:        Re: [Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Thanks Thomas.

I have iconv on the system:

$ iconv --version
iconv (GNU libiconv 1.11)
Copyright (C) 2000-2006 Free Software Foundation, Inc.

So it’s not that.

Will see how it goes now.

Thanks,

James.

On 8 Jun 2017, at 1:09 am, Thomas Eckardt <[hidden email]> wrote:

ASSP_AFC 4.55 is available at SF-CVS.

If the extraction fails with libarchive because of the conversion error, AFC now fails over to other available decompressors (Archive::Rar::Passthrough + 7z/RAR or Archive::Extract)


James, the zip in question contains a file with a wrong file name (one wrong character). Libarchive does not ignore this mistake like all other decompressors I tried.


None Asbestos Declaration for 80000797&798 .pdf  <- extracted by  Archive::Extract - the character in question was replaced by best guess

None Asbestos Declaration for 80000797&798 .pdf <- extracted by zip and 7z - the character was removed


I'll have a look in to the libarchive code. Hopefully I'll find a way to ignore those mistakes. For now (possibly for ever) the failover methode will be used.


How ever, if your system 'locale' would be set to UTF-8, the conversion error should not happen.


BUT - another issue could be:

libarchive requires to be compiled with 'iconv' to prevent the conversion error. Check if 'iconv' is installed on your system - if not:

- install it

- recompile libarchive

- reinstall Archive::Libarchive::XS


Thomas





Von:        
James Brown via Assp-test <[hidden email]>
An:        
ASSP development mailing list <[hidden email]>
Kopie:        
James Brown <[hidden email]>
Datum:        
07.06.2017 13:55
Betreff:        
Re: [Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Jun-07-17 21:50:37 [Main_Thread] Info: analyze detected: IP: '192.168.1.2' , HELO: '
astaro1.bordo.com.au' , assp-Host: 'mail.bordo.com.au'
Jun-07-17 21:50:38 [Main_Thread] [scoring] DKIM signature verified-OK - pass - sender policy is: accept - author policy is: accept
Jun-07-17 21:50:38 [Main_Thread] Info: domain
qq.com has published a DMARC record
Jun-07-17 21:50:40 [Main_Thread] Warning: possibly virus infected file (can't read entry in archive header) '/assp/tmp/zip_0_1496836240/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale. - tried correction to (/assp/tmp/zip_0_1496836240/.10/) failed - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 21:50:40 [Main_Thread] Warning: warn - libarchive extract '/assp/tmp/zip_0_1496836240/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 21:50:40 [Main_Thread] HMM Check [scoring] - Prob: 0.00000 => ham - answer/query relation: 100% of 275

James.

On 7 Jun 2017, at 7:57 pm, Thomas Eckardt <
[hidden email]> wrote:

James, pipe the mail in question in to the analyzer (GUI or per email) and watch the maillog.txt.


Thomas






Von:        
James Brown via Assp-test <[hidden email]>
An:        
ASSP development mailing list <[hidden email]>
Kopie:        
James Brown <[hidden email]>
Datum:        
07.06.2017 11:43
Betreff:        
Re: [Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Wow, thanks Thomas!

Have put 4.54 on now.

Will see how it goes.

Thanks again,

James.

On 7 Jun 2017, at 6:53 pm, Thomas Eckardt <
[hidden email]> wrote:

James,


I've just published ASSP_AFC 4.54 at SF-CVS.


Until 4.53 - if the conversion error was detected, the plugin stopped processing.
Now - the plugin tries to change the wrong path name to a valid one.

I'm unable to test this. It may work or not - but it will show why.


Thomas





Von:        
James Brown via Assp-test <[hidden email]>
An:        
ASSP development mailing list <[hidden email]>
Kopie:        
James Brown <[hidden email]>
Datum:        
07.06.2017 08:11
Betreff:        
[Assp-test] Bad Attachment: Pathname cannot be converted from UTF-8 to current locale.




Anyone know how to get these archived scanned by AFC?


Jun-07-17 12:54:17 [Worker_2] Warning: possibly virus infected file (can't read entry in archive header) '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 [Worker_2] Warning: warn - libarchive extract '/assp/tmp/zip_2_1496804057/80000797_798_Shipping_Documents.zip' - <-20> - Pathname cannot be converted from UTF-8 to current locale.
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
[hidden email]> to: [hidden email] SPAM FOUND bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)'
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] 192.168.1.2 [OIP: 112.90.139.244] <
[hidden email]> to: [hidden email] Message-Score: added 5 (baValencePB) for bad attachment '80000797&798 Shipping Documents.zip' cause: 'possibly virus infected file (can't extract archive)', total score for this message is now -20
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
[hidden email]> to: [hidden email] mail blocked by Plugin ASSP_AFC - reason BadAttachment
Jun-07-17 12:54:17 id-04046-19702 [Worker_2] [TLS-out] [Attachment] 192.168.1.2 [OIP: 112.90.139.244] <
[hidden email]> to: [hidden email] [spam found] (BadAttachment) [fwd Fw Fw 80000797 798 Shipping Documents] -> /assp/virii/fwd_Fw_Fw_80000797_798_Shipping_Documents--148368.eml;

ASSP 2.5.6(17151)

AFC 4.53

Thanks,

James.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test






DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list

[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org!
http://sdm.link/slashdot_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Loading...