Re: Any Outlook users out there? Reporting / analyze question

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Re: Any Outlook users out there? Reporting / analyze question

K Post
Can any of you report back on this?  THANKS

On Sun, Dec 4, 2016 at 4:32 PM, K Post <[hidden email]> wrote:
I'm curious if there are any ASSP admins out there who use Outlook on a PC.

We're having 2 minor issues with Spam/NotSpam reports sent from Outlook and I'm wondering if it's just our installation or if others are seeing the same thing.  Thomas understandably doesn't want to install Outlook, so I'm turning to you, the admin users of ASSP for some quick help.

Note: we send reports to assp by doing a Forward as Attachment, which preserves the headers.


Problem #1: Analyze reports don't work.  
When we send a Spam/NotSpam report, the report itself is saved perfectly in the corpus.  Headers are intact, the message is there.  All is well.  However, if we have Spam and Ham Reports will trigger an additional Analyze Report (DoAdditionalAnalyze) set to send an analyze report, the report gets sent, but it's all wrong.  It seems to analyze the headers of the report itself, not the reported message.  It also almost always triggers and error in the log like:

Dec-04-16 16:13:51 Warning: DKIM returned 'no domain to fetch policy for '    
(that warning line just ends with a single quote)


Problem #2: Sending multiple reports in a single message doesn't work correctly
If we select a couple messages in the inbox and do a forward as attachment to the spam/notspam reporting address, the message that is saves in the corpus seems to be a mime encoded version of the fist message only, the filename is a seemingly random bunch of ASCII characters.  I'm certain that this used to work, but I the last time I texted was years and years ago.  No idea when this stopped working for us.


Thanks!

Ken



------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|

Re: Any Outlook users out there? Reporting / analyze question

Andrew Macpherson-3
Just a thought…. Does Outlook think the mailbox for the report address is an outlook user or an internet mail user?  (Check in the sending address book)

Andrew Macpherson <[hidden email]>
(Twitter @OA5dotCom)

The Old Church, 22-24 Church St, Milnathort, KY13 9XH, GB
Phone tel:+441577861848 GSM tel:+447899961797

LEGAL CLAIMER:  Any claims made at this point in a message
are completely invalid as they are presented after the information they
attempt to assert rights over has been disclosed without prior caveat




> On 19 Dec 2016, at 01:09, K Post <[hidden email]> wrote:
>
> Can any of you report back on this?  THANKS
>
> On Sun, Dec 4, 2016 at 4:32 PM, K Post <[hidden email]> wrote:
> I'm curious if there are any ASSP admins out there who use Outlook on a PC.
>
> We're having 2 minor issues with Spam/NotSpam reports sent from Outlook and I'm wondering if it's just our installation or if others are seeing the same thing.  Thomas understandably doesn't want to install Outlook, so I'm turning to you, the admin users of ASSP for some quick help.
>
> Note: we send reports to assp by doing a Forward as Attachment, which preserves the headers.
>
>
> Problem #1: Analyze reports don't work.  
> When we send a Spam/NotSpam report, the report itself is saved perfectly in the corpus.  Headers are intact, the message is there.  All is well.  However, if we have Spam and Ham Reports will trigger an additional Analyze Report (DoAdditionalAnalyze) set to send an analyze report, the report gets sent, but it's all wrong.  It seems to analyze the headers of the report itself, not the reported message.  It also almost always triggers and error in the log like:
> Dec-04-16 16:13:51 Warning: DKIM returned 'no domain to fetch policy for '    
> (that warning line just ends with a single quote)
>
>
>
> Problem #2: Sending multiple reports in a single message doesn't work correctly
> If we select a couple messages in the inbox and do a forward as attachment to the spam/notspam reporting address, the message that is saves in the corpus seems to be a mime encoded version of the fist message only, the filename is a seemingly random bunch of ASCII characters.  I'm certain that this used to work, but I the last time I texted was years and years ago.  No idea when this stopped working for us.
>
>
>
> Thanks!
>
> Ken
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot_______________________________________________
> Assp-test mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/assp-test


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|

Re: Any Outlook users out there? Reporting / analyze question

K Post
Thanks for chiming in Andrew!!

This is through an exchange server.  The user enters the address from remembered addresses or by directly entering the internet address (which exchange knows isn't hosted internally).  By "Outlook user" I presume you mean Exchange users as Outlook's just a client and not a server.    I >think< this is all a moot point though as ASSP is getting the message correctly - or correctly enough - to save it as expected in the corrected corpus.  It's just the analyze report that's analyzing the report email itself vs the content of the reported email.  And I've got no idea what's going on when I forward multiple reports as attachments under one email.  No idea how long that's been broken for me.


On Mon, Dec 19, 2016 at 5:44 AM, Andrew Macpherson <[hidden email]> wrote:
Just a thought…. Does Outlook think the mailbox for the report address is an outlook user or an internet mail user?  (Check in the sending address book)

Andrew Macpherson <[hidden email]>
(Twitter @OA5dotCom)

The Old Church, 22-24 Church St, Milnathort, KY13 9XH, GB
Phone tel:<a href="tel:%2B441577861848" value="+441577861848">+441577861848 GSM tel:<a href="tel:%2B447899961797" value="+447899961797">+447899961797

LEGAL CLAIMER:  Any claims made at this point in a message
are completely invalid as they are presented after the information they
attempt to assert rights over has been disclosed without prior caveat




> On 19 Dec 2016, at 01:09, K Post <[hidden email]> wrote:
>
> Can any of you report back on this?  THANKS
>
> On Sun, Dec 4, 2016 at 4:32 PM, K Post <[hidden email]> wrote:
> I'm curious if there are any ASSP admins out there who use Outlook on a PC.
>
> We're having 2 minor issues with Spam/NotSpam reports sent from Outlook and I'm wondering if it's just our installation or if others are seeing the same thing.  Thomas understandably doesn't want to install Outlook, so I'm turning to you, the admin users of ASSP for some quick help.
>
> Note: we send reports to assp by doing a Forward as Attachment, which preserves the headers.
>
>
> Problem #1: Analyze reports don't work.
> When we send a Spam/NotSpam report, the report itself is saved perfectly in the corpus.  Headers are intact, the message is there.  All is well.  However, if we have Spam and Ham Reports will trigger an additional Analyze Report (DoAdditionalAnalyze) set to send an analyze report, the report gets sent, but it's all wrong.  It seems to analyze the headers of the report itself, not the reported message.  It also almost always triggers and error in the log like:
> Dec-04-16 16:13:51 Warning: DKIM returned 'no domain to fetch policy for '
> (that warning line just ends with a single quote)
>
>
>
> Problem #2: Sending multiple reports in a single message doesn't work correctly
> If we select a couple messages in the inbox and do a forward as attachment to the spam/notspam reporting address, the message that is saves in the corpus seems to be a mime encoded version of the fist message only, the filename is a seemingly random bunch of ASCII characters.  I'm certain that this used to work, but I the last time I texted was years and years ago.  No idea when this stopped working for us.
>
>
>
> Thanks!
>
> Ken
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot_______________________________________________
> Assp-test mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/assp-test


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test


------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today.http://sdm.link/intel
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|

Re: Any Outlook users out there? Reporting / analyze question

Colin

Hi Ken,

 

The majority of our users are Exchange/Outlook based. Is yours Outlook with Exchange or Outlook with POP/IMAP/SMTP?

 

I have never seen problem number 2. Reports including multiple attachments always work so I cannot help with that. We have Office 365, Exchange 2010, Exchange 2013 and now Exchange 2016 and have not seen any issues. Various versions of Outlook too. Have you made sure that you are not including a signature with the report? I’ve seen many instances where signatures cause reports to fail or have odd results so we ensure everyone is instruction to remove them.

 

Problem 1, I have never set DoAdditionalAnalyze before. I have just set it and tried. The report that came through was corrupt. Every line ends in =0D

I saved to an HTML file and stripped them all out.

I can however say that I am seeing the same problem as you. All of the bayes and HMM bad words are out of the headers. The thank you message includes both the actual sender and an [hidden email] address as well from the headers.

 

I have then downloaded the .eml file that ASSP collected from exactly the same message and sent that using Thunderbird. I still see some information from the headers in Bad Words, but much less. To me it looks like the analyse is including the headers for all reports. The problem is more evident in the Outlook message because that includes Exchange receipt and processing headers. IIRC the analysis only works with a set number of lines/bytes at the beginning at the message hence this becomes a bigger problem when using Exchange.


I've done a few preliminary searches directly in the database and I see the exact same entries appearing there which is a little concerning..have you checked your database to confirm if it is just an issue with the analyser for you?

All the best,
Colin.

On 19/12/2016 20:01, K Post wrote:
Thanks for chiming in Andrew!!

This is through an exchange server.  The user enters the address from remembered addresses or by directly entering the internet address (which exchange knows isn't hosted internally).  By "Outlook user" I presume you mean Exchange users as Outlook's just a client and not a server.    I >think< this is all a moot point though as ASSP is getting the message correctly - or correctly enough - to save it as expected in the corrected corpus.  It's just the analyze report that's analyzing the report email itself vs the content of the reported email.  And I've got no idea what's going on when I forward multiple reports as attachments under one email.  No idea how long that's been broken for me.


On Mon, Dec 19, 2016 at 5:44 AM, Andrew Macpherson <[hidden email]> wrote:
Just a thought…. Does Outlook think the mailbox for the report address is an outlook user or an internet mail user?  (Check in the sending address book)

Andrew Macpherson <[hidden email]>
(Twitter @OA5dotCom)

The Old Church, 22-24 Church St, Milnathort, KY13 9XH, GB
Phone tel:<a moz-do-not-send="true" href="tel:%2B441577861848" value="+441577861848">+441577861848 GSM tel:<a moz-do-not-send="true" href="tel:%2B447899961797" value="+447899961797">+447899961797

LEGAL CLAIMER:  Any claims made at this point in a message
are completely invalid as they are presented after the information they
attempt to assert rights over has been disclosed without prior caveat




> On 19 Dec 2016, at 01:09, K Post <[hidden email]> wrote:
>
> Can any of you report back on this?  THANKS
>
> On Sun, Dec 4, 2016 at 4:32 PM, K Post <[hidden email]> wrote:
> I'm curious if there are any ASSP admins out there who use Outlook on a PC.
>
> We're having 2 minor issues with Spam/NotSpam reports sent from Outlook and I'm wondering if it's just our installation or if others are seeing the same thing.  Thomas understandably doesn't want to install Outlook, so I'm turning to you, the admin users of ASSP for some quick help.
>
> Note: we send reports to assp by doing a Forward as Attachment, which preserves the headers.
>
>
> Problem #1: Analyze reports don't work.
> When we send a Spam/NotSpam report, the report itself is saved perfectly in the corpus.  Headers are intact, the message is there.  All is well.  However, if we have Spam and Ham Reports will trigger an additional Analyze Report (DoAdditionalAnalyze) set to send an analyze report, the report gets sent, but it's all wrong.  It seems to analyze the headers of the report itself, not the reported message.  It also almost always triggers and error in the log like:
> Dec-04-16 16:13:51 Warning: DKIM returned 'no domain to fetch policy for '
> (that warning line just ends with a single quote)
>
>
>
> Problem #2: Sending multiple reports in a single message doesn't work correctly
> If we select a couple messages in the inbox and do a forward as attachment to the spam/notspam reporting address, the message that is saves in the corpus seems to be a mime encoded version of the fist message only, the filename is a seemingly random bunch of ASCII characters.  I'm certain that this used to work, but I the last time I texted was years and years ago.  No idea when this stopped working for us.
>
>
>
> Thanks!
>
> Ken
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot_______________________________________________
> Assp-test mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/assp-test


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test



------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today.http://sdm.link/intel


_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test



------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today.http://sdm.link/intel
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test
Reply | Threaded
Open this post in threaded view
|

Re: Any Outlook users out there? Reporting / analyze question

K Post
Thanks Colin so much for testing for me!!

Problem 1- analyze report immediately following spam/notspam emails
I'm excited that I've found someone else with the same problem, and I'm glad that you're not finding the bug to be impacted since you don't use the feature.
The database/corpus looks fine when reports come in, which is really the most important thing.  I've been forced to turn off the DoAdditionalAnalyze, which I miss  -  it was a great way for me as the admin to see what was being reported and act on it if necessary (either removing the erroneous report or improving bombre or something else to better catch errors).

Problem 2-multiple reports attached in one email
That's a good tip about the signature, but there's none on the tests that I've done.  I know this used to work for us, and I have no idea when it broke.  Most users refuse to report anything (and instead complain to me), and multiple reports at once from end users don't seem to happen, so it's really hard for me to guess when this was broken for us.  It's strange, because if I forward say 3 attachments in one email, those 3 messages are extracted properly, they just appear in a single file in errors/spam or errors/notspam and the subject is bonkers.  Not a big deal, since the feature isn't used much, but my problem is that I'm a perfectionist...  

So Thomas, could you revisit #1 now that there's at least 1 other person who has the problem?  We'll call #2 something strange with my setup and move on.
 

On Mon, Dec 19, 2016 at 3:39 PM, Colin <[hidden email]> wrote:

Hi Ken,

 

The majority of our users are Exchange/Outlook based. Is yours Outlook with Exchange or Outlook with POP/IMAP/SMTP?

 

I have never seen problem number 2. Reports including multiple attachments always work so I cannot help with that. We have Office 365, Exchange 2010, Exchange 2013 and now Exchange 2016 and have not seen any issues. Various versions of Outlook too. Have you made sure that you are not including a signature with the report? I’ve seen many instances where signatures cause reports to fail or have odd results so we ensure everyone is instruction to remove them.

 

Problem 1, I have never set DoAdditionalAnalyze before. I have just set it and tried. The report that came through was corrupt. Every line ends in =0D

I saved to an HTML file and stripped them all out.

I can however say that I am seeing the same problem as you. All of the bayes and HMM bad words are out of the headers. The thank you message includes both the actual sender and an [hidden email] address as well from the headers.

 

I have then downloaded the .eml file that ASSP collected from exactly the same message and sent that using Thunderbird. I still see some information from the headers in Bad Words, but much less. To me it looks like the analyse is including the headers for all reports. The problem is more evident in the Outlook message because that includes Exchange receipt and processing headers. IIRC the analysis only works with a set number of lines/bytes at the beginning at the message hence this becomes a bigger problem when using Exchange.


I've done a few preliminary searches directly in the database and I see the exact same entries appearing there which is a little concerning..have you checked your database to confirm if it is just an issue with the analyser for you?

All the best,
Colin.


On 19/12/2016 20:01, K Post wrote:
Thanks for chiming in Andrew!!

This is through an exchange server.  The user enters the address from remembered addresses or by directly entering the internet address (which exchange knows isn't hosted internally).  By "Outlook user" I presume you mean Exchange users as Outlook's just a client and not a server.    I >think< this is all a moot point though as ASSP is getting the message correctly - or correctly enough - to save it as expected in the corrected corpus.  It's just the analyze report that's analyzing the report email itself vs the content of the reported email.  And I've got no idea what's going on when I forward multiple reports as attachments under one email.  No idea how long that's been broken for me.


On Mon, Dec 19, 2016 at 5:44 AM, Andrew Macpherson <[hidden email]> wrote:
Just a thought…. Does Outlook think the mailbox for the report address is an outlook user or an internet mail user?  (Check in the sending address book)

Andrew Macpherson <[hidden email]>
(Twitter @OA5dotCom)

The Old Church, 22-24 Church St, Milnathort, KY13 9XH, GB
Phone tel:<a href="tel:%2B441577861848" value="+441577861848" target="_blank">+441577861848 GSM tel:<a href="tel:%2B447899961797" value="+447899961797" target="_blank">+447899961797

LEGAL CLAIMER:  Any claims made at this point in a message
are completely invalid as they are presented after the information they
attempt to assert rights over has been disclosed without prior caveat




> On 19 Dec 2016, at 01:09, K Post <[hidden email]> wrote:
>
> Can any of you report back on this?  THANKS
>
> On Sun, Dec 4, 2016 at 4:32 PM, K Post <[hidden email]> wrote:
> I'm curious if there are any ASSP admins out there who use Outlook on a PC.
>
> We're having 2 minor issues with Spam/NotSpam reports sent from Outlook and I'm wondering if it's just our installation or if others are seeing the same thing.  Thomas understandably doesn't want to install Outlook, so I'm turning to you, the admin users of ASSP for some quick help.
>
> Note: we send reports to assp by doing a Forward as Attachment, which preserves the headers.
>
>
> Problem #1: Analyze reports don't work.
> When we send a Spam/NotSpam report, the report itself is saved perfectly in the corpus.  Headers are intact, the message is there.  All is well.  However, if we have Spam and Ham Reports will trigger an additional Analyze Report (DoAdditionalAnalyze) set to send an analyze report, the report gets sent, but it's all wrong.  It seems to analyze the headers of the report itself, not the reported message.  It also almost always triggers and error in the log like:
> Dec-04-16 16:13:51 Warning: DKIM returned 'no domain to fetch policy for '
> (that warning line just ends with a single quote)
>
>
>
> Problem #2: Sending multiple reports in a single message doesn't work correctly
> If we select a couple messages in the inbox and do a forward as attachment to the spam/notspam reporting address, the message that is saves in the corpus seems to be a mime encoded version of the fist message only, the filename is a seemingly random bunch of ASCII characters.  I'm certain that this used to work, but I the last time I texted was years and years ago.  No idea when this stopped working for us.
>
>
>
> Thanks!
>
> Ken
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot_______________________________________________
> Assp-test mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/assp-test


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test



------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today.http://sdm.link/intel


_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test



------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today.http://sdm.link/intel
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test



------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today.http://sdm.link/intel
_______________________________________________
Assp-test mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-test