Spam quantity and performance

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
11 messages Options
Reply | Threaded
Open this post in threaded view
|

Spam quantity and performance

Doug Dossett
Is there a point at which the performance of the spam database rebuild
becomes unreasonable based on the number of spam messages being
checked?   I currently have about 44,000 messages stored and growing.
It takes windows explorer a good minute or two to even display the
list of them all.  I'm just wondering if at some point I should delete
out older messages or if assp can handle in the hundreds of thousands
of messages.  I realize this will depend on the power of the machine
as well, but just wondering if there is some limit at which it's
recommended to do some deleting.

Thanks,

Doug Dossett


-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
<a href="http://sel.as-us.falkag.net/sel?cmd=lnk&kid0944&bid$1720&dat1642">http://sel.as-us.falkag.net/sel?cmd=lnk&kid0944&bid$1720&dat1642
_______________________________________________
Assp-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-user
Reply | Threaded
Open this post in threaded view
|

Re: Spam quantity and performance

Micheal Espinola Jr
Eventually yes.  But consider that Windows ability to display a large list of files visually does not have anything directly to do with ASSP's ability to process that list.

On 2/28/06, Doug Dossett <[hidden email]> wrote:
Is there a point at which the performance of the spam database rebuild
becomes unreasonable based on the number of spam messages being
checked?   I currently have about 44,000 messages stored and growing.
It takes windows explorer a good minute or two to even display the
list of them all.  I'm just wondering if at some point I should delete
out older messages or if assp can handle in the hundreds of thousands
of messages.  I realize this will depend on the power of the machine
as well, but just wondering if there is some limit at which it's
recommended to do some deleting.

Thanks,

Doug Dossett


-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
<a href="http://sel.as-us.falkag.net/sel?cmdlnk&amp;kid0944&amp;bid$1720&amp;dat1642">http://sel.as-us.falkag.net/sel?cmdlnk&kid0944&bid$1720&dat1642
_______________________________________________
Assp-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-user



--
ME2
Reply | Threaded
Open this post in threaded view
|

Re: Spam quantity and performance

Melvin Backus
I very well may have mis-understood the docs, but doesn't the maxfiles setting cause assp to purge the older files as it writes new ones and thus limit the total number available?

At 12:52 PM 2/28/2006, you wrote:
Eventually yes.  But consider that Windows ability to display a large list of files visually does not have anything directly to do with ASSP's ability to process that list.

On 2/28/06, Doug Dossett <[hidden email]> wrote:
Is there a point at which the performance of the spam database rebuild
becomes unreasonable based on the number of spam messages being
checked?   I currently have about 44,000 messages stored and growing.
It takes windows explorer a good minute or two to even display the
list of them all.  I'm just wondering if at some point I should delete
out older messages or if assp can handle in the hundreds of thousands
of messages.  I realize this will depend on the power of the machine
as well, but just wondering if there is some limit at which it's
recommended to do some deleting.

Thanks,

Doug Dossett


-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
<a href="http://sel.as-us.falkag.net/sel?cmdlnk&amp;kid&#017;0944&amp;bid$1720&amp;dat&#018;1642">http://sel.as-us.falkag.net/sel?cmdlnk&kid0944&bid$1720&dat1642
_______________________________________________
Assp-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-user




--
ME2
Reply | Threaded
Open this post in threaded view
|

Re: Spam quantity and performance

Micheal Espinola Jr
Yes.  I didn't mean to imply that you would have to manually delete the files.

On 2/28/06, Melvin Backus <[hidden email]> wrote:
I very well may have mis-understood the docs, but doesn't the maxfiles setting cause assp to purge the older files as it writes new ones and thus limit the total number available?

At 12:52 PM 2/28/2006, you wrote:
Eventually yes.  But consider that Windows ability to display a large list of files visually does not have anything directly to do with ASSP's ability to process that list.

On 2/28/06, Doug Dossett <[hidden email]> wrote:
Is there a point at which the performance of the spam database rebuild
becomes unreasonable based on the number of spam messages being
checked?   I currently have about 44,000 messages stored and growing.
It takes windows explorer a good minute or two to even display the
list of them all.  I'm just wondering if at some point I should delete
out older messages or if assp can handle in the hundreds of thousands
of messages.  I realize this will depend on the power of the machine
as well, but just wondering if there is some limit at which it's
recommended to do some deleting.

Thanks,

Doug Dossett


-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
<a onclick="return top.js.OpenExtLink(window,event,this)" href="http://sel.as-us.falkag.net/sel?cmdlnk&amp;kid%110944&amp;bid$1720&amp;dat%121642" target="_blank">http://sel.as-us.falkag.net/sel?cmdlnk&kid0944&bid$1720&dat1642
_______________________________________________
Assp-user mailing list
[hidden email]
<a onclick="return top.js.OpenExtLink(window,event,this)" href="https://lists.sourceforge.net/lists/listinfo/assp-user" target="_blank">https://lists.sourceforge.net/lists/listinfo/assp-user




--
ME2



--
ME2
Reply | Threaded
Open this post in threaded view
|

Re: Spam quantity and performance

Melvin Backus
Thanks.  I thought I read it correctly, but lately it seems I've thought that a lot and been wrong. :)

At 01:56 PM 2/28/2006, you wrote:
Yes.  I didn't mean to imply that you would have to manually delete the files.

On 2/28/06, Melvin Backus <[hidden email]> wrote:
I very well may have mis-understood the docs, but doesn't the maxfiles setting cause assp to purge the older files as it writes new ones and thus limit the total number available?

At 12:52 PM 2/28/2006, you wrote:
Eventually yes.  But consider that Windows ability to display a large list of files visually does not have anything directly to do with ASSP's ability to process that list.

On 2/28/06, Doug Dossett <[hidden email]> wrote:
Is there a point at which the performance of the spam database rebuild
becomes unreasonable based on the number of spam messages being
checked?   I currently have about 44,000 messages stored and growing.
It takes windows explorer a good minute or two to even display the
list of them all.  I'm just wondering if at some point I should delete
out older messages or if assp can handle in the hundreds of thousands
of messages.  I realize this will depend on the power of the machine
as well, but just wondering if there is some limit at which it's
recommended to do some deleting.
Thanks,
Doug Dossett

-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmdlnk&kid0944&bid$1720&dat1642
_______________________________________________
Assp-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-user




--
ME2




--
ME2
Reply | Threaded
Open this post in threaded view
|

Re: Spam quantity and performance

Doug Dossett
Unfortunately that setting doesn't work if you're using subjects as
the file name, which I am.  But at least I know I can delete on
occassion.  Thanks for the responses.

On 2/28/06, Melvin Backus <[hidden email]> wrote:

>  Thanks.  I thought I read it correctly, but lately it seems I've thought
> that a lot and been wrong. :)
>
>
>  At 01:56 PM 2/28/2006, you wrote:
>
> Yes.  I didn't mean to imply that you would have to manually delete the
> files.
>
>  On 2/28/06, Melvin Backus <[hidden email]> wrote:
>  I very well may have mis-understood the docs, but doesn't the maxfiles
> setting cause assp to purge the older files as it writes new ones and thus
> limit the total number available?
>
>  At 12:52 PM 2/28/2006, you wrote:
>
>  Eventually yes.  But consider that Windows ability to display a large list
> of files visually does not have anything directly to do with ASSP's ability
> to process that list.
>
>  On 2/28/06, Doug Dossett <[hidden email]> wrote: Is there a point
> at which the performance of the spam database rebuild becomes unreasonable
> based on the number of spam messages being checked?   I currently have about
> 44,000 messages stored and growing. It takes windows explorer a good minute
> or two to even display the list of them all.  I'm just wondering if at some
> point I should delete out older messages or if assp can handle in the
> hundreds of thousands of messages.  I realize this will depend on the power
> of the machine as well, but just wondering if there is some limit at which
> it's recommended to do some deleting.
>  Thanks,
>  Doug Dossett
>
>  -------------------------------------------------------
> This SF.Net email is sponsored by xPML, a groundbreaking scripting language
> that extends applications into web and mobile media. Attend the live webcast
> and join the prime developer group breaking into this new coding territory!
> http://sel.as-us.falkag.net/sel?cmdlnk&kid0944&bid$1720&dat1642
> _______________________________________________ Assp-user
> mailing list [hidden email]
> https://lists.sourceforge.net/lists/listinfo/assp-user
>
>
>
>
>  --
>  ME2
>
>
>
>  --
>  ME2


-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
<a href="http://sel.as-us.falkag.net/sel?cmd=lnk&kid0944&bid$1720&dat1642">http://sel.as-us.falkag.net/sel?cmd=lnk&kid0944&bid$1720&dat1642
_______________________________________________
Assp-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-user
Reply | Threaded
Open this post in threaded view
|

Re: Spam quantity and performance

Micheal Espinola Jr
Why are you using subjects as file names?

On 2/28/06, Doug Dossett <[hidden email]> wrote:
Unfortunately that setting doesn't work if you're using subjects as
the file name, which I am.  But at least I know I can delete on
occassion.  Thanks for the responses.

On 2/28/06, Melvin Backus <[hidden email]> wrote:

>  Thanks.  I thought I read it correctly, but lately it seems I've thought
> that a lot and been wrong. :)
>
>
>  At 01:56 PM 2/28/2006, you wrote:
>
> Yes.  I didn't mean to imply that you would have to manually delete the
> files.
>
>  On 2/28/06, Melvin Backus < [hidden email]> wrote:
>  I very well may have mis-understood the docs, but doesn't the maxfiles
> setting cause assp to purge the older files as it writes new ones and thus
> limit the total number available?
>
>  At 12:52 PM 2/28/2006, you wrote:
>
>  Eventually yes.  But consider that Windows ability to display a large list
> of files visually does not have anything directly to do with ASSP's ability
> to process that list.
>
>  On 2/28/06, Doug Dossett <[hidden email]> wrote: Is there a point
> at which the performance of the spam database rebuild becomes unreasonable
> based on the number of spam messages being checked?   I currently have about
> 44,000 messages stored and growing. It takes windows explorer a good minute
> or two to even display the list of them all.  I'm just wondering if at some
> point I should delete out older messages or if assp can handle in the
> hundreds of thousands of messages.  I realize this will depend on the power
> of the machine as well, but just wondering if there is some limit at which
> it's recommended to do some deleting.
>  Thanks,
>  Doug Dossett
>
>  -------------------------------------------------------
> This SF.Net email is sponsored by xPML, a groundbreaking scripting language
> that extends applications into web and mobile media. Attend the live webcast
> and join the prime developer group breaking into this new coding territory!
> http://sel.as-us.falkag.net/sel?cmdlnk&kid0944&bid$1720&dat1642
> _______________________________________________ Assp-user
> mailing list [hidden email]
> https://lists.sourceforge.net/lists/listinfo/assp-user
>
>
>
>
>  --
>  ME2
>
>
>
>  --
>  ME2


-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
<a href="http://sel.as-us.falkag.net/sel?cmdlnk&amp;kid0944&amp;bid$1720&amp;dat1642">http://sel.as-us.falkag.net/sel?cmdlnk&kid0944&bid$1720&dat1642
_______________________________________________
Assp-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-user



--
ME2
Reply | Threaded
Open this post in threaded view
|

Re: Spam quantity and performance

Doug Dossett
Just to make it a little easier to find false positives.  Though with
over 40,000 emails in there, I don't know how much it's really
helping.

On 2/28/06, Micheal Espinola Jr <[hidden email]> wrote:

> Why are you using subjects as file names?
>
>
> On 2/28/06, Doug Dossett <[hidden email]> wrote:
> >
> > Unfortunately that setting doesn't work if you're using subjects as
> > the file name, which I am.  But at least I know I can delete on
> > occassion.  Thanks for the responses.
> >
> > On 2/28/06, Melvin Backus <[hidden email]> wrote:
> > >  Thanks.  I thought I read it correctly, but lately it seems I've
> thought
> > > that a lot and been wrong. :)
> > >
> > >
> > >  At 01:56 PM 2/28/2006, you wrote:
> > >
> > > Yes.  I didn't mean to imply that you would have to manually delete the
> > > files.
> > >
> > >  On 2/28/06, Melvin Backus < [hidden email]> wrote:
> > >  I very well may have mis-understood the docs, but doesn't the maxfiles
> > > setting cause assp to purge the older files as it writes new ones and
> thus
> > > limit the total number available?
> > >
> > >  At 12:52 PM 2/28/2006, you wrote:
> > >
> > >  Eventually yes.  But consider that Windows ability to display a large
> list
> > > of files visually does not have anything directly to do with ASSP's
> ability
> > > to process that list.
> > >
> > >  On 2/28/06, Doug Dossett <[hidden email]> wrote: Is there a
> point
> > > at which the performance of the spam database rebuild becomes
> unreasonable
> > > based on the number of spam messages being checked?   I currently have
> about
> > > 44,000 messages stored and growing. It takes windows explorer a good
> minute
> > > or two to even display the list of them all.  I'm just wondering if at
> some
> > > point I should delete out older messages or if assp can handle in the
> > > hundreds of thousands of messages.  I realize this will depend on the
> power
> > > of the machine as well, but just wondering if there is some limit at
> which
> > > it's recommended to do some deleting.
> > >  Thanks,
> > >  Doug Dossett
> > >
> > >
> -------------------------------------------------------
> > > This SF.Net email is sponsored by xPML, a groundbreaking scripting
> language
> > > that extends applications into web and mobile media. Attend the live
> webcast
> > > and join the prime developer group breaking into this new coding
> territory!
> > >
> http://sel.as-us.falkag.net/sel?cmdlnk&kid0944&bid$1720&dat1642
> > > _______________________________________________
> Assp-user
> > > mailing list [hidden email]
> > > https://lists.sourceforge.net/lists/listinfo/assp-user
> > >
> > >
> > >
> > >
> > >  --
> > >  ME2
> > >
> > >
> > >
> > >  --
> > >  ME2
> >
> >
> > -------------------------------------------------------
> > This SF.Net email is sponsored by xPML, a groundbreaking scripting
> language
> > that extends applications into web and mobile media. Attend the live
> webcast
> > and join the prime developer group breaking into this new coding
> territory!
> >
> <a href="http://sel.as-us.falkag.net/sel?cmdlnk&kid0944&bid$1720&dat1642">http://sel.as-us.falkag.net/sel?cmdlnk&kid0944&bid$1720&dat1642
> > _______________________________________________
> > Assp-user mailing list
> > [hidden email]
> > https://lists.sourceforge.net/lists/listinfo/assp-user
> >
>
>
>
> --
> ME2


-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
<a href="http://sel.as-us.falkag.net/sel?cmd=lnk&kid0944&bid$1720&dat1642">http://sel.as-us.falkag.net/sel?cmd=lnk&kid0944&bid$1720&dat1642
_______________________________________________
Assp-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-user
Reply | Threaded
Open this post in threaded view
|

RE: Spam quantity and performance

Dickson, Paul
In reply to this post by Doug Dossett
During the first parts of the training faze, where I wasn't still sure I
wanted to use it and didn't want to put our 3000 users through learning
how to report spam until I was sure, I had all spam CC'ed to a specific
mailbox, then sorted that mailbox by subject.  It was really easy to
send false positives to 'whitelist' from there, and delete the rest with
minimal time allocation.  Between that and the auto-whitelisting, and
rebuildspamdb.pl referencing the Whitelist while rebuilding, it should
be cake for you.

-----Original Message-----
From: [hidden email]
[mailto:[hidden email]] On Behalf Of Doug Dossett
Sent: Tuesday, February 28, 2006 2:37 PM
To: [hidden email]
Subject: Re: [Assp-user] Spam quantity and performance

Just to make it a little easier to find false positives.  Though with
over 40,000 emails in there, I don't know how much it's really
helping.

On 2/28/06, Micheal Espinola Jr <[hidden email]> wrote:

> Why are you using subjects as file names?
>
>
> On 2/28/06, Doug Dossett <[hidden email]> wrote:
> >
> > Unfortunately that setting doesn't work if you're using subjects as
> > the file name, which I am.  But at least I know I can delete on
> > occassion.  Thanks for the responses.
> >
> > On 2/28/06, Melvin Backus <[hidden email]> wrote:
> > >  Thanks.  I thought I read it correctly, but lately it seems I've
> thought
> > > that a lot and been wrong. :)
> > >
> > >
> > >  At 01:56 PM 2/28/2006, you wrote:
> > >
> > > Yes.  I didn't mean to imply that you would have to manually
delete the
> > > files.
> > >
> > >  On 2/28/06, Melvin Backus < [hidden email]> wrote:
> > >  I very well may have mis-understood the docs, but doesn't the
maxfiles
> > > setting cause assp to purge the older files as it writes new ones
and
> thus
> > > limit the total number available?
> > >
> > >  At 12:52 PM 2/28/2006, you wrote:
> > >
> > >  Eventually yes.  But consider that Windows ability to display a
large
> list
> > > of files visually does not have anything directly to do with
ASSP's
> ability
> > > to process that list.
> > >
> > >  On 2/28/06, Doug Dossett <[hidden email]> wrote: Is there
a
> point
> > > at which the performance of the spam database rebuild becomes
> unreasonable
> > > based on the number of spam messages being checked?   I currently
have
> about
> > > 44,000 messages stored and growing. It takes windows explorer a
good
> minute
> > > or two to even display the list of them all.  I'm just wondering
if at
> some
> > > point I should delete out older messages or if assp can handle in
the
> > > hundreds of thousands of messages.  I realize this will depend on
the
> power
> > > of the machine as well, but just wondering if there is some limit
at

> which
> > > it's recommended to do some deleting.
> > >  Thanks,
> > >  Doug Dossett
> > >
> > >
> -------------------------------------------------------
> > > This SF.Net email is sponsored by xPML, a groundbreaking scripting
> language
> > > that extends applications into web and mobile media. Attend the
live

> webcast
> > > and join the prime developer group breaking into this new coding
> territory!
> > >
> http://sel.as-us.falkag.net/sel?cmdlnk&kid0944&bid$1720&dat1642
> > > _______________________________________________
> Assp-user
> > > mailing list [hidden email]
> > > https://lists.sourceforge.net/lists/listinfo/assp-user
> > >
> > >
> > >
> > >
> > >  --
> > >  ME2
> > >
> > >
> > >
> > >  --
> > >  ME2
> >
> >
> > -------------------------------------------------------
> > This SF.Net email is sponsored by xPML, a groundbreaking scripting
> language
> > that extends applications into web and mobile media. Attend the live
> webcast
> > and join the prime developer group breaking into this new coding
> territory!
> >
> <a href="http://sel.as-us.falkag.net/sel?cmdlnk&kid0944&bid$1720&dat1642">http://sel.as-us.falkag.net/sel?cmdlnk&kid0944&bid$1720&dat1642
> > _______________________________________________
> > Assp-user mailing list
> > [hidden email]
> > https://lists.sourceforge.net/lists/listinfo/assp-user
> >
>
>
>
> --
> ME2


-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting
language
that extends applications into web and mobile media. Attend the live
webcast
and join the prime developer group breaking into this new coding
territory!
<a href="http://sel.as-us.falkag.net/sel?cmd=k&kid0944&bid$1720&dat1642">http://sel.as-us.falkag.net/sel?cmd=k&kid0944&bid$1720&dat1642
_______________________________________________
Assp-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-user


-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
<a href="http://sel.as-us.falkag.net/sel?cmd=lnk&kid0944&bid$1720&dat1642">http://sel.as-us.falkag.net/sel?cmd=lnk&kid0944&bid$1720&dat1642
_______________________________________________
Assp-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-user
Reply | Threaded
Open this post in threaded view
|

Re: Spam quantity and performance

Fritz Borgstedt
In reply to this post by Doug Dossett

>Just to make it a little easier to find false positives

Just forget that. Switch to numbers as filenames. Use CopyAllSpam to
see the false positives and report them to error spam and whitelist.
If it is on the whitelist rebuildspamdb will remove the false positive.



-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642
_______________________________________________
Assp-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-user
Reply | Threaded
Open this post in threaded view
|

Re: Spam quantity and performance

Doug Dossett
Thanks, I'll give that a try.

On 2/28/06, Fritz Borgstedt <[hidden email]> wrote:

>
> >Just to make it a little easier to find false positives
>
> Just forget that. Switch to numbers as filenames. Use CopyAllSpam to
> see the false positives and report them to error spam and whitelist.
> If it is on the whitelist rebuildspamdb will remove the false positive.
>
>
>
> -------------------------------------------------------
> This SF.Net email is sponsored by xPML, a groundbreaking scripting language
> that extends applications into web and mobile media. Attend the live webcast
> and join the prime developer group breaking into this new coding territory!
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642
> _______________________________________________
> Assp-user mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/assp-user
>


-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
<a href="http://sel.as-us.falkag.net/sel?cmd=lnk&kid0944&bid$1720&dat1642">http://sel.as-us.falkag.net/sel?cmd=lnk&kid0944&bid$1720&dat1642
_______________________________________________
Assp-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/assp-user