Bug 3917 - CM getting slower when retrieving mail
Summary: CM getting slower when retrieving mail
Status: RESOLVED INVALID
Alias: None
Product: Claws Mail (GTK 2)
Classification: Unclassified
Component: Filtering (show other bugs)
Version: 3.16.0
Hardware: PC Linux
: P3 normal
Assignee: users
URL:
Depends on:
Blocks:
 
Reported: 2017-11-16 06:20 UTC by Pierre Fortin
Modified: 2020-02-17 15:57 UTC (History)
0 users

See Also:


Attachments

Description Pierre Fortin 2017-11-16 06:20:22 UTC
One of my CM instances has been getting slower when retrieving mail from one MTA; and there is no new mail to account for this. The status line indicates 243/243 which is processed quite quickly. Then it switches to 0/17 with "SpamAssassin: filtering message..." which is strange because there is no new mail...

Using --debug, found that after the dry poll, CM starts processing messages in /home/pierre/.claws-mail/tempfolder/processing-3 which contains:
-rw------- 1 pierre pierre  7484 Oct 25 19:33 103
-rw------- 1 pierre pierre  9611 Oct 25 22:19 105
-rw------- 1 pierre pierre  9531 Oct 26 06:49 106
-rw------- 1 pierre pierre  9329 Oct 26 19:42 139
-rw------- 1 pierre pierre  9602 Oct 26 22:19 141
-rw------- 1 pierre pierre  8989 Oct 27 01:37 142
-rw------- 1 pierre pierre  7284 Oct 27 06:34 146
-rw------- 1 pierre pierre  9340 Oct 27 09:35 153
-rw------- 1 pierre pierre  8316 Oct 27 11:00 155
-rw------- 1 pierre pierre 10459 Nov  1 23:51 325
-rw------- 1 pierre pierre  7111 Nov  2 22:55 365
-rw------- 1 pierre pierre  7325 Nov  2 23:49 370
-rw------- 1 pierre pierre  9003 Nov  5 07:22 420
-rw------- 1 pierre pierre  7993 Nov  9 06:33 532
-rw------- 1 pierre pierre  9274 Oct 24 19:57 77
-rw------- 1 pierre pierre 10616 Oct 24 22:31 78
-rw------- 1 pierre pierre  9430 Oct 22 18:40 9

The dates indicate that whatever left these messages hanging around was not a one-time occurrence.  

I'm only seeing this on one account (primary/default) on one instance of CM.

My setup has:
CM#1: 16 accounts -- 11 active 
CM#2: 19 accounts --  7 active  
The primary/default accounts on both instances are with the same MTA.

Moving these 17 messages out of the processing-3 folder makes checking for new mail instantaneous again.

Nothing in any of the other processing-* folders.  

Based on a quick scan of these messages, it is possible they were left as a result of manually filtering (Tools->Filter selected messages...) as described in my msg to the ML on 10/28/17 w/Subject "Filtering spam difference - auto v. manual".  All 17 have sender TLDs that are in the rule mentioned in that msg.

Seems like 2 bugs here:
1. msgs are left in processing-N when bug triggered
2. on every poll, they were sent to sa-learn; but never deleted.

I have not yet reproduced or found a trigger for leaving msgs in processing-N.
Comment 1 Pierre Fortin 2017-12-06 08:33:57 UTC
Noticed CM slowing again... found these in processing-3:
-rw------- 1 pierre pierre 8290 Nov 30 01:03 199
-rw------- 1 pierre pierre 6865 Dec  4 18:02 336
-rw------- 1 pierre pierre 6811 Dec  5 07:00 342

Not sure about the first one; but I did not manually filter over the last 48 hours.  These messages are not in my SPAM folder as directed by the rule:
enabled rulename "SPAM-tld" from regexpcase ".bid>" | from regexpcase ".club>" | from regexpcase ".date>" | from regexpcase ".download>" | from regexpcase ".loan>" | from regexpcase ".site>" | from regexpcase ".stream>" | from regexpcase ".top>" | from regexpcase ".trade>" | from regexpcase ".tv>" | from regexpcase ".win>" color 7 mark_as_spam move "#mh/Mailbox/inbox/SPAM"

Guessing that under some condition(s), something appears to be bailing out of filtering, leaving messages in processing-N...
Comment 2 Pierre Fortin 2017-12-06 08:35:52 UTC
Sorry... forgot to mention that the count this time showed 0/4 which is one too many...
Comment 3 Pierre Fortin 2017-12-31 05:18:03 UTC
Got 3 more messages left in ~/.claws-mail/temfolder/processing-N on 3 different accounts (one each) -- 2 since updating to 3.16.0
Comment 4 Andrej Kacian 2018-01-05 21:07:54 UTC
I too have found four messages in one of the processing-* folders, dated several months ago, so I don't think this is something new in 3.16.0.
Comment 5 Pierre Fortin 2018-01-06 00:57:58 UTC
Right. This bug was opened a full month before 3.16.0  :) 
I don't recall changing the version above; but may have...
Comment 6 Pierre Fortin 2020-02-17 15:51:46 UTC
Has not occurred in a long time.

Note You need to log in before you can comment on or make changes to this bug.