Reply to topic

Kmail: Find Messages finds NOTHING!

User avatar einar
Administrator
Posts
2269
Karma
5
OS
Check if you have idle detection enabled (akonadiconsole -> Nepomuk Feeder -> Configure): if so, mails will *only* be indexed when your computer is idle. You can, in 4.10, force a reindexing of the folder by right clicking on it, selecting Properties, then pushing "Force reindexing" in the Maintenance tab.


"Violence is the last refuge of the incompetent."
Image
Plasma FAQ maintainer - Plasma programming with Python
mreed
Registered Member
Posts
10
Karma
0
By idle detection I presume you're referring to

akonadiconsole -> Akonadi Nepomuk Feeder -> Configure Local -> Disable Idle Timeout

The idle timeout was 120s. I checked the "Disable Idle Timeout" box and clicked okay. I suspect that my system is seldom idle.

I then open the Nepomuk Controller and observed that file indexing was suspended. I clicked the "resume file indexing" box. Display changes to "scanning for recent changes in files for desktop search." I click close. In "top" I observe nepomukservices and virtuoso-t consuming approximately 150% of 200% available cpu. There's lots of disk activity. In a few minutes the controller window begins to show my Maildir files being indexed and cpu utilization down to a little over 100%! So, I wait. (I've got over 5GB and 162,000 files in my Maildir. Based upon the file count, the email hadn't really previously been indexed as the controller showed only 78,000 files in the index. When done I'll expect north of 200,000 files in the index.)

While I wait, back at akonadiconsole, the akonadi nepomuk feeder shows "system busy, indexing suspended." I quit and restarted akonadiconsole. The status remains the same.

--

More on my config history. I run a local imap server so that I can use my laptop to access my email when I'm in meetings. kmail fetches email from pop3 account, placed in an imap inbox, and then filtered to other imap folders. Disconnected mode is disabled for the imap account as the email is already on my workstation (accessed via imap server). It just somehow seems wrong to want to store 5GB of email two times.

I had been using Thunderbird and the "suse" imap program using mbox files. This combination worked fine. As kmail was reported to work better using maildir, I migrated to dovecot v2. I've configured dovecot to use the file system format. The migration tool created folder names in Maildir beginning with ".". This is how I started. I noticed things weren't indexing, so I renamed the folders within kmail, removing the leading ".".

Another interesting (to me, anyway) tidbit is, based upon advice about "force reindexing", I examined a small folder (475 MB) and the properties indicated it had last been reindexed o Apr 1st. I tried a search on a subject word within that folder and kmail continued to find nothing. At some point I clicked on the force reindexing box. It still shows as indexed April 1st.

But, things appear to be indexing at the moment, so it's a start. And... I continue to wait.

So, I've still got a question. How do I tell if kmail is actually trying to access the database? My email is on IMAP and a local copy is not stored on the machine, i.e., "enable disconnected mode" is not checked for the imap account. Further, how do I tell what's actually been index? Is there an interface to desktop search that I can use to see what's there?

-- Indexing complete! Only took 4+ hours!

Aside: You know, it just seems like an inefficient process when it literally takes hours to index my email, with the system running pretty hard in the process, just so that I can do a few random searches on a folder, maybe, once a day. There needs to be a "simple" search option bypassing nepomuk that pulls message bodies from the imap server in real time and uses, oh, maybe grep, to look for possible hits on the search term. This simple search might take longer on slow connections, but would be robust. Setting a date range for the search would speed things up. Further, having to wait for indexing software to run against a folder with new messages results in a gap of

So, anyway, sorry 'bout the book. With the search complete, akonadaiconsole still shows indexing suspended. so, I clicked on "restart" and now it's indexing something called "notes". I haven't actually created any notes... So, I now get to wait. Again. ... It's been five minutes and still no progress on indexing "notes". Still 0%. Being impatient at this point I've clicked on "abort" and it won't. Nepomuk/virtuoso-t is consuming about one core on my two core system at the moment. I suppose I can log out and back in.

I'm going to post this and provide more info on whether I can get nepomuk feeder unstuck at a later time. But, hey, at least I saw nepomuk index my Maildir!
mreed
Registered Member
Posts
10
Karma
0
After reboot I started akonadiconsole and it shows the nepomuk feeder is waiting for the nepomuk server to start. The nepomuk controller is scanning for changes in files for search. After a few minutes, akonadiconsole reports "nepomuk is not operational: nepomuk is not running". Is it waiting for the scan for changed files to complete before it can become "operational"? And, nepomukservices / virtuoso-t is consuming 100% of a cpu, most of it virtuoso-t. Gee, I guess nepomuk/virtuoso-t is the open source equivalent of the next Windows release. Both require hardware upgrades to work efficiently! :)

And I wait. :z

I guess I should ask, is this the right forum to actually diagnose what's wrong?

Oh well, more tomorrow.
User avatar einar
Administrator
Posts
2269
Karma
5
OS
The latter sympthom is a bug that's already reported ( https://bugs.kde.org/show_bug.cgi?id=315985 ). However its occurrence is spotty as best (works for me, but doesn't for some of the reporters there).
There are pending changes for this part of KDE PIM, they were about to get merged in for 4.10.2 but ultimately it was decided they were too intrusive to be added in at the last moment, so they should be there for 4.10.3.


"Violence is the last refuge of the incompetent."
Image
Plasma FAQ maintainer - Plasma programming with Python
mreed
Registered Member
Posts
10
Karma
0
With regard to bug 315985, once the startup overhead associated with Nepomuk / virtuoso-t stopped (i.e., when I came in today), I selected the feeder in akonadiconsole, clicked "restart" andd the feeder detected the service and started indexing various collections. Then it got to "Indexing collection 'akonadi_ical_resource_1'...(99%)" and has been stuck at 99% for 20 minutes. Nepomuk controller indicates indexer is idle. virtuoso-t is between 75% and 100% cpu. nepomukservices is between 2% and 10%. akonadi_nepomuk and akonadi_server shows up in the "top" output every once in the while. The "restart" button is greyed out, which makes sense to me as I'd clicked restart and it's probably not finished restarting.

My "std.ics" file is 475k.

So, I wait! :) I'll report back if/when it gets past ical_resource_1 or I give up and restart things.
mreed
Registered Member
Posts
10
Karma
0
I used korganizer to archive / delete entries from prior years. My calendar shrunk to 185k. :) I restarted the system. The feeder again didn't recognize that nepomuk services were running. I restarted it. And it's stuck at almost the same point as last time. It's indexing collection akonadi_ical_resource_1, but is only at (0%). And virtuoso-t is again consume almost all of my system.

I may try to remove the calendar collection and see if I can get the feeder up and running.

If nothing else, this makes for cheap entertainment!
mreed
Registered Member
Posts
10
Karma
0
Okay. Removed my local ical calendar resource. Feeder now gets stuck (at 68%) trying to index a remote google calendar resource. And virtuoso-t contiues to consume 75-100% of a cpu.

Is there any way to figure out just what's going on? Or perhaps to get feeder to not try to index calendar resources?

SUSE just released some updated 4.10 rpms. akonadi, kdepim4, kmail, korganizer, etc. Probably wouldn't hurt to try updating to these.
mreed
Registered Member
Posts
10
Karma
0
Okay... I actually had an email search work this time. Two interesting things. Following reboot, the nepomuk controller reported that search hadn't started. I went into akonadiconsole and verified that feeder was waiting for nepomuk. I clicked restart. With all of my google and local calendar resources disabled, feeder actually got through indexing. As this was a first, I fired up kmail and did a search. Wonder of wonders, search worked!

So, I'm going to speculate that "Find Messages finds NOTHING!" is related to feeder not being able to complete indexing.

There you have it! Now, anyone have any suggestions on how to get feeder / nepomuk to play happy together with all resources enabled? Or perhaps there's a way to configure feeder so that it will only index a selected subset of resources...

Progress!

So, last thing after the above was to update to the latest packages made available from SUSE. They seem to be 4.10.2, release 553, based. After a reboot, as I have desktop search working (for how long I don't know), I went back in and enabled my calendars and rebooted again. I still have the problem of feeder waiting for nepomuk server, but being patient and clicking restart seems to always work. This time, it didn't appear to try to index my enabled calendars. It went straight to "ready to index data". So, I tried search again and it still works.

I can at least work with having to restart feeder.

Hopefully all the long posts above offer some clues to those needing to get search working and to the KDE team on where a complete fix (feeder - nepomuk server startup interaction) might go.

I'll follow up if my issues return. Thanks for the help in getting email search working in my environment!

And now I rest!
User avatar xywa
Registered Member
Posts
47
Karma
0
OS
Hi,

I use kmail/kontact 4.10.3 and function [Find Messages...] still doesn't work. I did all what it was said in this topic. Help! I need to find an email...
User avatar xywa
Registered Member
Posts
47
Karma
0
OS
Hi,

My search fuction still doesnt work, and now I have kmail 4.11. Now, when I click [Find Messages...] there is an information:
The nepomuk service is not available. Searching is not possible without it. You can enable it in "System Settings".

but... in "System Settings" everything is enabled, however there are messages "File indexing service is not running" and "Email indexing service is suspended".

What is wrong and how to fix it?
mutterburra
Registered Member
Posts
7
Karma
0
Hi,

My search fuction still doesnt work, and now I have kmail 4.11. Now, when I click [Find Messages...] there is an information:

The nepomuk service is not available. Searching is not possible without it. You can enable it in "System Settings".


but... in "System Settings" everything is enabled, however there are messages "File indexing service is not running" and "Email indexing service is suspended".

What is wrong and how to fix it?


me too, nepomuk seems to be working in Dolphin on my Kubuntu iinstallation just fine, but no luck within Kmail within Kontact, just lots of messages about how I need to turn nepumuk on in systems settings (it is on, it is indexing my whole home folder except some hidden folders, I guess this is the default).

email indexer in system settings is ennabled.

I do not often search within Kmail and am not sure if it worked before upgrading Kubuntu to 13.04, but I think it did.

Do I need to speerately upgrade Kontact? to?
mutterburra
Registered Member
Posts
7
Karma
0
ok, after some more googling II've tried the following to get past the system setting messages....

In my specific case I suspended indexing, modified the folders to be indexed (you could create a dummy folder to toggle indexing for that purpose perhaps), applied the setting then set indexing to resume.

This is done in System Settings-->Desktop Search (nepomuk server config)-->Basic Settings tab (turn off file indexing) -->apply

then follow the advice above in System Settings-->Desktop Search (nepomuk server config)-->Indexing Setting --> the customize folders button ---> apply

then back to System Settings-->Desktop Search (nepomuk server config)-->Basic Settings tab (turn ON file indexing) ---> apply

i go the message "Scanning for recent changes in files for desktop search."

Going back to Kontact and Kmail , back soon after a re-start (currently still recieving the please turn Nepomuk on in settings messages).

Okay no change in Kmail. Edit-->Find Messages still returns the message "The Nepomuk semantic search service is not available. Searching is not possible without it. You can enable it in "System Settings"."

In basic settings for desktop search as follows
Image
User avatar xywa
Registered Member
Posts
47
Karma
0
OS
Did not help for me... :|
Anyway looks like indexing for kmail should work - see bellow:

Image
third time\'s a charm?
Registered Member
Posts
2
Karma
0
I see there hasn't been activity in this thread for a while, are these problems resolved or have they been given up on? Has this been moved to another thread?

I've been experiencing the "kmail search just does not work" and the "Akonadi Nepomuk feeder: system busy indexing suspended" problem, too (KDE 4.8.5). Is there a solution less drastic than "use Thunderbird"?
User avatar einar
Administrator
Posts
2269
Karma
5
OS
See this KDE Dot News story for improvements on searching: http://dot.kde.org/2014/02/24/kdes-next ... tic-search


"Violence is the last refuge of the incompetent."
Image
Plasma FAQ maintainer - Plasma programming with Python

 
Reply to topic

Bookmarks



Who is online

Registered users: AGB, Alexa [Bot], anditosan, Baidu [Spider], Bing [Bot], Blingy, bshah, Charblaze, Exabot [Bot], franku, garthecho, Google [Bot], google01103, jgrulich, joshaughnessy, ken300, koriun, La Ninje, lazyit, Majestic-12 [Bot], mtvee, ooker, renatoatilio, rulet111, scummos, Sentynel, Steve Guilford, verbalshadow, vylaern, Wiz, Yahoo [Bot]