This forum has been archived. All content is frozen. Please use KDE Discuss instead.

collection database cleanup

Tags: None
(comma "," separated)
dovydas
Registered Member
Posts
3
Karma
0

collection database cleanup

Fri Sep 08, 2006 8:57 pm
I would like to have a tool for collection database clean-up.

I have a relatively large colection with 17 000+ songs. Database file is 14,5 MB size and amaroK after 0,5 years of database creation got very slow. There is a 0,5 - 1 sec delay on every search. Half a year ago amaroK was instant!!
I removed database file and created new collection. Database file was 12 MB size now and amaroK was realy faster. Apparently I have lost all my statistics, ratings and scores.

I restored old database file and check it with raw hex viewer. And I found TONS of records of songs and albums I have deleted ages ago!! I did rescan-collection many times, but it seems that amaroK doesn't remove records about non-existant files from database. I think it would be useful to have some tool for database cleaning up and riding off records about non existant files. amaroK would be really faster for me and for all of us. That 0,5 sec delay on every search really annoys me.
marshalle
Registered Member
Posts
16
Karma
0

Re: collection database cleanup

Wed Oct 11, 2006 5:17 am
I agree, this would be a welcome addition, no doubt there's something you could do on the actual database but to make it easy, why not put it in an admin settings section.  While we're at it, it would be great to have a backup option for those statistics perhaps with selectable backup options such as covers, stats etc.  Those two items together would be awesome!  No more losing stats, data, rescanning covers etc!  Yeeha!
User avatar
markey
KDE Developer
Posts
2286
Karma
3
OS

Re: collection database cleanup

Wed Oct 11, 2006 6:33 am
You did not mention what kind of database backend you are using, but if it's SQLite, you should definitely switch to MySQL or Postgres. SQLite does not currently scale very well with big collections.


--
Mark Kretschmann - Amarok Developer
User avatar
deloco
Registered Member
Posts
71
Karma
0

Re: collection database cleanup

Sat Oct 14, 2006 6:17 am
How do I use MySQL?
Do I have to set up a MySQL-Server?
How do I do that?
Should I use MySQL with about 4000 Songs or or should I stay with SQLite?


MacBook, 2GHz C2D, 3GB RAMM, 120GB HDD.

Amarok 2.0 Beta from KDE-on-Mac.
User avatar
markey
KDE Developer
Posts
2286
Karma
3
OS

Re: collection database cleanup

Sat Oct 14, 2006 6:56 am
deloco wrote:Should I use MySQL with about 4000 Songs or or should I stay with SQLite?


4000 tracks is not so much. SQLite should be fine.


--
Mark Kretschmann - Amarok Developer
User avatar
deloco
Registered Member
Posts
71
Karma
0

Re: collection database cleanup

Sat Oct 14, 2006 1:30 pm
So at what Track-count you recommend using MySQL?
When I add my Audiobooks to my Collection it's about 5000 Tracks, I believe it's not so much either is it?


MacBook, 2GHz C2D, 3GB RAMM, 120GB HDD.

Amarok 2.0 Beta from KDE-on-Mac.
marshalle
Registered Member
Posts
16
Karma
0

Re: collection database cleanup

Sun Oct 15, 2006 8:49 pm
That's a good point actually, it would be nice if there was a track count recommendation on the initial setup screen so we knew when to use each type of database.
User avatar
markey
KDE Developer
Posts
2286
Karma
3
OS

Re: collection database cleanup

Mon Oct 16, 2006 6:42 am
It's hard to say. Rule of thumb: If your collection is bigger than 10000 tracks, you might consider trying MySQL or PostgreSQL.


--
Mark Kretschmann - Amarok Developer
User avatar
deloco
Registered Member
Posts
71
Karma
0

Re: collection database cleanup

Mon Oct 16, 2006 6:47 am
Okay... Till I got 10000 Tracks it will take a while... So I'll stay with SQLite... Thanks so far.


MacBook, 2GHz C2D, 3GB RAMM, 120GB HDD.

Amarok 2.0 Beta from KDE-on-Mac.
nonor
Registered Member
Posts
5
Karma
0

Re: collection database cleanup

Thu Oct 19, 2006 8:12 pm
And what about the difference between mysql and postgresql with ~10000 tracks ? Any idea ?
User avatar
markey
KDE Developer
Posts
2286
Karma
3
OS

Re: collection database cleanup

Mon Oct 23, 2006 12:01 pm
nonor wrote:And what about the difference between mysql and postgresql with ~10000 tracks ? Any idea ?


Nope, no idea. Be the first to find out :)


(PostgreSQL is often said to be the better database, though)


--
Mark Kretschmann - Amarok Developer
kraymer
Registered Member
Posts
14
Karma
0

Re: collection database cleanup

Sat Nov 11, 2006 5:50 pm
Does MySQL or Postgresql solve the problem of non existant files being kept in database ?


Bookmarks



Who is online

Registered users: Bing [Bot], Google [Bot], lockheed, Sogou [Bot]