Skip to main content

iTunes Dupe Wrangling

Using a music management program like iTunes can be very useful when keeping a large collection in order. It can rename files, keep them organised in a decent directory structure and let you browse and edit the tags with ease. Perfect, as long as the songs you import are all properly tagged and have no duplicates. If anything is wrong, though, it can be a royal pain in the posterior.

When creating an iTunes library out of an existing music collection, it is often the case that an existing set of MP3s has to be imported into an existing iTunes library. In this case, many terrible things can happen, including duplicates and MP3s with subtly different (and sometimes incorrect) tags.

Enter Dupin, from Doug's AppleScripts. Dupin is a handy iTunes duplicate finder and remover. This is not a free tool, but if you're dealing with several thousand MP3s and don't fancy the agony of the iTunes dedupe tool, it's well worth a tenner.

The key to effectively and quickly importing an old library into a newer iTunes library is to turn off the "Copy files to iTunes Media folder when adding to library" option in the iTunes advanced settings. This will leave your MP3s where they are, but add them into the iTunes interface. Don't worry, though, if you prefer them all together. We'll get to that.

Once that option is disabled, drag the folder containing all the old MP3s into the iTunes window. Leave it for a bit, and before you know it, all the MP3s will show up. Some might be duplicates, some might just have crap for tags, but they will be there. Have a quick look through to see if there are any glaring errors in the import, and fire up Dupin.

You can match several different tags to consider files as duplicate. If you're lucky and have properly tagged all the old files, checking the Title, Album, Artist and Track Number fields should give you a nice list of tracks with their duplicates. Click the Filter button to get the list of ways to filter out the duplicates.

This is where disabling the copy option comes in. Simply select the Folder Location radio button, and leave the folder as your current library location. Click the Filter button and all the duplicates that are not already in your library will be marked for removal. This means that there is less to copy in when you consolidate your library later; only files you genuinely did not have will be copied.

To actually remove the files, select the Purge option from the Tools menu. Thanks to the MP3s still being in their original folder, you can opt to not send the files to the Trash without fear of cluttering your iTunes library folder with unused rubbish. After a little while, all the dupes will be removed from iTunes and all should be well.

You might want to run Dupin again, this time without the Track Number match. I have found that many old MP3s do not have a valid Track Number ID3 tag, and so show up without one in iTunes. This causes the Track Number match option to ignore them as dupes. Again, using the Folder Location filter should work the magic.

Now that's done, click File -> Library -> Organize Library. Opt to Consolidate your library and click OK. All the new files will then be copied and properly named in your iTunes library folder. Once that's done, you can be cavalier and delete the old MP3 folder, or you can give it a once over just to be sure it's all there. Either way, your libraries are merged and the duplicates are removed. Anything left is up to you to sort out!


Popular posts from this blog

Shooting the Enterprise

I was recently asked if I could help out providing an image for a magazine article about stress management. For reasons as yet undiscovered the requested image would be of the USS Enterprise flying through a storm in space. Unfortunately I didn't have a lot of time (just a couple of hours), but I did have a very nice model of the Enterprise D I could use to build the image around. Thinking fast, I rigged up a rather slapdash rig consisting of a black reflector backdrop, an umbrella and stand from which dangled the model by a thread, and a couple of strobes. One light above, diffused, to provide the key light, and another, reflected and lower power, to fill some of the very dark shadows. It ended up all looking something like this: Using a fast shutter, f/16 and cunning flash positioning I managed to keep the background black and give the model suitably textured lighting so it didn't have that flat, uniform, shadowless appearance of, well, a model. The narrow aperture obv

Fairy Lights

Street lights at night can be very pretty. For someone who lives close to the centre of a large city, skirting round the edge of the town centre can provide a host of beautiful views at night. One advantage to using a wide open lens when taking these pictures is the capture of bokeh, or creative blur. An extreme example is shown to your right; a mass of coloured circles that roughly represent the city they are part of. A more subtle example, of course, is in the picture of the day at the top of this post. The lights cluster around the top of the leaves like fireflies, obviously part of a cityscape but at the same time abstract. The extreme out of focus image is a blurred version of the picture on the left. A view over Sheffield from Pitsmoor, looking up Netherthorpe Road and up to the university. Even when the buildings are focussed (roughly; I'm still practicing) the lights take on the shape of the lens's aperture. I try to incorporate some foreground focus wh

Another canal walk

The sun has started being a little more present lately, so some mornings are actually quite pleasant. On one such morning I decided to have a wander up the canal. The clouds made everything look a bit Toy Story, and the low sun gave a lovely light and contrast to everything else. Of course, it wasn't sunny everywhere. But even in the darker places, such as right underneath Leeds railway station, the sun had a go at peeking in.