Welcome, Guest | Home | Search | Login | Register
Author Using Extensis Portfolio for managing 100k image files (Read 7786 times)
68040
512 MB
*****
Posts: 950
68k - thy kingdom come, thy will be done !
View Profile
on: September 28, 2023, 11:41

@Bolkonskij - I'm up to my knees in my own "ueber-system challenge. Just moved my entire image collection "back to vintage" and am cataloging 100+k images via Extensis' Porfolio right now.

Corel's Gallery couldn't hack it (yet Portfolio can handle Corel's images, too) and none of the other image cataloging apps could either.

But Portfolio is happily churning away at my collection for 5+ hours already.

Next stop: My Video and then my sound files. Install a few more apps and last not least the big one: 10k fonts to manage!

That'll keep me busy for a few more days. ;)
Bolkonskij
Administrator
1024 MB
*****
Posts: 2023
View Profile Cornica - Video Entertainment for Mac OS users
Reply #1 on: September 28, 2023, 11:54

That's very impressive, especially if these are not 32x32.gif files but somewhat modern sized image files?

But eerr, as interesting as that is, how about starting another thread on this? We better return to topic for the sake of forum hygiene :-)

If you're up for a diversion, try the olduse.net from my post in the usenet thread. It'll beam you right back to the happy-go-lucky days of autumn 1983 ...
Last Edit: September 28, 2023, 11:58 by Bolkonskij
68040
512 MB
*****
Posts: 950
68k - thy kingdom come, thy will be done !
View Profile
Reply #2 on: September 28, 2023, 13:30

I've got images files up to 3088×1440 /w true color (16+ million). Extensis's Portfolio doesn't just catalog them all nicely (be they PICT, PNG, JPG, PCD, CMX or Lord knows what format), it even displays most of them flawlessly in its internal viewer (+thumbnail for preview).

I can edit them in PhotoShop 4 or speed zoom around 'em in xRes straight from the catalog.

Plus with my recently installed editing tools I'll be able to Avid-Videoshop or PS4-Plugin my Qt movies, too.

And my apologies, but I had to hijack somebody's thread for as not to miss this chance to brag about it all. ;)
Last Edit: September 28, 2023, 13:36 by 68040
Bolkonskij
Administrator
1024 MB
*****
Posts: 2023
View Profile Cornica - Video Entertainment for Mac OS users
Reply #3 on: September 28, 2023, 13:35

Haha, don't worry...this sounds remarkable. Well worth opening it's own thread.

Sounds amazing but then of course you're using a modern emulated setup which throws Mhz and RAM at the thing. I wonder how fast it'd be on a real System 7 machine. 100k images is just a huuuge number. How big is the file size?
68040
512 MB
*****
Posts: 950
68k - thy kingdom come, thy will be done !
View Profile
Reply #4 on: September 28, 2023, 13:44

[uPortfolio doesn't really care about the file's size, as it generates its own preview thumbnail.

The big difference compared to like tools from other vendors - and as I guess the main reason why it keeps working even with modern day MB files -  is that it writes every change straight to DB. So its a pure transactional approach, with no "undo" capacity. But this prevents problems from occurring that other catalog apps (like Corel's Gallery) suffer from, when they try to manage 20, 30 or 50Mb files in memory. Or attempt to create internal lists for 20-50k items.

It also means that Portfolio is not the fastest cataloging app, but its speed is consistent, no matter how humongous the amount of files you are working on.

The only true drawback of this app is that you need to adhere to its strict search algorithm when trying to locate an item. So you better chose your keywords wisely, or you'll never find that file again. ;)

For all other apps I found that giving MacOS enough RAM and putting it on an SSD overcomes most of the speed barriers within the system. I am not sure about the price for vintage RAM modules, but I do know that they've got SSD adapters for old IDE and SCSI interfaces. So maybe try a little HW upgrade? ;)
Last Edit: September 28, 2023, 13:51 by 68040
Bolkonskij
Administrator
1024 MB
*****
Posts: 2023
View Profile Cornica - Video Entertainment for Mac OS users
Reply #5 on: September 28, 2023, 17:04

Interesting.

So, out of interest, how big is your library / database file? (which holds all the records)
68040
512 MB
*****
Posts: 950
68k - thy kingdom come, thy will be done !
View Profile
Reply #6 on: September 28, 2023, 20:07

I split 'em up in several DBs and the content of the Corel Gallery CD's is still being compiled.

The other catalogs are between 1MB and 27MB in size, each covering between a few hundred to up to 25k items (images, sound files a.s.o.).
68040
512 MB
*****
Posts: 950
68k - thy kingdom come, thy will be done !
View Profile
Reply #7 on: September 29, 2023, 09:35

Done! The complete Corel Gallery CD collection stored on my data drive, cataloged and indexed /w Extensis' Portfolio: 25595 images with a catalog size of 151.6MB

Only took me 10+ hours. ;)
68040
512 MB
*****
Posts: 950
68k - thy kingdom come, thy will be done !
View Profile
Reply #8 on: September 29, 2023, 12:06

And as always, size matters (let no one tell you otherwise).

So I chucked in another 10k pictures or so, high-res photo images this time.

It feels good to go BIIIG. :D
Last Edit: September 30, 2023, 21:41 by 68040
Pages: [1]

© 2021 System7Today.com.
The Apple Logo, Macintosh™, Mac OS™, and others property of Apple Computer, Inc.
This site is in no way affiliated with Apple Computer, Inc.