AI is changing the way photos are classified, photos or memories

26 September 2024

The iPhone 16, Apple’s latest smartphone, has arrived on shop shelves. There are four versions of the device: 16, 16 Plus, 16 Pro, and 16 Pro Max. In time all will feature Apple Intelligence, Apple’s artificial intelligence (AI) offering, which will be “deeply integrated” into iOS18 and other Apple operating systems. From what I can gather, Apple Intelligence features will be rolled out over time, presumably by way of incremental updates to iOS18, and beyond.

One of the iPhone 16’s — specifically the Pro and Pro Max models — big talking points though, has been the inclusion of a physical shutter button (although Apple calls it “camera control”) for the camera. It means people will be able to tilt their phone into (what I’ll call) landscape mode, and have the device mimic cameras of old.

Of course, photos can still be taken in portrait orientation using the button. There are a number of other major new camera and photo settings, but Nilay Patel, editor-in-chief of The Verge, suggests the new camera/photo features alone may be reason enough to consider buying a 16.

There’s also speculation as to the difference Apple Intelligence will make to photos taken, going forward. A yet to arrive feature, called “Clean Up”, which like the “Magic Eraser” function on Google phones, will allow people to alter, with the aid of AI, their iPhone photos. They’ll be able to remove (and add) objects and people. It’s going to be a game-changer. So much so, that some smartphone images are being referred to as memories:

I asked Apple’s VP of camera software engineering Jon McCormack about Google’s view that the Pixel camera now captures “memories” instead of photos, and he told me that Apple has a strong point of view about what a photograph is — that it’s something that actually happened.

This distinction is significant. Old school images, raw and unedited, recording an instant in time, will continue to be referred to as photos. This will be a journalistic application. Images edited by way of AI, meanwhile, will become more appropriately considered memories.

Clean Up or Magic Eraser can be used to remove that inadvertently photo-bombing stranger who strays into the background of a family group shot, thus preserving the memory of the moment as those present would like to remember it.

Photos or memories. It seems all very inconsequential, a small step even — I’m merely scratching the surface here — but another of the many changes AI technologies are bringing our way.