Tuesday’s IPTC Photo Metadata Conference was a great success. With 12 speakers from the media and software industries and over 200 people registered, it continues to be the largest gathering of photo and image metadata experts globally.

Introduction and welcome, 20 years of IPTC Photo Metadata, Recent work on Photo Metadata at IPTC

We started off with David Riecks and Michael Steidl, co-leads of the IPTC Photo Metadata Working Group, giving an update on what the IPTC has been working on in the areas of photo metadata since the last conference in 2022, along with Brendan Quinn, IPTC Managing Director.

A lot has been happening, including Meta announcing support for IPTC metadata for Generative AI,  launching the IPTC Media Provenance Committee and updating the IPTC Photo Metadata User Guide, including our guidance for how to tag Generative AI content with metadata and how to use the DigitalSourceType field.

Panel 1: AI and Image Authenticity

The first panel saw Leonard Rosenthol of Adobe, Lead of the C2PA Technical Working Group; Dennis Walker of Camera Bits, creators of Photo Mechanic; Dr. Neal Krawetz, Computer security specialist, forensic researcher, and founder of FotoForensics; and Bofu Chen, Founder & CTO of Numbers Protocol speak about image provenance and authenticity, covering the C2PA spec, the problems of fraudulent images, what it’s like to implement C2PA technology in existing software, and how blockchain-based systems could be built on top of C2PA to potentially extend its capabilities.

Session on Adobe’s Custom Metadata Panel

James Lockman, Group Manager, Digital Media Services at Adobe demonstrated the Custom Metadata Panel plugin for some Adobe tools (Bridge, Illustrator, Photoshop and Premiere Pro) that allows the full range of IPTC Photo Metadata Standard and IPTC Video Metadata Hub, or any other metadata schema, to be edited directly in Adobe’s interface.

Panel 2: AI-powered asset management

Speakers  Nancy Wolff, Partner at Cowan, DeBaets, Abrahams & Sheppard, LLP; Serguei Fomine, Founder and CEO of IQPlug; Jeff Nova, Chief Executive Officer at Colorhythm and Mark Milstein, co-founder and Director of Business Development at vAIsual discussed the impact of AI on copyright, metadata and media asset management.

The full event recording is also available as a YouTube playlist.

Thanks to everyone for coming and especial thanks to our speakers. We’re already looking forward to next year!

The 2024 IPTC Photo Metadata Conference takes place as a webinar on Tuesday 7th May from 1500 – 1800 UTC. Speakers hail from Adobe (makers of Photoshop), CameraBits (makers of PhotoMechanic), Numbers Protocol, Colorhythm, vAIsual and more.

First off, IPTC Photo Metadata Working Group co-leads, David Riecks and Michael Steidl, will give an overview of what has been happening in the world of photo metadata since our last Conference in November 2022, including IPTC’s work on metadata for AI labelling, “do not train” signals, provenance, diversity and accessibility.

Next, a panel session on AI and Image Authenticity: Bringing trust back to photography? discusses approaches to the problem of verifying trust and credibility for online images. The panel features C2PA lead architect Leonard Rosenthol (Adobe), Dennis Walker (Camera Bits), Neal Krawetz (FotoForensics) and Bofu Chen (Numbers Protocol).

Next, James Lockman of Adobe presents the Custom Metadata Panel, which is a plugin for Photoshop, Premiere Pro and Bridge that allows for any XMP-based metadata schema to be used – including IPTC Photo Metadata and IPTC Video Metadata Hub. James will give a demo and talk about future ideas for the tool.

Finally, a panel on AI-Powered Asset Management: Where does metadata fit in? discusses teh relevance of metadata in digital asset management systems in an age of AI. Speakers include Nancy Wolff (Cowan, DeBaets, Abrahams & Sheppard, LLP),  Serguei Fomine (IQPlug), Jeff Nova (Colorhythm) and Mark Milstein (vAIsual).

The full agenda and links to register for the event are available at https://iptc.org/events/photo-metadata-conference-2024/

Registration is free and open to anyone who is interested.

See you there on Tuesday 7th May!

Updated in June 2024 to include an image containing the new metadata property

Many image rights owners noticed that their assets were being used as training data for generative AI image creators, and asked the IPTC for a way to express that such use is prohibited. The new version 2023.1 of the IPTC Photo Metadata Standard now provides means to do this: a field named “Data Mining” and a standardised list of values, adopted from the PLUS Coalition. These values can show that data mining is prohibited or allowed either in general, for AI or Machine Learning purposes or for generative AI/ML purposes. The standard was approved by IPTC members on 4th October 2023 and the specifications are now publicly available.

Because these data fields, like all IPTC Photo Metadata, are embedded in the file itself, the information will be retained even after an image is moved from one place to another, for example by syndicating an image or moving an image through a Digital Asset Management system or Content Management System used to publish a website. (Of course, this requires that the embedded metadata is not stripped out by such tools.)

Created in a close collaboration with PLUS Coalition, the publication of the new properties comes after the conclusion of a public draft review period earlier this year. The properties are defined as part of the PLUS schema and incorporated into the IPTC Photo Metadata Standard in the same way that other properties such as Copyright Owner have been specified.

The new properties are now finalised and published. Specifically, the new properties are as follows:

• Data Mining: a field with a value from a controlled value vocabulary. Values come from the PLUS Data Mining vocabulary, reproduced here:
  • http://ns.useplus.org/ldf/vocab/DMI-UNSPECIFIED (Unspecified – no prohibition defined)
  • http://ns.useplus.org/ldf/vocab/DMI-ALLOWED (Allowed)
  • http://ns.useplus.org/ldf/vocab/DMI-PROHIBITED-AIMLTRAINING (Prohibited for AI/ML training)
  • http://ns.useplus.org/ldf/vocab/DMI-PROHIBITED-GENAIMLTRAINING (Prohibited for Generative AI/ML training)
  • http://ns.useplus.org/ldf/vocab/DMI-PROHIBITED-EXCEPTSEARCHENGINEINDEXING (Prohibited except for search engine indexing)
  • http://ns.useplus.org/ldf/vocab/DMI-PROHIBITED (Prohibited)
  • http://ns.useplus.org/ldf/vocab/DMI-PROHIBITED-SEECONSTRAINT (Prohibited, see Other Constraints property)
  • http://ns.useplus.org/ldf/vocab/DMI-PROHIBITED-SEEEMBEDDEDRIGHTSEXPR (Prohibited, see Embedded Encoded Rights Expression property)
  • http://ns.useplus.org/ldf/vocab/DMI-PROHIBITED-SEELINKEDRIGHTSEXPR (Prohibited, see Linked Encoded Rights Expression property)
• Other Constraints: Also defined in the PLUS specification, this text property is to be used when the Data Mining property has the value “http://ns.useplus.org/ldf/vocab/DMI-PROHIBITED-SEECONSTRAINT“. It can specify, in a human-readable form, what other constraints may need to be followed to allow Data Mining, such as “Generative AI training is only allowed for academic purposes” etc.

The IPTC and PLUS Consortium wish to draw users attention to the following notice included in the specification:

Regional laws applying to an asset may prohibit, constrain, or allow data mining for certain purposes (such as search indexing or research), and may overrule the value selected for this property. Similarly, the absence of a prohibition does not indicate that the asset owner grants permission for data mining or any other use of an asset.

The prohibition “Prohibited except for search engine indexing” only permits data mining by search engines available to the public to identify the URL for an asset and its associated data (for the purpose of assisting the public in navigating to the URL for the asset), and prohibits all other uses, such as AI/ML training.

The IPTC encourages all photo metadata software vendors to incorporate the new properties into their tools as soon as possible, to support the needs of the photo industry.

ExifTool, the command-line tool for accessing and manipulating metadata in image files, already supports the new properties. Support was added in the ExifTool version 12.67 release, which is available for download on exiftool.org.

The new version of the specification can be accessed at https://www.iptc.org/std/photometadata/specification/IPTC-PhotoMetadata or from the navigation menu on iptc.org. The IPTC Get Photo Metadata tool and IPTC Photo Metadata Reference images been updated to use the new properties.

The IPTC and PLUS Coalition wish to thank many IPTC and PLUS member organisations and others who took part in the consultation process around these changes. For further information, please contact IPTC using the Contact Us form.

The IPTC NewsCodes Working Group has approved an addition to the Digital Source Type NewsCodes vocabulary.

The new term, “Composite with Trained Algorithmic Media“, is intended to handle situations where the “synthetic composite” term is not specific enough, for example a composite that is specifically made using an AI engine’s “inpainting” or “outpainting” operations.

The full Digital Source Type vocabulary can be accessed from https://cv.iptc.org/newscodes/digitalsourcetype. It can be downloaded in NewsML-G2 (XML), SKOS (RDF/XML, Turtle or JSON-LD) to be integrated into content management and digital asset management systems.

The new term can be used immediately with any tool or standard that supports IPTC’s Digital Source Type vocabulary, including the C2PA specification, the IPTC Photo Metadata Standard and IPTC Video Metadata Hub.

Information on the new term will soon be added to IPTC’s Guidance on using Digital Source Type in the IPTC Photo Metadata User Guide.

We are proud to announce that Camera Bits, Mobius Labs, Microsoft, Smithsonian, CBC and many others will be presenting at the IPTC Photo Metadata Conference next week, Thursday 10th November. With a theme of Photo Metadata in the Real World, the event is free for anyone to attend. Register here for the Zoom webinar to receive details before the event.

The event will run from 1500 UTC to 1800 UTC. The full agenda with timings is published on the event page.

We will start off with a short presentation on recent updates to the IPTC Photo Metadata Standard from David Riecks and Michael Steidl, co-leads of the IPTC Photo Metadata Working Group. This will include the new properties approved at the recent IPTC Autumn Meeting.

A session on Adoption of IPTC Accessibility properties will include speakers from Smithsonian, Camera Bits (makers of the photographers tool Photo Mechanic), Picvario presenting their progress implementing IPTC’s accessibility properties, announced at last year’s Photo Metadata Conference.

The next session will be Software Supporting the IPTC Photo Metadata Standard, where Michael Steidl and David Riecks, co-leads of the IPTC Photo Metadata Working Group, present their work on IPTC’s database of software supporting the Photo Metadata Standard, and the IPTC Interoperability tool, showing compatibility between tools for individual properties.

Use of C2PA in real-world workflows is the topic of the next session, demonstrating progress made in implementing C2PA technology to make images and video tamper-evident and to establish a provenance trail for creative works. Speakers include Nigel Earnshaw and Charlie Halford from the BBC, David Beaulieu and Jonathan Dupras from CBC/Radio Canada, Jay Li from Microsoft, and a speaker yet to be confirmed from the Content Authenticity Initiative.

The next session should be very exciting: Metadata for AI images will be the topic, featuring an introduction to synthetic media and “generative AI” images, including copyright and ownership issues behind the images used to train the machine learning models involved, from Brendan Quinn and Mark Milstein.

Then we have a panel session: How should IPTC support AI and generative models in the future? Questions to be covered include whether we should identify which tool, text prompt and/or model was used to create a generative image? Should we include a flag that indicates content was created using a “green”, copyright-cleared set of training images? And perhaps other questions too – please come along to ask your own questions! Speakers include Dmitry Shironosov, Everypixel / Dowel.ai / Synthetics.media, Martin Roberts from Mobius Labs and Sylvie Fodor from CEPIC. The session will be moderated by Mark Milstein from vAIsual.

Last year we had over 200 registrants and very lively discussions. We look forward to even more exciting presentations and discussions this time around! See you there. (Please don’t forget to register!)

By Sarah Saunders

Ten years ago, the very first IPTC Photo Metadata Conference in Florence was packed with photographers and picture libraries eager to discuss ways of protecting their work in the digital environment. The image industry has expanded enormously since. The image industry has the additional challenge of vast numbers of images crowding the web, and the difficulty of finding the relevant picture, as well as the metadata relating to it.

IPTC Photo Metadata Conference 2017 was designed to look into the future, with a focus on image search using AI or Artificial Intelligence. The ability of computer systems to learn from humans has increased enormously in recent years, and the necessary computer power has now become available. The question for the conference was – how far can these systems help the professional image industry sharpen up its search capability and make gains in productivity?

Solution for Auto Tagging in the Image Industry

Kai-Uwe Barthel, professor of visual computing at HTW Berlin University gave a clear exposition on the history of the field and of the pressing need to create solutions for the picture industry. There are now too many images for classical search systems to handle, but using Neural Network Analysis – a variant of AI – computer systems can be taught to tag and recognise images in a fraction of the time it takes to manually tag. As most online images are untagged, a combination of human tagging and visual similarity search presents a viable way forward. But Barthel and his team have also researched new methods of presenting images, using three dimensional structures to dig into results with large numbers of images visible at one time.

Speakers on the use of AI came from across the industry, presenting solutions which can be put into practice now. The key to success in this area is to have enough content for the computers to learn from, and this can be achieved in a number of different ways. General AI systems produce good results for skies and beaches and general themes because they’ve had the data to learn from. But users can set a system to learn from their own content so that more specialist content can be tagged if the conditions are right. Computers are learning faster, and need fewer images to learn from than before.

AI systems can be trained to recognise faces, text, colours, composition, scenes, and objects, but can also be trained in the aesthetics of image selection, with one speaker maintaining that twenty images are enough to train a system in a particular brand aesthetic. But speakers admitted also that defining the precise location of what is shown in an image by its content was tested but it did not work in a reliable way.

Speakers stressed that the important element in computer learning is the understanding of the nature of the material to be tagged, an attribute which is currently not about to be taken over by artificial intelligence. The benefits in speed and productivity will be enormous but we’re not yet talking about doing away with human skills altogether!

IPTC Video Metadata and Easier Cross Media Distribution

The first afternoon session by IPTC Managing Director Michael Steidl was about the IPTC Video Metadata Hub (VMH), published in 2016 to provide a standard set of fields for use across the varied technologies used in video. Many of the Video Hub fields are equivalent to those in IPTC Photo Metadata Standard, which helps streamline cross media distribution. The VMH can be applied down to the level of video clips, which makes it a useful metadata tool for production, archive and distribution.

Technology That Protects Rights Information in Google Image Search

The IPTC conference was held a day after a CEPIC seminar on Google. The Google image search scrapes images from their original sites and displays them in its own environment. This is bad for rightsholders as images can be saved and downloaded direct from Google without reference to the original site. Picture libraries and agencies lose significant traffic to their sites as a result with a German agencies survey indicating a drop of 50 percent in traffic. The recent fine levied by the EU on Google for anti-competitiveness in comparative shopping sites is encouraging and has paved the way for scrutiny of Google’s actions with online images.

The second presentation of the afternoon presented a solution for the problems raised in the Google seminar. SmartFrame technology allows images to be presented online without the danger of being scraped by Google as this is disabled by technical means. Most of the mechanisms people use to download images – like right-click – are disabled too. Images can be shared as links so social media sharing doesn’t lead to an image becoming orphaned and lost in the websphere. And when an image is viewed as a thumbnail in Google, there is a clear indication that it is a copyrighted image, and a link back to the originating site. Rob Sewel, Pixelrights CEO demonstrated how product items within an image could be linked back to a brand website, providing ways of funding photography in the future where photography provides a link to a paid-for advertising service. The technology could be put to all sorts of uses in both commercial and non-commercial fields, and gives control back to creators and their agents.

The success of this kind of technology, as with all solutions to image grabbing and orphaned images, lies in the uptake of the technology. To be truly protective of copyright, client websites would need to implement a technology like SmartFrame.

The IPTC Photo Metadata Conference 2017 was fascinating from start to finish for the about 60 attendees on location, the level of presentations was extremely high, and the presentations and videos are all available on the website at https://iptc.org/events/photo-metadata-conference-2017/.

Sarah Saunders runs Electric Lane, an independent DAM consultancy specialising in workflow planning, asset retrieval, data management and DAM project management. She works with IPTC’s Photo Metadata Working Group.