Ever since we created our Version 2 of A Flickr of Humanity, we’ve been brainstorming different ways to develop this project at the Flickr Foundation headquarters. Suddenly, we came across the question: what would happen if we used AI image generators to recreate The Family of Man? 

• What could this reveal about the current generative AI models and their understanding of photography?
• How might it create a new interpretation of The Family of Man exhibition?
• What issues or problems would we encounter with this uncanny approach?

We didn’t know the answers to these questions, or what we might even find, so we decided to jump on board for a new journey to Version 3. (Why not?!)

We split our research into three main stages:

1. Research into different AI image generators
2. Exploring machine-generated image captions
3. Challenges of using source photography responsibly in AI projects

And, we decided to try and see if we could use the current captioning and image generation technologies to fully regenerate The Family of Man for our Version 3.

Stage 1. Researching into different AI image generator softwares

Since the rapid advancements of generative artificial intelligence in the last couple of years, hundreds of image-generating applications, such as DALL-E 2 or Midjourney, have been launched. In the initial research stage, we tested different platforms by creating short captions of roughly ten images from The Family of Man and observing the resulting outputs.

Stage 1 Learnings: 

• Image generators are better at creating photorealistic images of landscapes, objects, and animals than close-up shots of people. 
• Most image generators, especially those that are free, have caps on the numbers of images that can be produced in a day, slowing down production speed. 
• Some captions had to be altered because they violated terms and policies of the platforms; certain algorithms would censor prompts with potential to create unethical, explicit images (e.g. Section A photo caption – the word “naked” could not be used for Microsoft Bing)

We decided to use Microsoft Bing’s Image generator for this project because it produced images with highest quality (across all image categories) with most flexible limits on the quantity of images that could be generated. We’ve tested other tools including Dezgo, Veed.io, Canva, and Picsart. 

Stage 2. Exploring image captions: AI Caption Generators

Image generators today primarily operate based on text prompts. This realisation meant we should explore caption generation software in more depth. There was much less variety in the caption-generating platforms compared to image generators. The majority of the websites we found seemed intended for social media use. 

Experiment 1: Human vs machine captions

Here’s a series of experiments done by rearranging and comparing different types of captions—human-written and artificially generated—with images to observe how it alters the images generated, their different expression and, in some cases, meaning: 

Stage 2 Learnings: 

• It was quite difficult to find a variety of caption generating software that generated different styles of captions because most platforms only generated “cheesy” social media captions, 
• In the platforms that generated other styles of captions (not for social media), we found the depth and accuracy of the description was really limited, for example, “a mountain range with mountains.”

Stage 3. Challenges of using AI to experiment with photography?!

Since both the concept and process of using AI to regenerate  The Family of Man is experimental, we encountered several dilemmas along the way:

1. Copyright Issues with Original Photo Use 

• It’s very difficult to obtain proper permission to use photos from the original publication of The Family of Man since the exhibition contains photos from 200+ photographers in different locations and for different publications. Hence, we’ve decided to not include the original photos of The Family of Man in the Version 3 publication.
• This is disappointing because having the original photo alongside the generated versions would allow us to create a direct visual comparison between authentic and synthetic photographs.
• All original photos of The Family of Man used in this blog post were photographed using the physical catalogue in our office.

2. Caption Generation 

• Even during the process of generating captions, we are required to plug in the original photo of The Family of Man so we’ve had to take screenshots of the online catalogue available in The Internet Archive. This can still be a violation of the copyrights policies because we’re adopting the image within our process, even if we don’t explicitly display the original image. We also have a copy of The Family of Man publication purchased by the Flickr Foundation here at the office.

4. Moving Forward..

Keeping these dilemmas in mind, we will try our best to show respect to the original photographs and photographers throughout our project. We’ll also continuously repeat this process/experimentation to the rest of the images in The Family of Man to create a new Version 3 in our A Flickr of Humanity project. 

Preface

In the first week of starting our summer placement at Flickr Foundation, Maya and I were tasked with an exciting project of working on A Flickr of Humanity. The original A Flickr of Humanity publication was created as part of a class exercise by students in California State University, Sacramento, supervised by Nick Shepard, assistant professor for photography. Inspired by the MoMA Family of Man exhibition, 5 groups of students were tasked with curating a selection of photos using Flickr representing the following themes: COVID-19, Love, Embers and Ashes, Women, and Spectrum. Once we showed Ben MacAskill, President & COO of Flickr, a copy of the publication, he loved it so much he asked us to arrange 250 copies for the upcoming Tugboat Institute summit where he was due to present the Flickr Foundation (amongst other things). Yay! 

But, before sending the publication to the printers, we had to check the licensing of every image to make sure the publication wasn’t violating any copyrights. It’s important to the Flickr Foundation to do the best we can to present licenses and licensed work as correctly as we can.

That’s when we embarked on the crazy  journey with Nick and George to create A Flickr of Humanity Version 2! We had a week to identify copyright restrictions and sources of 212 images and to replace roughly ⅕ of images missing the source or having licensing issues.

Day 1: Finding image source information

After creating an image index spreadsheet with Nick’s help, we began proofreading the list of photographer’s names and locating the image’s URL on Flickr . This involved a lot of scrolling down photo feeds and spotting images. Using the metadata of the photos in Flickr, we also logged the Creative Commons (CC) license information in the spreadsheet to make sure that we could use all photos for the final V2 publication. We worked closely with Nick throughout the project, despite the 8-hour time difference. 

To make it easier to visualise the full publication, we photocopied the spreads from the publication and laid them out on the office floor. This came in especially handy for tagging images that needed to be replaced or writing down editorial notes.

Day 3: Replacing images and creating new sections

Now that we had finally come to the finished index  containing information on 200+ images, we realised the majority of copyrighted photos came from the Embers and Ashes section. This meant most of those photos needed replacements. 

We took the opportunity to create a new version of the section focusing on California’s nature and wildfires, and continued to replace images in other sections.

Day 4: New index creation and wrapping up!

To finish up, we created a new index with the updated page numbers and order of photos and continued to swap out any copyrighted photos. Once we were finished, Nick kindly wrapped up the final details of the index and took charge of printing the copies in the U.S. 

Take a look at our A Flickr of Humanity project page to read more about the original inspirations of the publication and the Foundation’s future vision to expand Flickr as a curation tool.

Many thanks to Nick Shepard and George Oates for helping us throughout the process and the students of California State University, Sacramento for their amazing work on Version 1.

Maya Osaka

I am a second year BA Design student studying at Goldsmiths, University of London with the honour of being one of the first design interns at Flickr Foundation! Check out my work at mayaosaka.com!

Juwon Jung

I’m an interactive designer specializing in creating digital products with emerging technologies. To learn more, visit juwonjung.cargo.site 🙂