Bridging the Gap between Subjective and Computational Measurements of Machine Creativity (CMMC): An Interactive Workshop at CVPR 2021

Virtual Workshop @ CVPR’21 (

Sunday, June 20, 2021

Time: TBD Check our website for updates

More Information: 

Evaluation is a key component of scientific research including both qualitative and quantitative ways of measuring successes and progresses. While the methods for producing machine creativity have significantly improved, the discussion on a scientific consensus on measuring the creative abilities of machines has only begun.  As Artificial Intelligence becomes capable of solving more abstract and advanced problems (e.g., image synthesis, cross-modal translations), how do we measure the creative performance of a machine?  In the world of visual art, subjective evaluations of creativity have been discussed at length. In the CVPR community, by comparison, evaluating a creative method has not been as systematized. Our goal in this workshop is to discuss current methods for measuring creativity both from experts in creative artificial intelligence as well as artists.  We do not wish to narrow the gap between how humans evaluate creativity and how machines do, instead we wish to understand the differences and create links between the two such that our machine creativity methods improve. We aim to collate ideas and collectively find answers to our questions from diverse perspectives. This workshop is Part II of our trilogy workshops on Measuring Computational Creativity where Part I took place at ISEA’20 and Part III is scheduled at SIGGRAPH’21.  

Call for Participation

Our workshop is composed of the following three parts: 

Invited Talks: pre-recorded videos of the talks will be made available prior to the workshop (open to all CVPR attendees). We have gathered a list of experts in creative computer vision and visual art who are interested in discussing their own methods of measuring creativity and hearing how others do so.  These guest speakers will engage in panel discussions and a question and answer session. 

David Bau, MIT CSAIL
Kazjon Grace, U. Sydney
Kristen Grauman, U. Texas, Austin
Ellen Pearlman, ThoughtWorks Arts 
Mark Riedl, Georgia Tech
Carolyn Rose, CMU
Kenneth Stanley, Open AI

Panel Discussion: All of our invited speakers will have a discussion on the core topics on measuring creativity of AI Arts (open to all CVPR attendees).

Interactive workshop with breakout sessions (open to all CVPR attendees but registration is required as space may be limited).

Registration deadline: Saturday, May 1st, 23:59:59 Eastern Daylight Time.


Acceptance notification date: May 20th, 2021.

In the interactive portion of the workshop, participants will discuss thought-provoking topics of measuring creativity, drawing on their disciplinary expertise. The discussions will draw from concrete examples from a variety of creative domains, including image generation, robots painting, and story generation, e.g., the artworks submitted to the workshop. Example questions include: how do we evaluate the artifacts created by AI systems? What are the metrics for measuring creativity? Participants will engage in breakout room discussions to collaboratively find answers to these questions.

This interdisciplinary workshop aims to provide a platform for the researchers in computer vision, machine learning, or AI in general, to meet artists, writers, and performers to discuss and share their views on the subject of creativity and intelligence. We aim to build on existing views from both artists and AI researchers to carve our interdisciplinary discourse on Creative AI. 

Call for Artwork

Our workshop for CVPR 2021 ( bridges subjective and computational measurements of machine creativity.

We are now accepting submissions of artworks exploring creative AI to form a virtual gallery exhibition that will be shared with the public and CVPR participants. Submissions will be evaluated for acceptance by a jury committee of artists.  Additionally these artworks will serve as contemporary examples of machine creativity for workshop participants to discuss. Guest speakers and attendees will study these artworks during the workshop, applying the measures of machine creativity developed earlier in the event. 

If you are interested in submitting artwork, please use the following Google Form to send your work by Saturday, May 1st, midnight Eastern. 

Questions regarding artwork submission: or


Ahmed Elgammal, Rutgers University
Hyeju Jang, University of British Columbia
Eunsu Kang, Carnegie Mellon University
James McCann, Carnegie Mellon University
Jean Oh, Carnegie Mellon University
Devi Parikh, Georgia Tech and Facebook AI Research
Peter Schaldenbrand, Carnegie Mellon University
Robert Twomey, Carson Center for Emerging Media Arts, UNL
Jun-Yan Zhu, Carnegie Mellon University