Evaluating Interactive Documentaries: Audience, Impact and Innovation in Public Interest Media

Public interest media organizations are increasingly interested in experimenting with interactive and participatory approaches to documentary storytelling enabled by digital technologies. However, due to the experimental nature of these interactive documentaries, it is not yet clear whether the more active user engagements they require translate into outcomes like sustained attention, greater narrative comprehension, enhanced learning, empathy or civic engagement – never mind larger societal impacts like improved public discourse, behavior change or policy change. The shifting definitions and measures of complex, multi-­‐dimensional concepts like “engagement” and “impact” is a challenge for public interest media organizations migrating to digital platforms – particularly at a time when audience activities have become far more transparent and funders place greater emphasis on “data-­driven” impact measurement.

This thesis explores the “theories of change” that inform institutional investments in documentary and examines how three public interest media organizations – the National Film Board of Canada, POV and the New York Times – are approaching interactive documentary production, attempting to define what constitutes success or impact – and how to measure it. I argue that we need new theories of change and evaluation frameworks that expand definitions of “impact” and “engagement,” balancing public service mission with the strategic goals of audience development and the circuitous processes of artistic and technological innovation. This means looking beyond quantitative mass media era metrics, which fail to account for important qualitative dimensions of the user experience. I propose a new set of qualitative and quantitative measures that might better reflect the social and artistic aspirations of the interactive documentary, test assumptions in ways that can inform project design, and embrace the potentials of technology to transform the methods, ethics and process of documentary storytelling in the digital age.

Download.

Sean Flynn

About Sean Flynn

Sean Flynn is a Co-Founder and Program Director at the Points North Institute, a media arts organization that produces the Camden International Film Festival and other artist support programs that serve as a launching pad for the next generation of nonfiction storytellers. Sean received a master’s degree from MIT’s Comparative Media Studies department, where he worked as a researcher at the MIT Open Documentary Lab. Sean began his career in documentary as a producer and cinematographer working on two feature-length films, BEYOND BELIEF and THE LIST, both of which had their premiere at the Tribeca Film Festival and aired on national television. In 2012, Sean was a Fulbright Senior Research Fellow in Mumbai, where he investigated the emergence of the slum tourism industry. In 2015, he was selected for the NAMAC Creative Leadership Lab. Thesis: Evaluating Interactive Documentaries: Audience, Impact and Innovation in Public Interest Media