Making Peace with Metrics: Relational Work in Online News Production

Angèle Christin; Caitlin Petre

doi:10.6092/issn.1971-8853/11178

Authors

Angèle Christin Department of Communication, Stanford University http://orcid.org/0000-0002-7437-2013
Angèle Christin is an Assistant Professor in the Department of Communication at Stanford University. She studies how algorithms and analytics transform professional values, expertise, and work practices. Her book Metrics at Work: Journalism and the Contested Meaning of Algorithms (Princeton University Press, June 2020) focuses on the case of web journalism, analyzing the growing importance of audience data in web newsrooms in the U.S. and France. She is currently a Visiting Researcher with the Social Media Collective at Microsoft Research New England.
Caitlin Petre School of Communication and Information, Rutgers University, Brunswick, NJ http://orcid.org/0000-0001-7846-9659
Caitlin Petre is an Assistant Professor of Journalism and Media Studies at the Rutgers University. She examines the social and material implications of an increasingly data-saturated world, with particular attention to the relationship between digital technologies, knowledge work, and media industries. Using field research methods, she analyzes how new sources of quantitative data interact with long-established approaches to cultural production and the management of media workers.

DOI:

https://doi.org/10.6092/issn.1971-8853/11178

Keywords:

Journalism, Metrics, Relational Work, Zelizer, Matching

Abstract

How do workers make peace with performance metrics that threaten their professional values? Drawing on Viviana Zelizer’s concepts of relational work and “good matches,” we focus on the case of online news production and analyze efforts to align audience metrics with journalistic values. Whereas existing research on web metrics tends to frame editorial production and audience data as “hostile worlds” of professional and market forces that cannot be reconciled, we show that journalists rely on relational work to make metrics acceptable within organizations. Drawing on ethnographic material, we identify five key relational strategies: moral boundary-drawing between "good" and "bad" metrics, strategic invocation of "best-case scenarios," domestication through bespoke metrics, reframing metrics as democratic feedback, and justifying metrics as organizational subsidies. We then turn to cases of failure and document a process that we call overspelling, which can coincide with organizational breakdown. We conclude by discussing the concept of “failed matches” and the indirect relationship between metrics and markets in online news production.

References

Almeling, R. (2007). Selling genes, selling gender: Egg agencies, sperm banks, and the medical market in genetic material. American Sociological Review, 72(3), 319–340. https://doi.org/10.1177/000312240707200301

Anderson, C. W. (2011a). Between creative and quantified audiences: Web metrics and changing patterns of newswork in local US newsrooms. Journalism, 12(5), 550–566. https://doi.org/10.1177/1464884911402451

Anderson, C. W. (2011b). Deliberative, agonistic, and algorithmic audiences: Journalism’s vision of its public in an age of audience transparency. International Journal of Communication, 5, 519–547.

Anderson, C. W. (2013). Rebuilding the News: Metropolitan Journalism in the Digital Age. Philadelphia: Temple University Press.

Bandelj, N. (2020). Relational Work in the Economy. Annual Review of Sociology, 46, 251–272. https://doi.org/10.1146/annurev-soc-121919-054719

Beckert, J., & Aspers, P. (Eds.). (2011). The Worth of Goods: Valuation and Pricing in the Economy. New York: Oxford University Press.

Belair-Gagnon, V., & Holton, A. E. (2018). Boundary work, interloper media, and analytics in newsrooms. Digital Journalism, 6(8), 492–508. https://doi.org/10.1080/21670811.2018.1445001

Benkler, Y. (2006). The Wealth of Networks: How Social Production Transforms Markets and Freedom. New Haven: Yale University Press.

Benton, J. (2014). The leaked New York Times innovation report is one of the key documents of this media age. NiemanLab, May 15. Retrieved from: https://www.niemanlab.org/2014/05/the-leaked-new-york-times-innovation-report-is-one-of-the-key-documents-of-this-media-age/

Blanchett Neheli, N. (2018). News by numbers: The evolution of analytics in journalism. Digital Journalism, 6(8), 1041–1051. https://doi.org/10.1080/21670811.2018.1504626

Boczkowski, P. J. (2005). Digitizing the News: Innovation in Online Newspapers. Cambridge: MIT Press.

Boczkowski, P. J., & Mitchelstein, E. (2013). The News Gap: When The Information Preferences of the Media and The Public Diverge. Cambridge: MIT Press.

Boltanski, L., & Thévenot, L. (2006). On Justification: Economies of Worth. Princeton: Princeton University Press.

boyd, d., & Crawford, K. (2012). Critical questions for big data: Provocations for a cultural, technological, and scholarly phenomenon. Information, Communication & Society, 15(5), 662–679. https://doi.org/10.1080/1369118X.2012.678878

Bunce, M. (2019). Management and resistance in the digital newsroom. Journalism, 20(7), 890–905. https://doi.org/10.1177/1464884916688963

Carlson, M. (2015). When news sites go native: Redefining the advertising-editorial divide in response to native advertising. Journalism, 16(7), 849–865. https://doi.org/10.1177%2F1464884914545441

Carr, D. (2014). Risks Abound as Reporters Play in Traffic. The New York Times, March 23. Retrieved from: https://www.nytimes.com/2014/03/24/business/media/risks-abound-as-reporters-play-in-traffic.html

Cherubini, F., & Nielsen, R. K. (2016). Editorial analytics: How news media are developing and using audience data and metrics. <. Retrieved from: https://reutersinstitute.politics.ox.ac.uk/our-research/editorial-analytics-how-news-media-are-developing-and-using-audience-data-and-metrics

Christin, A. (2018). Counting Clicks. Quantification and Variation in Web Journalism in the United States and France. American Journal of Sociology, 123(5), 1382–1415. https://doi.org/10.1086/696137

Christin, A. (2020). Metrics at Work: Journalism and the Contested Meaning of Algorithms. Princeton, NJ: Princeton University Press.

Coddington, M. (2015). The wall becomes a curtain: Revisiting journalism’s new-business boundary. In M. Carlson & S. C. Lewis (Eds.), Boundaries of Journalism: Professionalism, Practices and Participation (pp. 67–82). London: Routledge. https://www.taylorfrancis.com/books/e/9781315727684/chapters/10.4324/9781315727684-5

Darnton, R. (1975). Writing news and telling stories. Daedalus, 104(2), 175–194. Retrieved from: http://www.jstor.org/stable/20024337

Daulerio, A.J. (2012). Gawker will be conducting an experiment, please enjoy your free cute cats singing and sideboobs. Gawker, January 23. Retrieved from: https://gawker.com/5878065/gawker-will-be-conducting-an-experiment-please-enjoy-your-free-cute-cats-singing-and-sideboobs

DiMaggio, P., & Louch, H. (1998). Socially embedded consumer transactions: For what kinds of purchases do people most often use networks? American Sociological Review, 63(5), 619–637. https://doi.org/10.2307/2657331

DiMaggio, P. J., & Powell, W. W. (1983). The iron cage revisited: Institutional isomorphism and collective rationality in organizational fields. American Sociological Review, 48(2), 147–160. https://doi.org/10.2307/2095101

Espeland, W. N., & Stevens, M. L. (1998). Commensuration as a social process. Annual Review of Sociology, 24(1), 313–343. https://doi.org/10.1146/annurev.soc.24.1.313

Ferrer-Conill, R., & Tandoc Jr, E. C. (2018). The audience-oriented editor: Making sense of the audience in the newsroom. Digital Journalism, 6(4), 436–453. https://doi.org/10.1080/21670811.2018.1440972

Fourcade, M. (2012). The moral sociology of Viviana Zelizer. Sociological Forum, 27(4), 1055–1061. https://doi.org/10.1111/j.1573-7861.2012.01371.x

Fourcade, M., & Kluttz, D. N. (2020). A Maussian bargain: Accumulation by gift in the digital economy. Big Data & Society, 7(1). https://doi.org/10.1177/2053951719897092

Fischer, M.C. (2014). The pay-per-visit debate: Is chasing viral traffic hurting journalism? American Journalism Review, March 27. Retrieved from: https://ajr.org/2014/03/27/pay-per-visit-debate-chasing-viral-traffic-hurting-journalism/

Gans, H. J. (1979). Deciding What’s News: A Study of CBS Evening News, NBC Nightly News, Newsweek, and Time. New York: Vintage Books (Random House).

Guardian Comms. (2015). Behind the scenes: Ophan — how the Guardian democratized data. The Guardian , December 11. Retrieved from: https://medium.com/@GuardianComms/behind-the-scenes-ophan-how-the-guardian-democratised-data-36cde3967062

Granovetter, M. (1995). Getting a Job: A Study of Contacts and Careers. Chicago: University of Chicago Press.

Greenwell, M. (2019). The adults in the room. Deadspin, August 23. Retrieved from: https://theconcourse.deadspin.com/the-adults-in-the-room-1837487584

Habermas, J. (1989). The Structural Transformation of the Public Sphere. (T. Burger & F. Lawrence, Trans.). Cambridge: MIT Press. (Original work published 1962).

Haile, T. (2014). What you think you know about the web is wrong. Time, March 9. Retrieved from: https://time.com/12933/what-you-think-you-know-about-the-web-is-wrong/

Hanusch, F. (2017). Web analytics and the functional differentiation of journalism cultures: Individual, organizational and platform-specific influences on newswork. Information, Communication and Society, 20(10), 1571–1586. https://doi.org/10.1080/1369118X.2016.1241294

Healy, K. (2010). Last Best Gifts: Altruism and the Market for Human Blood and Organs. Chicago: University of Chicago Press.

Herrman, J. (2012). Infinite feedback will make us crazy. Buzzfeed News, March 8. Retrieved from: https://www.buzzfeednews.com/article/jwherrman/infinite-feedback-will-make-us-crazy

Igo, S. E. (2008). The Averaged American: Surveys, Citizens, and the Making of a Mass Public. Cambridge, MA: Harvard University Press.

Keller, M. & Abelson, B. (2015). Newslynx: A tool for newsroom impact and measurement. Columbia Journalism Review, June 4. Retrieved from: https://www.cjr.org/tow_center_reports/newslynx_a_tool_for_newsroom_impact_measurement.php

Kiviat, B. (2019). The moral limits of predictive practices: The case of credit-based insurance scores. American Sociological Review, 84(6), 1134–1158. https://doi.org/10.1177/0003122419884917

Konieczna, M. & Powers, E. (2017). What can nonprofit journalists actually do for democracy? Journalism Studies, 18(12), 1542–1558. https://doi.org/10.1080/1461670X.2015.1134273

Lamont, M., & Molnár, V. (2002). The study of boundaries in the social sciences. Annual Review of Sociology, 28(1), 167–195. https://doi.org/10.1146/annurev.soc.28.110601.141107

Lamont, M. (2012). Toward a comparative sociology of valuation and evaluation. Annual Review of Sociology, 38, 201–221. https://doi.org/10.1146/annurev-soc-070308-120022

Mears, A. (2011a). Pricing looks: Circuits of value in fashion modeling markets. In J. Beckert & P. Aspers (Eds.), The Worth of Goods (pp. 155–177). New York: Oxford University Press.

Mears, A. (2011b). Pricing beauty: The Making of a Fashion Model. Berkeley: University of California Press.

Merritt, D. (2005). Breaching the wall. Nieman Watchdog, April 18. Retrieved from: http://www.niemanwatchdog.org/index.cfm?fuseaction=Background.view&backgroundid=44

Nadler, A. M. (2016). Making the News Popular: Mobilizing U.S. News Audiences. Urbana, IL: University of Illinois Press.

Napoli, P. M. (2011). Audience Evolution: New Technologies and the Transformation of Media Audiences. New York: Columbia University Press.

Nelson, J. L., & Tandoc Jr, E. C. (2019). Doing “well” or doing “good”: What audience analytics reveal about journalism’s competing goals. Journalism Studies, 20(13), 1960–1976. https://doi.org/10.1080/1461670X.2018.1547122

The New York Times. (2017). Journalism that stands apart: the report of the 2020 group. The New York Times, January. Retrieved from: https://www.nytimes.com/projects/2020-report/index.html

Ossandón, J., & Zelizer, V. (2019). How did I become a historical sociologist? Viviana Zelizer in conversation with José Ossandón. Sociologica, 13(3), 191–196. https://doi.org/10.6092/issn.1971-8853/10132

Petchesky, B. (2019). I was fired from Deadspin for refusing to “stick to sports.” The New York Times, November 11. https://www.nytimes.com/2019/11/11/opinion/deadspin-sports.html

Petre, C. (2015). The traffic factories: Metrics at Chartbeat, Gawker Media, and The New York Times. Tow Center for Digital Journalism. https://doi.org/10.7916/D80293W1

Petre, C. (2018). Engineering consent: How the design and marketing of newsroom analytics tools rationalize journalists’ labor. Digital Journalism, 6(4), 509–527. https://doi.org/10.1080/21670811.2018.1444998

Pulitzer, J. (1904). The School of Journalism in Columbia University: The Power of Public Opinion. The North American Review, 41–80. Retrieved from: https://archive.org/details/schoolofjournali00puliuoft/page/6/mode/2up

Reich, A. (2012). Disciplined doctors: The electronic medical record and physicians’ changing relationship to medical knowledge. Social Science & Medicine, 74(7), 1021– 1028. https://doi.org/10.1016/j.socscimed.2011.12.032

Reich, A.D. (2014). Selling Our Souls: The Commodification of Hospital Care in the United States. Princeton: Princeton University Press.

Rosen, J. (2006). The people formerly known as the audience. PressThink, June 27. Retrieved from: http://archive.pressthink.org/2006/06/27/ppl_frmr.html

Salcetti, M. (1995). The Emergence of the Reporter: Mechanization and the Devaluation of Editorial Workers. In H. Hardt & B. Brennan (Eds.). Newsworkers: Toward a History of the Rank and File (pp. 48–74). Minneapolis: University of Minnesota Press.

Saroff, J. (2017). A Chartbeat evolution. Chartbeat Press, October 3. Retrieved from: https://blog.chartbeat.com/2017/10/03/a-chartbeat-evolution/

Schudson, M. (2005). Autonomy from what? In R. Benson & E. Neveu. (Eds.), Bourdieu and the Journalistic Field (pp. 214–223). Cambridge: Polity Press.

Shire, E. (2014). Saving us from ourselves: The anti-clickbait movement. The Daily Beast, April 14. Retrieved from: https://www.thedailybeast.com/saving-us-from-ourselves-the-anti-clickbait-movement

Snyder, G. (2017). How the New York Times is clawing its way into the future. Wired, February 12. Retrieved from: https://www.wired.com/2017/02/new-york-times-digital-journalism

Stark, D. (2009). The Sense of Dissonance: Accounts of Worth in Economic Life. Princeton, NJ: Princeton University Press.

Tandoc, E. C. & Thomas, R. J. (2015). The ethics of web analytics: Implications of using audience metrics in news construction. Digital Journalism, 3(2), 243–258. https://doi.org/10.1080/21670811.2014.909122

Timmermans, S., & Tavory, I. (2012). Theory construction in qualitative research: From grounded theory to abductive analysis. Sociological Theory, 30(3), 167–186. https://doi.org/10.1177/0735275112457914

Tofel, R. (2013). Nonprofit journalism: Issues around impact.Propublica. Retrieved from: https://s3.amazonaws.com/propublica/assets/about/LFA_ProPublica-white-paper_2.1.pdf

Upworthy. (2014). What uniques and pageviews leave out (and why we’re measuring attention minutes instead). Upworthy Insider, February 6. Retrieved from: https://blog.upworthy.com/what-uniques-and-pageviews-leave-out-and-why-were-measuring-attention-minutes-instead-d12c159d5c96?gi=16a0c6bbd9b2

Usher, N. (2010). Why SEO and audience tracking won’t kill journalism as we know it. NiemanLab, September 14. Retrieved from: https://www.niemanlab.org/2010/09/why-seo-and-audience-tracking-won’t-kill-journalism-as-we-know-it-2/

Usher, N. (2013). Al Jazeera English Online: Understanding web metrics and news production when a quantified audience is not a commodified audience. Digital Journalism, 1(3), 335–51. https://doi.org/10.1080/21670811.2013.801690

Vatin, F. (2009). Evaluer et valoriser: une sociologie économique de la mesure. Toulouse: Presses Universitaires du Mirail.

Wahl-Jorgensen, K. (2002). The construction of the public in Letters to the Editor: Deliberative democracy and the idiom of insanity. Journalism: Theory, Practice & Criticism, 3(2), 183–204. https://doi.org/10.1177/146488490200300203

Wang, S. (2016). The New York Times is trying to narrow the distance between reporters and analytics data. NiemanLab, July 25. Retrieved from: https://www.niemanlab.org/2016/07/the-new-york-times-is-trying-to-narrow-the-distance-between-reporters-and-analytics-data/

Wherry, F. F., Seefeldt, K. S., & Alvarez, A. S. (2019). To lend or not to lend to friends and kin: Awkwardness, obfuscation, and negative reciprocity. Social Forces, 98(2), 753–793. https://doi.org/10.1093/sf/soy127

Woods, B. (2015). How The Guardian’s Ophan analytics engine helps editors make better decisions. TheNextWeb, April 13. Retrieved from: https://thenextweb.com/media/2015/04/13/how-the-guardians-ophan-analytics-engine-helps-editors-make-better-decisions/

Zamith, R. (2018). Quantified audiences in news production: A synthesis and research agenda. Digital Journalism, 6(4), 418–435. https://doi.org/10.1080/21670811.2018.1444999

Zelizer, V. A. (1994). Pricing the Priceless Child: The Changing Social Value of Children. Princeton, NJ: Princeton University Press.

Zelizer, V. A. (1996). Payments and social ties. Sociological Forum, 11(3), 481–495. https://doi.org/10.1007/BF02408389

Zelizer, V. A. (1997). The Social Meaning of Money. Princeton, NJ: Princeton University Press.

Zelizer, V. A. (2007). The Purchase of Intimacy. Princeton, NJ: Princeton University Press.

Zelizer, V. A. (2010). Economic Lives: How Culture Shapes the Economy. Princeton, NJ: Princeton University Press.

Zelizer, V. A. (2012). How I became a relational economic sociologist and what does that mean? Politics & Society, 40(2), 145–174. https://doi.org/10.1177/0032329212441591

Making Peace with Metrics: Relational Work in Online News Production

Authors

DOI:

Keywords:

Abstract

References

Downloads

Published

How to Cite

Issue

Section

License

Information

Make a Submission

Current Issue