Altmetrics data providers: A meta-analysis review of the coverage of metrics and publication

• José-Luis Ortega ^[1]
  1. [1] Consejo Superior de Investigaciones Científicas

     Consejo Superior de Investigaciones Científicas

     Madrid, España

     
• Localización: El profesional de la información, ISSN-e 1699-2407, ISSN 1386-6710, Vol. 29, Nº 1, 2020 (Ejemplar dedicado a: Multidisciplinar / Multidisciplinary)
• Idioma: inglés
• DOI: 10.3145/epi.2020.ene.07
• Enlaces
  • Texto completo
• Dialnet Métricas: 9 Citas
• Resumen

  • The aim of this paper is to review the current and most relevant literature on the use of altmetric providers since 2012. This review is supported by a meta-analysis of the coverage and metric counts obtained by more than 100 publications that have used these bibliographic platforms for altmetric studies. The article is the most comprehensive analysis of altmetric data providers (Lagotto, Altmetric.com, ImpactStory, Mendeley, PlumX, Crossref Event Data) and explores the coverage of publications, social media and events from a longitudinal view. Disciplinary differences were also analysed. The results show that most of the studies are based on Altmetric.com data. This provider is the service that captures most mentions from social media sites, blogs and news outlets. PlumX has better coverage, counting more Mendeley readers, but capturing fewer events. CED has a special coverage of mentions from Wikipedia, while Lagotto and ImpactStory are becoming disused products because of their limited reach.

• Referencias bibliográficas
  • Adams, Jonathan; Loach, Tamar (2015). Digital research report: Altmetric mentions and the communication of medical research. London: Digital...
  • Adie, Euan; Roe, William (2013). “Altmetric: enriching scholarly content with article level discussion and metrics”. Learned publishing, v....
  • Aduku, Kuku-Joseph; Thelwall, Mike; Kousha, Kayvan (2017). “Do Mendeley reader counts reflect the scholarly impact of conference papers? An...
  • Alhoori, Hamed; Furuta, Richard (2014). “Do altmetrics follow the crowd or does the crowd follow altmetrics?”. In: Proceedings of the 14th...
  • Alhoori, Hamed; Choudhury, Sagny-Ray; Kanan, Tarek; Fox, Edward A.; Furuta, Richard; Giles, C. Lee (2015). “On the relationship between open...
  • Allen, Polly (2015). To tweet or not to tweet? Is not the question. Plum Analytics. https://plumanalytics.com/to-tweet-or-not-to-tweet-is-not-the-question
  • Allen, Polly (2016). PlumX’s Facebook Altmetrics – Measure up! Plum Analytics. https://plumanalytics.com/plumx-facebook-altmetrics-measure-up
  • Allen, Polly (2018). Spanish and Portuguese Wikipedia references are now in PlumX metrics. Plum Analytics. https://plumanalytics.com/spanish-portuguese-wikipedia-references-now-plumx-metrics
  • Alperin, Juan-Pablo (2015). “Geographic variation in social media metrics: an analysis of Latin American journal articles”. Aslib journal...
  • Altmetric.com (2019a). Altmetric data timeline. https://www.altmetric.com/about-our-data/data-timeline
  • Altmetric.com (2019b). Altmetric annual research grant. https://www.altmetric.com/research-grant
  • Altmetric.com (2019c). Researcher data access program. https://www.altmetric.com/research-access
  • Altmetric Support (2019). What outputs and sources does Altmetric track? https://help.altmetric.com/support/solutions/articles/6000060968-what-outputs-and-sources-does-altmetric-track-
  • Araujo, Amanda-Costa; Nascimento, Dafne-Port; Gonzalez, Gabrielle-Zoldan; Maher, Christopher G.; Costa, Leonardo-Oliveira-Pena (2018). “Impact...
  • Bar-Ilan, Judit; Haustein, Stefanie; Peters, Isabella; Priem, Jason; Shema, Hadas; Terliesner, Jens (2012). “Beyond citations: Scholars’ visibility...
  • Bar-Ilan, Judit; Halevi, Gali; Milojevic, Staca (2019). “Differences between Altmetric data sources - A case study”. Journal of altmetrics,...
  • Barthel, Simon; Tönnies, Sascha; Köhncke, Benjamin; Siehndel, Patrick; Balke, Wolf-Tilo (2015). “What does Twitter measure?: influence of...
  • Bonasio, Alice (2014). Export directly from Scopus and Science Direct! Mendeley blog. https://blog.mendeley.com/2014/02/03/export-directly-from-scopus-and-science-direct
  • Bornmann, Lutz (2014a). “Validity of altmetrics data for measuring societal impact: A study using data from Altmetric and F1000Prime”. Journal...
  • Bornmann, Lutz (2014b). Which kind of papers has higher or lower altmetric counts? A study using article-level metrics from PLoS and F1000Prime....
  • Bornmann, Lutz (2014c). “Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics”....
  • Bornmann, Lutz (2015a). “Alternative metrics in scientometrics: A meta-analysis of research into three altmetrics”. Scientometrics, v. 103,...
  • Bornmann, Lutz (2015b). “Usefulness of altmetrics for measuring the broader impact of research: A case study using data from PLoS and F1000Prime”....
  • Bornmann, Lutz; Haunschild, Robin (2016a). “How to normalize Twitter counts? A first attempt based on journals in the Twitter Index”. Scientometrics,...
  • Bornmann, Lutz; Haunschild, Robin (2016b). “Overlay maps based on Mendeley data: The use of altmetrics for readership networks”. Journal of...
  • Bornmann, Lutz; Haunschild, Robin (2017). “Measuring field-normalized impact of papers on specific societal groups: An altmetrics study based...
  • Bornmann, Lutz; Haunschild, Robin (2018a). “Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime...
  • Bornmann, Lutz; Haunschild, Robin (2018b). “Normalization of zero-inflated data: An empirical analysis of a new indicator family and its use...
  • Costas, Rodrigo; Zahedi, Zoreh; Wouters, Paul (2015a). “Do ‘altmetrics’ correlate with citations? Extensive comparison of altmetric indicators...
  • Costas, Rodrigo; Zahedi, Zoreh; Wouters, Paul (2015b). “The thematic orientation of publications mentioned on social media: large-scale disciplinary...
  • D’Angelo, Ciriaco-Andrea; Di-Russo, Samuele (2019). “Testing for universality of Mendeley readership distributions”. Journal of informetrics,...
  • Dardas, Latefa-Ali; Woodward, Amanda; Scott, Jewel; Xu, Hanzhang; Sawair, Faleh A. (2018). “Measuring the social impact of nursing research:...
  • De-Filippo, Daniela; Sanz-Casado, Elías (2018). “Bibliometric and altmetric analysis of three social science disciplines”. Frontiers in research...
  • De-Winter, Joost C. (2015). “The relationship between tweets, citations, and article views for PLoS one articles”. Scientometrics, v. 102,...
  • Didegah, Fereshteh; Bowman, Timothy D.; Holmberg, Kim (2016). “Increasing our understanding of altmetrics: identifying factors that are driving...
  • Eléspuru Briceño, Liliana; Huaroto, Libio (2016). “Los repositorios institucionales como herramientas para medir los indicadores Altmetrics:...
  • Erdt, Mojisola; Aw, Ashley-Sara; Aung, Htet-Htet; Mohammadi, Ehsan; Theng, Yin-Leng (2016a). “Investigating Singapore’s altmetric landscape”....
  • Erdt, Mojisola; Nagarajan, Aarthy; Sin, Sei-Ching J.; Theng, Yin-Leng (2016b). “Altmetrics: an analysis of the state-of-the-art in measuring...
  • Fairclough, Ruth; Thelwall, Mike (2015). “National research impact indicators from Mendeley readers”. Journal of informetrics, v. 9, n. 4,...
  • Fang, Zhichao; Costas, Rodrigo (2018). “Studying the Velocity Index for various Altmetric.com data sources”. In: 23rd International conference...
  • Fenner, Martin (2013). “What can article-level metrics do for you?”. PLoS biology, v. 11, n. 10, e1001687. https://doi.org/10.1371/journal.pbio.1001687
  • Gorraiz, Juan; Blahous, Benedikt; Wieland, Martin (2018). “Monitoring the broader impact of the journal publication output on country level:...
  • Hammarfelt, Björn (2014). “Using altmetrics for assessing research impact in the humanities”. Scientometrics, v. 101, n. 2, pp. 1419-1430....
  • Hassan, Saeed-Ul; Gillani, Uzair A. (2016). “Altmetrics of ‘altmetrics’ using Google Scholar, Twitter, Mendeley, Facebook, Google-plus, CiteULike,...
  • Hassan, Saeed-Ul; Imran, Mubashir; Gillani, Uzair A.; Aljohani, Naif-Radi; Bowman, Timothy D.; Didegah, Fereshteh (2017). “Measuring social...
  • Haustein, Stefanie; Bowman, Timothy D.; Macaluso, Benoît; Sugimoto, Cassidy R.; Larivière, Vincent; Borner, Katie (2014a). “Measuring Twitter...
  • Haustein, Stefanie; Costas, Rodrigo; Larivière, Vincent (2015). “Characterizing social media metrics of scholarly papers: The effect of document...
  • Haustein, Stefanie; Larivière, Vincent (2014). “Mendeley as a source of readership by students and postdocs? Evaluating article usage by academic...
  • Haustein, Stefanie; Larivière, Vincent; Thelwall, Mike; Amyot, Didier; Peters, Isabella (2014b). “Tweets vs. Mendeley readers: How do these...
  • Haustein, Stefanie; Peters, Isabella; Bar-Ilan, Judit; Priem, Jason; Shema, Hema; Terliesner, Jens (2014c). “Coverage and adoption of altmetrics...
  • Haustein, Stefanie; Peters, Isabella; Sugimoto, Cassidy R.; Thelwall, Mike; Larivière, Vincent (2014d). “Tweeting biomedicine: An analysis...
  • Holmberg, Kim; Park, Han-Woo (2018). “An altmetric investigation of the online visibility of South Korea-based scientific journals”. Scientometrics,...
  • Htoo, Tint-Hla-Hla; Na, Jin-Cheon (2015). “Comparison of altmetrics across multiple disciplines: Psychology, history, and linguistics”. In:...
  • Htoo, Tint-Hla-Hla; Na, Jin-Cheon (2017). “Disciplinary differences in altmetrics for social sciences”. Online information review, v. 41,...
  • ImpactStory (2019). ImpactStory: Discover the online impact of your research. https://profiles.impactstory.org/search
  • Jabaley, Craig S.; Groff, Robert F.; Stentz, Michael J.; Moll, Vanessa; Lynde, Grant C.; Blum, James M.; O’Reilly-Shah, Vikas N. (2018). “Highly...
  • Joubert, Marina; Costas, Rodrigo (2019). “Getting to know science tweeters: A pilot analysis of South African Twitter users tweeting about...
  • Knight, Simon R. (2014). “Social media and online attention as an early measure of the impact of research in solid organ transplantation”....
  • Kolahi, Jafar; Iranmanesh, Pouya; Khazaei, Saber (2017). “Altmetric analysis of 2015 dental literature: a cross sectional survey”. British...
  • Kousha, Keyvan; Thelwall, Mike (2017). “Are Wikipedia citations important evidence of the impact of scholarly articles and books?”. Journal...
  • Kraker, Peter; Lex, Elisabeth; Gorraiz, Juan; Gumpenberger, Christian; Peters, Isabella (2015). “Research data explored II: The anatomy and...
  • Luo, Feighen; Sun, Aixin; Erdt, Mojisola; Raamkumar, Aravind S.; Theng, Yin L. (2018). “Exploring prestigious citations sourced from top universities...
  • Maggio, Lauren A.; Leroux, Todd C.; Meyer, Holly S.; Artino Jr, Anthony R. (2018). “#MedEd: exploring the relationship between altmetrics...
  • Maricato, João-De-Melo; Filho, Jayme-Leiro-Vilan (2018). “The potential for altmetrics to measure other types of impact in scientific production:...
  • Mas-Bleda, Amalia; Thelwall, Mike (2016). “Can alternative indicators overcome language biases in citation counts? A comparison of Spanish...
  • Meschede, Christine; Siebenlist, Tobias (2018). “Cross-metric compatability and inconsistencies of altmetrics”. Scientometrics, v. 115, n....
  • Mohammadi, Ehsan; Thelwall, Mike (2014). “Mendeley readership altmetrics for the social sciences and humanities: Research evaluation and knowledge...
  • Mohammadi, Ehsan; Thelwall, Mike; Haustein, Stefanie; Larivière, Vincent (2015). “Who reads research articles? An altmetrics analysis of Mendeley...
  • NISO (2016). Outputs of the NISO alternative assessment metrics project. NISO RP-25-2016. https://bit.ly/2SXCEym
  • Nuredini, Kaltrina; Peters, Isabella (2016). “Enriching the knowledge of altmetrics studies by exploring social media metrics for Economic...
  • https://www.econstor.eu/bitstream/10419/146879/1/enriching-knowledge-altmetrics-economic-business-studies-journals.pdf https://ideas.repec.org/p/zbw/esconf/146879.html
  • Orduña-Malea, Enrique; Delgado-López-Cózar, Emilio (2019). “Demography of altmetrics under the light of Dimensions: Locations, institutions,...
  • Ortega, José-Luis (2016a). Social network sites for scientists: A quantitative survey. Oxford, UK: Chandos Publishing (Elsevier Group), 198...
  • Ortega, José-Luis (2016b). “To be or not to be on Twitter, and its relationship with the tweeting and citation of research papers”. Scientometrics,...
  • Ortega, José-Luis (2017). “The presence of academic journals on Twitter and its relationship with dissemination (tweets) and research impact...
  • Ortega, José-Luis (2018a). “Disciplinary differences of the impact of altmetric”. FEMS microbiology letters, v. 365, n. 7, fny049. https://doi.org/10.1093/femsle/fny049
  • Ortega, José-Luis (2018b). “Reliability and accuracy of altmetric providers: a comparison among Altmetric.com, PlumX and Crossref Event Data”....
  • Ortega, José-Luis (2019a). “The coverage of blogs and news in the three major altmetric data providers”. In: 17th International conference...
  • Ortega, José-Luis (2019b). “Availability and audit of links in altmetric data providers: link checking of blogs and news in Altmetric.com,...
  • Ortega, José-Luis (2019c). “Blogs and news sources coverage in altmetrics data providers: A comparative analysis by country, language, and...
  • Peters, Isabella; Jobmann, Alexandra; Eppelin, Anita; Hoffmann, Christian P.; Künne, Sylvia; Wollnik-Korn, Gabriele (2014a). “Altmetrics for...
  • Peters, Isabella; Jobmann, Alexandra; Hoffmann, Christian P.; Künne, Sylvia; Schmitz, Jasmin; Wollnik-Korn, Gabriele (2014b). “Altmetrics...
  • Peters, Isabella; Kraker, Peter; Lex, Elisabeth; Gumpenberger, Christian; Gorraiz, Juan (2015). “Research data explored: Citations versus...
  • Peters, Isabella; Kraker, Peter; Lex, Elisabeth; Gumpenberger, Christian; Gorraiz, Juan (2016). “Research data explored: An extended analysis...
  • PLoS (2019). Article-level metrics > Sources > Facebook. https://alm.plos.org/docs/facebook
  • Plum Analytics (2019). “Coverage: Expanding the world of altmetrics”. Plum Analytics. https://plumanalytics.com/learn/about-metrics/coverage
  • Pooladian, Aida; Borrego, Ángel (2016). “A longitudinal study of the bookmarking of library and information science literature in Mendeley”....
  • Priem, Jason; Piwowar, Heather; Hemminger, Bradley M. (2012). “Altmetrics in the wild: Using social media to explore scholarly impact”. arXiv...
  • Repiso, Rafael; Castillo, Antonio; Torres-Salinas, Daniel (2019). “Altmetrics, alternative indicators for Web of Science communication studies...
  • Robinson-García, Nicolás; Arroyo-Machado, Wenceslao; Moed, Henk; Torres-Salinas, Daniel (2018). “Do altmetrics promote open access? An exploratory...
  • Robinson-García, Nicolás; Arroyo-Machado, Wenceslao; Torres-Salinas, Daniel (2019). “Mapping social media attention in Microbiology: Identifying...
  • Robinson-García, Nicolás; Torres-Salinas, Daniel; Zahedi, Zohreh; Costas, Rodrigo (2014). “New data, new possibilities: Exploring the insides...
  • Rosenkrantz, Andrew B.; Ayoola, Abimbola; Singh, Kush; Duszak Jr, Richard (2017). “Alternative metrics (‘altmetrics’) for assessing article...
  • Scopus (2014) “Mendeley readership statistics available in Scopus”. Scopus blog. https://blog.scopus.com/posts/mendeley-readership-statistics-available-in-scopus
  • Scott, Catriona; Farrow, Paul; Young, Fran (2015). “Use of Twitter and other social media to disseminate specialist clinical research: analysis...
  • Thelwall, Mike (2018). “Altmetric prevalence in the social sciences, arts and humanities: Where are the online discusions?”. Journal of altmetrics,...
  • Thelwall, Mike; Nevill, Tamara (2018). “Could scientists use Altmetric.com scores to predict longer term citation counts?”. Journal of informetrics,...
  • Thelwall, Mike; Wilson, Paul (2016). “Mendeley readership altmetrics for medical articles: An analysis of 45 fields”. Journal of the Association...
  • Torres-Salinas, Daniel; Castillo-Valdivieso, Pedro-Ángel; Pérez-Luque, Álvaro; Romero-Frías, Esteban (2018b). “Altmétricas a nivel institucional:...
  • Torres-Salinas, Daniel; Gorraiz, Juan; Robinson-García, Nicolás (2018a). “The insoluble problems of books: what does Altmetric.com have to...
  • Torres-Salinas, Daniel; Gumpenberger, Christian; Gorraiz, Juan (2017b). “PlumX as a potential tool to assess the macroscopic multidimensional...
  • Torres-Salinas, Daniel; Milanés-Guisado, Yusnelkis (2014). “Presencia en redes sociales y altmétricas de los principales autores de la revista...
  • Torres-Salinas, Daniel; Robinson-García, Nicolás; Gorraiz, Juan (2017a). “Filling the citation gap: measuring the multidimensional impact...
  • Torres-Salinas, Daniel; Robinson-García, Nicolás; Jiménez-Contreras, Evaristo (2016). “Can we use altmetrics at the institutional level? A...
  • Van-Honk, Jeroen; Costas, Rodrigo (2016). “Integrating context in Twitter metrics: Preliminary investigation on the possibilities of hashtags...
  • Wang, Xianwen; Fang, Zhichao; Li, Qingchun; Guo, Xinhui (2016). “The poor altmetric performance of publications authored by researchers in...
  • Wang, Xianwen; Liu, Chen; Fang, Zhichao; Mao, Wenli (2014). “From attention to citation, what and how does altmetrics work?”. arXiv preprint,...
  • Williams, Catherine (2015). “Altmetric to provide expanded mainstream media tracking”. Altmetric blog. https://www.altmetric.com/blog/moreover
  • Wolcott, Holly; Williams, Duane; Antman, Melissa; Corrigan, James; Burgess, Christine (2019). “Can altmetrics supplement citation analysis...
  • Wooldridge, Jenny; King, Mike B. (2019). “Altmetric scores: An early indicator of research impact”. Journal of the Association for Information...
  • Yu, Houqiang (2017). “Context of altmetrics data matters: an investigation of count type and user category”. Scientometrics, v. 111, n. 1,...
  • Yu, Houqiang; Xu, Shenmeng; Xiao, Tingting; Hemminger, Bradley M.; Yang, Siluo (2017). “Global science discussed in local altmetrics: Weibo...
  • Zahedi, Zohreh; Costas, Rodrigo (2018). “General discussion of data quality challenges in social media metrics: Extensive comparison of four...
  • Zahedi, Zohreh; Costas, Rodrigo; Wouters, Paul (2014a). “Assessing the impact of the publications read by the different Mendeley users: Is...
  • Zahedi, Zohreh; Costas, Rodrigo; Wouters, Paul (2014b). “How well developed are altmetrics? A cross-disciplinary analysis of the presence...
  • Zahedi, Zohreh; Fenner, Martin; Costas, Rodrigo (2014c). “How consistent are altmetrics providers? Study of 1000 PLoS one publications using...
  • Zahedi, Zohreh; Fenner, Martin; Costas, Rodrigo (2015). “Consistency among altmetrics data provider/aggregators: What are the challenges?”....
  • Zahedi, Zohreh; Haustein, Stefanie; Bowman, Timothy (2014d). “Exploring data quality and retrieval strategies for Mendeley reader counts”....
  • Zahedi, Zohreh; Van-Eck, Nees J. (2018). “Exploring topics of interest of Mendeley users”. Journal of altmetrics, v. 1, n. 1. https://doi.org/10.29024/joa.7
  • Zhang, Xi; Wang, Xianhai; Zhao, Hongke; Ordóñez-De-Pablos, Patricia; Sun, Yongqiang; Xiong, Hui (2019). “An effectiveness analysis of altmetrics...