Web indicators for research evaluation: Part 3: books and non standard outputs

• Kayvan Kousha ^[1] ; Mike Thelwall ^[1]
  1. [1] University of Wolverhampton

     University of Wolverhampton

     GB.ENG.Q3.41UF, Reino Unido

     
• Localización: El profesional de la información, ISSN-e 1699-2407, ISSN 1386-6710, Vol. 24, Nº 6, 2015 (Ejemplar dedicado a: Edición y difusión del libro), págs. 724-736
• Idioma: inglés
• DOI: 10.3145/epi.2015.nov.04
• Títulos paralelos:
  • Indicadores Web para evaluación de la investigación: Parte 3: Libros y resultados académicos no estándar
• Enlaces
  • Texto completo
• Dialnet Métricas: 6 Citas
• Resumen
  • español

    Esta revisión bibliográfica describe indicadores web para evaluar el impacto de libros y otros resultados académicos no estándar, tales como software, bases de datos y videos. Aunque los artículos de revistas dominan la investigación académica en ciencias de la salud y naturales, otros tipos de resultados pueden ser también estimables contribuciones a la ciencia, y son más usuales en otras disciplinas. No siempre es posible obtener indicadores de impacto basados en citas a esas contribuciones debido a su ausencia o a la cobertura incompleta en los índices de citas tradicionales. En este contexto la Web es particularmente valiosa como fuente potencial de indicadores de impacto de los resultados académicos no estándar. El foco principal de esta revisión son los libros, debido a que se han estudiado mucho más y porque son considerados particularmente valiosos en arte y humanidades y en algunas áreas de ciencias sociales.

  • English

    This literature review describes web indicators for the impact of books, software, datasets, videos and other non-standard academic outputs. Although journal articles dominate academic research in the health and natural sciences, other types of outputs can make equally valuable contributions to scholarship and are more common in other fields. It is not always possible to get useful citation-based impact indicators for these due to their absence from, or incomplete coverage in, traditional citation indexes. In this context, the web is particularly valuable as a potential source of impact indicators for non-standard academic outputs. The main focus in this review is on books because of the much greater amount of relevant research for them and because they are regarded as particularly valuable in the arts and humanities and in some areas of the social sciences.

• Referencias bibliográficas
  • Abrizah, Abdullah; Thelwall, Mike (2014). " Can the impact of non-Western academic books be measured? An investigation of Google Books...
  • Anagnostou, Paolo; Capocasa, Marco; Milia, Nicola; Bisol, Giovanni D. (2013). " Research data sharing: Lessons from forensic genetics"....
  • Angus, Emma; Thelwall, Mike; Stuart, David (2008). " General patterns of tag usage among university groups in Flickr". Online information...
  • Borgman, Christine L. (2012). "The conundrum of sharing research data ". Journal of the American Society for Information Science and...
  • Cabezas-Clavijo, Álvaro; Robinson-García, Nicolás; Torres-Salinas, Daniel; Jiménez-Contreras, Evaristo; Mikulka, Thomas; Gumpenberger, Christian;...
  • Chavan, Vishwas S.; Ingwersen, Peter (2009). " Towards a data publishing framework for primary biodiversity data: Challenges and potentials...
  • Chen, Xiaotian (2012). " Google Books and WorldCat: A comparison of their content". Online information review, v. 36, n. 4, pp. 507-516....
  • Chi, Pei-Shan; Jeuris, Wouter; Thijs, Bart; Glänzel, Wolfgang (2015). " Book bibliometrics-a new perspective and challenge in indicator...
  • Cooper, Michael D.; McGregor, George F. (1994). " Using article photocopy data in bibliographic models for journal collection management"....
  • Crowston Kevin Annabi Hala Howison James 2003 Defining open source software project success". In: Procs of the 24th Intl conf on information...
  • Crowston, Kevin; Annabi, Hala; Howison, James; Masango, Chengetai (2004). " Towards a portfolio of Floss project success measures"....
  • Darnton, Robert (2013). "The national digital public library is launched". New York review of books, v. 60, n. 7. http://www.nybooks.com/articles/archives/2013/apr/25/national-digital-public-library-launched
  • Donovan, Claire; Butler, Linda (2007). " Testing novel quantitative indicators of research 'quality', esteem and 'user engagement':...
  • Dullaart, Constant (2014). "High retention, slow delivery ". [Art piece: 2.5 million Instagram followers bought and distributed to...
  • Eccles, Kathryn E.; The lwall, Mike; Meyer, Eric T. (2012). " Measuring the web impact of digitised scholarly resources". Journal...
  • Ga rand, James C.; Giles, Micheal W. (2011). " Ranking scholarly publishers in political science: An alternative approach". PS: Political...
  • Garfield, Eugen (1996). "Citation indexes for retrieval and research evaluation ". Consensus conf on the theory and practice of research...
  • Giménez-Toledo, Elea; Mañana-Rodríguez, Jorge; Engels, Tim; Ingwersen, Peter; Pölönen, Janne; Sivertsen, Gunnar; Verleysen Frederick; Zuccala,...
  • Giménez-Toledo, Elea; Tejada-Artigas, Carlos; Mañana-Rodríguez, Jorge (2013). " Evaluation of scientific books' publishers in social...
  • Glasbey, Chris A.; Horgan, Graham W. (1995). " Image analysis for the biological sciences". Chichester: John Wiley & Sons. ISBN:...
  • Gorraiz, Juan; Gumpenberger, Christian (2010). " Going beyond citations: Serum-A new tool provided by a network of libraries". Liber...
  • Gorraiz, Juan; Gumpenberger, Christian; Purnell, Philip J. (2014). " The power of book reviews: A simple and transparent enhancement approach...
  • Gorraiz, Juan; Purnell, Philip J.; Glänzel, Wolfgang (2013). " Opportunities for and limitations of the book citation index ". Journal...
  • Hammarfelt, Björn (2014). " Using altmetrics for assessing research impact in the humanities". Scientometrics, v. 101, n. 2, pp. 1419-1430....
  • Haran, Brady; Poliakoff, Martyn (20 12). " The periodic table of videos". Science, n. 332, pp. 1046-1047. http://dx.doi.org/10.1126/science.1196980
  • Hartley, James (2006). Reading and writing book reviews across the disciplines. Journal of the American Society for Information Science and...
  • Hefce (2015). The metric tide: Correlation analysis of REF2014 scores and metrics. Su pplementary Report II to the Independent review of the...
  • Hicks, Diana (1999). " The difficulty of achieving full coverage of international social science literature and the bibliometric consequences"....
  • Holmberg, Kim (2015). " Online attention of universities in Finland: Are the bigger universities bigger online too?" In: Procs of...
  • Huang Xiaolei Hawkins Bradford A. Lei Fumin Miller Gary L. Favret Colin Zhang Ruiling Qiao Gexia 2012 Willing or unwilling to share primary...
  • Ingwersen, Peter; Chavan, Vishwas S. (2011). " Indicators for the data usage index (DUI): An incentive for publishing primary biodiversity...
  • James, Ryan (2010). "An assessment of the legibility of Google Books ". Journal of access services, v. 7, n. 4, pp. 223-228. http://dx.doi.org/10.1080/15367967.2010.503486
  • Kousha, Kayvan; Thelwall, Mike (2009). " Google Book Search: Citation analysis for social science and the humanities". Journal of...
  • Kousha, Kayvan; Thelwall, Mike (2014). " An automatic method for extracting citations from Google Books". Journal of the Association...
  • Kousha, Kayvan; Thelwall, Mike (2015). " Alternative metrics for book impact assessment: Can Choice reviews be a useful source?" In:...
  • Kousha, Kayvan; Thelwall, Mike (in press). " Can Amazon. com reviews help to assess the wider impacts of books?". Journal of the Association...
  • Kousha, Kayvan; Thelwall, Mike; Abdoli, Mahshid (2012). " The role of online videos in research communication: A content analysis of YouTube...
  • Kousha, Kayvan; Thelwall, Mike; Rezaie, Somayeh (2010). " Can the impact of scholarly images be assessed online? An exploratory study...
  • Kousha, Kayvan; The lwall, Mike; Rezaie, Somayeh (2011). " Assessing the citation impact of books: The role of Google Books, Google Scholar,...
  • Lim, Yu S.; Feng, David-Dugan; Cai, Tom-Weidong (2000). " A web-based collaborative system for medical image analysis and diagnosis"....
  • Linmans, A. Janus M. (2010). " Why with bibliometrics the humanities does not need to be the weakest link. Indicators for research evaluation...
  • Mayernik, Matthew S.; Callaghan, Sarah; Leigh, Roland; Tedds, Jonathan; Worley, Steven (2015). " Peer review of datasets: When, why, and...
  • Metz, Paul; Stemmer, John (1996). " A reputational study of academic publishers". College and research libraries, v. 57, n. 3, pp....
  • Mooney, Hailey; Newton, Mark P. (2012). " The anatomy of a data citation: Discovery, reuse, and credit". Journal of librarianship...
  • Nicolaisen, Jeppe (2002). " The scholarliness of published peer reviews: A bibliometric study of book reviews in selected social science...
  • Pang, Bo; Lee, Lillian (2008). "Opinion mining and se ntiment analysis". Foundations and trends in information retrieval, v. 2, n....
  • Piwowar, Heather A.; Day, Roger S.; Fridsma, Douglas B. (2007). " Sharing detailed research data is associated with increased citation...
  • Poldrack, Russell A.; Poline, Jean-Bapti ste (2015). " The publication and reproducibility challenges of shared data". Trends in cognitive...
  • Robinson-García, Nicolás; Jiménez-Contreras, Evaristo; Torres-Salinas, Daniel (in press). "Analyzing data citation practices according...
  • Rossi, Bruno; Russo, Barbara; Succi, Giancarlo (2010). " Download patterns and releases in open source software projects: A perfect symbiosis?"....
  • Schonfeld, Roger C.; Housewright, Ross (2010). Faculty survey 2009: Key strategic insights for libraries, pu blishers, and societies. Ithaka...
  • Schröder, Karsten; Lüthen, Holger (2009). " Astrophotography". In: G. D. Roth (eds.), Handbook of practical astronomy. Berlin: Springer,...
  • Shaw, Debora (1991). "An analysis of the relationship between book reviews and fic tion holdings in OCLC". Library and information...
  • Steen, R. Grant (2011). " Retractions in the scientific literature: Do authors deliberately commit research fraud?". Journal of medical...
  • Sud, Pardeep; Thelwall, Mike (2014 b). "Evaluating altmetrics ". Scientometrics, v. 98, n. 2, pp. 1131-1143. http://dx.doi.org/10.1007/s11192-013-1117-2
  • Sud, Pardeep; Thelwall, Mike (2014 a). "Linked title mentions: A new automated link search candidate ". Scientometrics, v. 101, n....
  • Sugimoto, Cassidy R.; Thelwall, Mike (2013). " Scholars on soap boxes: Science communication and dissemination in TED videos". Journal...
  • Taylor, Jim; Walker, Ian (2009). " Peer assessment of research: How many publications per staff?". Lancaster University Management...
  • Tenopir, Carol; Allard, Suzie; Douglass, Kimberly; Aydinoglu, Arsev-Umur; Wu, Lei et al. (2011). "Data sharing by scientists: Practices...
  • Thelwall, Mike (2004). Link analysis: An information science approach. San Diego: Academic Press. ISBN: 0 12 088553 0
  • Thelwall, Mike; Buckley, Kevan; Paltoglou, Georgios; Cai, Di; Kappas, Arvid (2010). " Sentiment strength detection in short informal text"....
  • Thelwall, Mik e; Delgado, María M. (2015). " Arts and humanities research evaluation: No metrics please, just data". Journal of documentation,...
  • Thel wall, Mike; Fairclough, Ruth (2015). " The influence of time and discipline on the magnitude of correlations between citation counts...
  • Thelwall, Mike; Kousha, Kayvan (2015 a). " Web indicators for research evaluation. Part 1: Citations and links to academic articles from...
  • Thelwall, Mike; Kousha, Kayvan (2015 b). "Web indicators for research evaluation. Part 2: Social media metrics ". El profesional de...
  • Thelwall, Mike; Sud, Pardeep; Vis, Farida (2012). " Commenting on YouTube videos: From Guatemalan rock to El Big Bang". Journal of...
  • Thompson, Jennifer W. (2002). "The death of the scholarly monograph in the humanit ies? Citation patterns in literary scholarship"....
  • Torres-Salinas, Daniel; Moed, Henk F. (2009). " Library catalog analysis as a tool in studies of social sciences and humanities: An exploratory...
  • Torres-Sali nas, Daniel; Robinson-García, Nicolás; Jiménez-Contreras, Evaristo; Delgado-López-Cózar, Emilio (2012). " Towards a 'Book...
  • Torres-Salinas, Daniel; Robinson-García, Nicolás; Jiménez-Contreras, Evaristo; Fuente-Gutiérrez, Enrique (in press). " The BiPublishers...
  • Torres-Salinas, Daniel; Rodríguez-Sánchez, Rosa; Robinson-García, Nicolás; Fernández-Valdivia, Joaquín; García, JoséA. (2013). " Mapping...
  • Tsay, Ming-Yueh (1998). " The relationship between journal use in a medical library and citation use". Bulletin of the Medical Library...
  • Vaughan, Liwen (2012). " An alternative data source for web hyperlink analysis: 'Sites Linking In' at Alexa Internet". Collnet...
  • Liwen V.,Rongbin Y. Web data as academic and business quality estimates: A comparison of three data sources Journal of the American Society...
  • Vaughan, Liwen; Yang, R ongbin (2013). " Web traffic and organization performance measures: Relationships and data sources examined"....
  • Weiss, Dawid (2005). " Measuring success of open source projects using web search engines". In: Scotto M., Giancarlo S. (eds.): Procs...
  • Weiss, Andrew; James, Ryan (2013 a). " An examination of massive digital libraries' coverage of Spanish language materials: Issues...
  • Weiss, Andrew; James, Ryan (2013 b). "Assessing the coverage of Hawai ian and pacific books in the Google Books digitization project"....
  • Weller, Ann C. (2001). "Editorial peer revie w: Its strengths and weaknesses". Medford, NJ: Information Today. ISBN: 1 57387 100 1
  • White, Howard D.; Boell, Sebastian K.; Yu, Hairong; Davis, Mari; Wilson, Concepción S.; Cole, Fletcher T. H. (2009). " Libcitations: A...
  • Wilkinson, David; Sud, Pardeep; Thelwall, Mike (2014). " Substance without citation: Evaluating the online impact of grey literature"....
  • Yan, Erjia; Pan, Xuelian (2015). " A bootstrapping method to assess software impact in full-text papers". In: Procs of 15th Intl conf...
  • Zhou, Qingqing; Zhang, Chengzhi (2015). " Can book reviews be used to evaluate books' influence?" In: Procs of 15th Intl conf...
  • Zuccala, Alesia A.; Guns, Raf (2013). " Comparing book citations in humanities journals to library holdings: Scholarly use versus "...
  • Zu ccala, Alesia A.; Guns, Raf; Cornacchia, Roberto; Bod, Rens (2014). " Can we rank scholarly book publishers? A bibliometric experiment...
  • Zuccala, Alesia A.; Verleysen, Frederik T.; Cornacchia, Roberto; Engels, Tim C. (2015). " Altmetrics for the humanities: Comparing Goodreads...
  • Zuccala, Alesia A.; White, Howard D. ( 2015). " Correlating libcitations and citations in the humanities with WorldCat and Scopus Data"....