構繪研究影響力科學的不同世代:對衡量指標、框架與預測方法的範域文獻回顧
Mapping the Generations of Research Impact Science: A Scoping Review of Metrics' Frameworks' and Predictive Approaches
澳洲西雪梨大學資訊與數據科學院(School of Computer, Data and Mathematical Sciences, Western Sydney University, Penrith, Australia);澳洲斯威本理工大學設計創新中心(Centre for Design Innovation, Swinburne University of Technology, Melbourne, Australia)
摘要
本文對研究影響力評估框架進行系統性範域文獻回顧,採Arksey與O’Malley(2005)提出、Levac等人(2010)改良、並對應PRISMA-ScR準則的方法,查找Scopus、Web of Science、PubMed、IEEE Xplore、Google Scholar以及灰色文獻後,篩選出有關評估框架、標準和方法之139篇研究論文。研究影響力科學的發展從引文測量轉變至複雜的資料驅動,分為四個世代:第一代書目計量著重於出版生產力;第二代多維框架納入社會、經濟和政策指標;第三代資料驅動整合機器學習和預測分析;第四代另類計量掌握即時數位參與。主要挑戰包括標準化受限、地區性偏誤,以及新興技術運用不足,故本研究指出需建立預測性多維框架和標準化分類,提升影響力評估的擴展性和前瞻性,有助精進評估方法,以面對社會挑戰並指引策略研究之經費補助。
Abstract
This scoping review systematically examines the evolution of research impact assessment frameworks, categorising their development into 4 generations. The study follows Arksey and O’Malley’s (2005) scoping review methodology, enhanced by Levac et al. (2010) and aligned with PRISMA-ScR guidelines. A comprehensive search was conducted across Scopus, Web of Science, PubMed, IEEE Xplore, and Google Scholar, as well as grey literature, to identify relevant studies on research impact frameworks, metrics, and methodologies. A total of 139 studies were selected based on predefined inclusion criteria, encompassing bibliometric indices, multidimensional frameworks, predictive analytics, and alternative metrics.
The findings highlight the transition from traditional citation-based measures to sophisticated, data-driven methodologies. The first generation (bibliometric indices) included 26 key metrics focusing on publication productivity. The second generation introduced 41 multidimensional frameworks incorporating societal, economic, and policy indicators. The third-generation integrated machine learning and predictive analytics to assess impact across 17 aspects and 9 data-driven factors. The fourth generation utilised 16 alternative metrics, including Altmetric Attention Scores and PlumX Metrics, to capture real-time digital engagement.
Key challenges identified include limited standardisation, regional biases, and the under-exploitation of emerging technologies, such as large language models. The study underscores the need for predictive multidimensional frameworks and standardised taxonomies to enhance scalability and foresight in impact assessment. By structuring the evolution of research impact science, this review provides actionable insights to refine assessment methodologies, ensuring their relevance for addressing societal challenges and guiding strategic research investments.
關鍵詞
- 類型
- 論文
- 期刊
- 圖書資訊學刊
- ISSN
- 1606-7509
- 卷期
- 23卷1期
- 出版
- 2025年06月
- 頁碼
- 001–077
- 編號
- NTUEJ00004473
同期目錄
- 構繪研究影響力科學的不同世代:對衡量指標、框架與預測方法的範域文獻回顧Mudassar Arsalan;Omar Mubin;Abdullah Al Mahmud・頁 001–077
- 以書目計量法分析新冠疫情對中國大學生心理健康研究的影響朱哲賢(Zhexian Zhu);Michela Montesi・頁 079–108
- 建構替代性社交互動設計:一個透過圖書館互動緩解社交焦慮症的系統張登文(Teng-Wen Chang);黃馨儀(Hsin-Yi Huang);簡湘婷(Hsiang-Ting Chien);蔡仕廷(Shih-Ting Tsai)・頁 109–136
- 聖經書目療法的本質:自助還是創意?邱炯友(Jeong-Yeou Chiu)・頁 137–164
- 論學位論文即時網路公開為畢業條件:現況與檢討何萬順(One-Soon Her);何姵萱(Pei-Hsuan Ho);林映辰 (Ying-Chen Lin);林雯瑤(Wen-Yau Cathy Lin)・頁 165–200
- 傅斯年圖書館藏陸僎跋《杜工部集》鈔本考論——以吳若本為中心張其秀(Qi-Xiu Zhang);綦維( Wei Qi )・頁 201–228
- 鄭玄撫系統《玉臺新詠》版本述考鮑功瀚 (Gong-Han Bao)・頁 229–257