The library of Babel: assessing the powers of artificial intelligence in knowledge synthesis, learning and development and coaching

Passmore, J. ORCID: https://orcid.org/0000-0003-0832-7510 and Tee, D. (2024) The library of Babel: assessing the powers of artificial intelligence in knowledge synthesis, learning and development and coaching. Journal of Work-Applied Management, 16 (1). pp. 4-18. ISSN 2205-149X doi: 10.1108/jwam-06-2023-0057

Abstract/Summary

Purpose This study aimed to evaluate the potential of artificial intelligence (AI) as a tool for knowledge synthesis, the production of written content and the delivery of coaching conversations. Design/methodology/approach The research employed the use of experts to evaluate the outputs from ChatGPT's AI tool in blind tests to review the accuracy and value of outcomes for written content and for coaching conversations. Findings The results from these tasks indicate that there is a significant gap between comparative search tools such as Google Scholar, specialist online discovery tools (EBSCO and PsycNet) and GPT-4's performance. GPT-4 lacks the accuracy and detail which can be found through other tools, although the material produced has strong face validity. It argues organisations, academic institutions and training providers should put in place policies regarding the use of such tools, and professional bodies should amend ethical codes of practice to reduce the risks of false claims being used in published work. Originality/value This is the first research paper to evaluate the current potential of generative AI tools for research, knowledge curation and coaching conversations.

Item Type	Article
URI	https://reading-clone.eprints-hosting.org/id/eprint/121857
Identification Number/DOI	10.1108/jwam-06-2023-0057
Refereed	Yes
Divisions	Henley Business School > Leadership, Organisations, Behaviour and Reputation
Publisher	Emerald
Download/View statistics	View download statistics for this item