Research
I do not have a lot of publications yet, but I hope that the ones I have right now are of interest for you. If you have any questions or are interested in commenting my work I will be happy to receive any comments.
1.
Font-Julian, Cristina I.; Orduña-Malea, Enrique; Codina, Lluís
ChatGPT Search as a tool for scholarly tasks: evolution or devolution? Journal Article
In: Infonomy, vol. 2, no. 5, pp. 15, 2024, ISSN: 2990-2290.
Abstract | Links | BibTeX | Tags: A-GEO, Academic Generative Engine Optimization, Academic Tasks, AI, ChatGPT, ChatGPT Search, Generative Artificial Intelligente, Information Retrieval, Link Analysis, Narrative Synthesis, Quantitative vs Qualitative, Scholarly Tasks, Search Engines, Web Search
@article{chatgpt-search,
title = {ChatGPT Search as a tool for scholarly tasks: evolution or devolution?},
author = {Cristina I. Font-Julian and Enrique Orduña-Malea and Lluís Codina},
doi = { https://doi.org/10.3145/infonomy.24.059},
issn = {2990-2290},
year = {2024},
date = {2024-11-26},
journal = {Infonomy},
volume = {2},
number = {5},
pages = {15},
abstract = {ChatGPT Search was launched on October 31 by OpenAI as a new AI-powered search engine. Among its features, it stands out for its ability to retrieve information from various online sources, including scholarly databases, which potentially allows the use of this tool for academic tasks, both quantitative and qualitative. To test its features, five academic tasks are designed: two quantitative (collecting hit count estimates from Google Search and scraping bibliometric indicators from ResearchGate); two qualitative tasks (performing a narrative synthesis of an academic topic and generating a brief academic author profile), and a mixed task (identifying, collecting and describing a list of publications from Google Scholar Profiles). The results show the inability of ChatGPT Search to conduct quantitative tasks correctly, fabricating the results (hallucination). Qualitative tasks are performed with better results; however, errors are detected, which prevent recommending the tool without manual analysis and refinement. Finally, the ability to generate links to scientific publications can open up competition among academic sites to be mentioned in the ChatGPT Search responses, giving rise to Academic Generative Engine Optimization (A-GEO).},
keywords = {A-GEO, Academic Generative Engine Optimization, Academic Tasks, AI, ChatGPT, ChatGPT Search, Generative Artificial Intelligente, Information Retrieval, Link Analysis, Narrative Synthesis, Quantitative vs Qualitative, Scholarly Tasks, Search Engines, Web Search},
pubstate = {published},
tppubtype = {article}
}
ChatGPT Search was launched on October 31 by OpenAI as a new AI-powered search engine. Among its features, it stands out for its ability to retrieve information from various online sources, including scholarly databases, which potentially allows the use of this tool for academic tasks, both quantitative and qualitative. To test its features, five academic tasks are designed: two quantitative (collecting hit count estimates from Google Search and scraping bibliometric indicators from ResearchGate); two qualitative tasks (performing a narrative synthesis of an academic topic and generating a brief academic author profile), and a mixed task (identifying, collecting and describing a list of publications from Google Scholar Profiles). The results show the inability of ChatGPT Search to conduct quantitative tasks correctly, fabricating the results (hallucination). Qualitative tasks are performed with better results; however, errors are detected, which prevent recommending the tool without manual analysis and refinement. Finally, the ability to generate links to scientific publications can open up competition among academic sites to be mentioned in the ChatGPT Search responses, giving rise to Academic Generative Engine Optimization (A-GEO).