论文发表当期期刊封面：

论文题目：

Performance of ChatGPT and Bard on the Medical Licensing Examinations Varies across Different Cultures: a Comparison Study

论文作者：

Yikai Chen, Xiujie Huang, Fangjie Yang, Haiming Lin, Haoyu Lin, Zhuoqun Zheng, Qifeng Liang, Jinhai Zhang, Xinxin Li

论文摘要：

Background: This study aimed to eva luate the performance of GPT-3.5, GPT-4, GPT-4o and Google Bard on the United States Medical Licensing Examination (USMLE), the Professional and Linguistic Assessments Board (PLAB), the Hong Kong Medical Licensing Examination (HKMLE) and the National Medical Licensing Examination (NMLE). Methods: This study was conducted in June 2023. Four LLMs (Large Language Models) (GPT-3.5, GPT-4, GPT-4o and Google Bard) were applied to four medical standardized tests (USMLE, PLAB, HKMLE and NMLE). All questions are multiple-choice questions and were sourced from the question banks of these examinations. Results: In USMLE step 1, step 2CK and Step 3, there are accuracy rates of 91.5%, 94.2% and 92.7% provided from GPT-4o, 93.2%, 95.0% and 92.0% provided from GPT-4, 65.6%, 71.6% and 68.5% provided from GPT-3.5, and 64.3%, 55.6%, 58.1% from Google Bard, respectively. In PLAB, HKMLE and NMLE, GPT-4o scored 93.3%, 91.7% and 84.9%, GPT-4 scored 86.7%, 89.6% and 69.8%, GPT-3.5 scored 80.0%, 68.1% and 60.4%, and Google Bard scored 54.2%, 71.7% and 61.3%. There was significant difference in the accuracy rates of four LLMs in the four medical licensing examinations. Conclusion: GPT-4o performed better in the medical licensing examinations than other three LLMs. The performance of the four models in the NMLE examination needs further improvement.

基金项目：

1.       汕头大学医学院本科教学质量与教学改革工程项目（2023 No.25）

2.       广东省“新医科”教指委教学改革项目（2023 NO.122）

3.       广东省临床教学基地教学改革项目(2023 NO.32)

4.       广东省本科高校高等教育教学改革项目（No.583）；

5.       广东省临床教学基地教学改革项目（No.128）；

6.       教育部产学合作协同育人项目（No.230805236050915）

第一作者简介：

陈奕楷：汕头大学医学院2023级硕士生

黄秀杰：汕头大学医学院2023级硕士生

通讯作者简介：

李欣欣：外科学博士，胃肠外科主任医师；硕士研究生导师，博士后合作导师；汕头大学医学院第一附属医院大外科主任；规培医生全程导师、专培导师、全英教师、汕头大学生物医学工程系医学导师，汕头市高层次人才，汕头市健康科普专家，岭南名医。

学术任职：

广东省医学会加速康复外科学分会常委

广东省抗癌协会大肠癌专业委员会青委会常委

广东省临床医学学会结直肠外科学专业委员会常委

广东省医师协会加速康复外科医师分会青年专业组副组长

汕头市抗癌协会肿瘤MDT专业委员会副主任委员

汕头市医学会结直肠肛门外科学专业委员会副主任委员等

以第一作者或通讯作者发表SCI论文10余篇; 以第一发明人参与设计开发的医疗器械获国家实用新型4项，发明专利3项。