Can LLMs Simulate Novice Programmers' Misconceptions?
arXiv:2610.10656v1 Announce Type: new Abstract: We evaluate 13 LLMs on generating, solving, simulating, and diagnosing novice programming misconceptions on code-tracing problems. While frontier models reliably perform these tasks, small models ($\le$14B) struggle with dynamic execution. Notably, code-tuned models fail during misconception simulation by reverting to correct execution. Finally, misconception diagnosis is significantly easier in True/False formats than in open-ended generation tasks.
原文：https://www.a8q9.cn/en/article/can-llms-simulate-novice-programmers-misconceptions-0d92f1.html