Research on 'ChatGPT' in Turkish high schools: Students using artificial intelligence score lower

A study conducted with high school students has determined that the use of ChatGPT negatively affects learning. 

The emergence of artificial intelligence chatbots has made accessing information easier, just like the internet.

On the other hand, some experts believe that tools like ChatGPT could lead to a decline in academic success. 

Some studies suggest that these tools may increase procrastination behaviors and lead to a decline in memory.

NO INCREASE IN CHEATING RATES

At the same time, although it is thought that ChatGPT would make cheating easier, a study conducted last year noted that artificial intelligence chatbots did not cause an increase in cheating rates.

According to the report in Independent Türkçe, approximately 1,000 students in grades 9 through 11 at a high school in Turkey participated in the study in the fall of 2023. 

Following a mathematics lesson taught in class, students were divided into three groups and given practice assignments on the subject. One group did the assignment with the help of ChatGPT, some with a ChatGPT-supported artificial intelligence tutor, and others on their own. 

The ChatGPT-supported tutor was programmed to show the path to the result without giving the answer directly. 

Later, the grades received by the students who took an exam on the subject were evaluated.

STUDENTS USING ARTIFICIAL INTELLIGENCE SCORED LOWER

The findings of the research, which has not yet been published in a peer-reviewed journal, were shared on the Social Science Research Network (SSRN), a website that publishes pre-print versions of articles.

Although students using ChatGPT reached 48 percent more correct answers in practice questions than those working alone, they scored 17 percent lower in the subsequent exam.

Students who benefited from the artificial intelligence tutor performed 127 percent better in the practice than those who did not use artificial intelligence. However, no difference was recorded between the two groups in the exam results. 

ARTIFICIAL INTELLIGENCE ALSO GIVES WRONG ANSWERS TO QUESTIONS

The team believes this problem stems from students using the tools to reach the answer directly. 

However, the fact that ChatGPT also gives wrong answers to questions may play a role in this. It was observed that the artificial intelligence tool, which gives wrong answers to questions at a rate of 8 percent, also explained the solution to the problem incorrectly at a rate of 42 percent. 

Researchers advise students not to rely solely on these tools as they may negatively affect the learning process.