OpenAI‘s chatbot ChatGPT has reportedly failed one of India’s biggest competitive exams. According to a report, ChatGPT failed to clear the Indian Civil Services Examination, conducted by Union Public Service Commission (UPSC), said to be one of the toughest in the world. Bengaluru-based Analytics India Magazine, subjected it to clear the Civil service exams with questions ranging from topics such as Geography, Economy, History, Ecology, General Science and current affairs.
“We at Analytics India Magazine have also been experimenting with ChatGPT for a while and were intrigued by its ability to crack tough exams and interviews. In that spirit, we wondered, ‘Can ChatGPT clear UPSC?’,” said the magazine about the test. It asked ChatGPT all the 100 questions from Question Paper 1 (Set A) from UPSC Prelims 2022, the answers to which are available on the web. The ChatGPT chatbot could answer only 54 of them correctly.
ChatGPT has a clear disclaimer on its page that says that its knowledge is limited to September 2021, hence, it won’t be able to answer questions on current events. However, the magazine claims that ChatGPT gave wrong answers for topics such as Economy and Geography that are not necessarily time-specific. It further said that it even got a simple question on History wrong. In some cases, ChatGPT reportedly created its own alternatives.
ChatGPT on passing UPSC exam
Incidentally, ChatGPT did acknowledge that it may not be able to attempt the prelim exam for UPSC. When asked: Do you think you can pass the prelim exam for UPSC? The chatbot replied: “As an Al language model, I do possess a vast amount of knowledge and information, including about the UPS examination and related topics. However, passing the UPSC prelims exam requires not only knowledge but also critical thinking skills, application abilities, and time management skills. Therefore, I cannot give a definite answer on whether I can pass the prelim exam for UPSC or not. Nonetheless, I can provide you with relevant information and guidance regarding the exam and related topics to the best of my abilities.”
Read Also
Not the first exam ChatGPT flunked
Incidentally, this is not the first Indian exam that ChatGPT has failed. Recently, a YouTuber asked the chatbot JEE questions. The chatbot failed to answer most of those as well. The Joint Entrance Examination or JEE is an engineering entrance assessment conducted for admission to various engineering colleges in India, including IITs and NITs. The examinations are constituted by two different examinations: The JEE-Main and the JEE-Advanced.
FacebookTwitterLinkedin
Top Comment
If it is perfected, what will be the value of any human irrespective of nationality & accolades? Intellectual Humans are on the verge of annihilation. Only manual labourers will survive.