AI Index Report-2024: AI still behind humans on complex tasks like competition-level mathematics

Published On: April 16, 2024 07:15 PM NPT By: Republica  | @RepublicaNepal

KATHMANDU, April 16: In the wake of trepidation, optimism and bewilderment lumped together with the spurt and influence of artificial intelligence (AI), research and studies on AI have surged lately across the globe. 

In this connection, the Human-Centered Artificial Intelligence (HAI) at Stanford University released an annual report on AI on Monday. The seventh edition report- 'Artificial Intelligence Index Report, 2024' has comprehensively studied the AI trend in multiple fronts ranging from education to accountability, research to development, and economy to medicine.

One of the significant messages the report has underlined is: 'AI beats humans on some tasks, but not on all'. There are ten takeaways in the wide-ranging report fit in 500 plus pages with extensive use of data and comparative analyses. 

In the first takeaway it wrote, "AI has surpassed human performance on several benchmarks, including some in image classification, visual reasoning, and English understanding. Yet it trails behind on more complex tasks like competition-level mathematics, visual commonsense reasoning and planning."

The report is dovetailed in nine chapters focusing research and development, technical performance, responsible AI, economy, science and medicine, education, policy and governance, diversity, and public opinion.

AI patent shifting from US to East Asia and Pacific

Taking reference from the Center for Security and Emerging Technology, 2023, the report has shown shifting AI patents. Comparing the data from 2010 to 2022, the report showed AI patents highly concentrated in East Asia and the Pacific – 75.2 percent, which is trailed by North America with 21.2 percent. North America was leading the AI patent till 2011.

However, the US leads the top AI model in the world. In the last year, 2023, the institutions based in the US produced 61 modes of AI while it is followed by the European Union with 21 models and China 15 models.



Leave A Comment