GPT-4 scores 90% in Bar Exam, 88% in LSAT

GPT-4, the upgraded AI model released this week by Microsoft-backed OpenAI, can now outperform most law graduates on the bar exam as per a new study. That places GPT-4 in the 90th percentile of actual test takers and is enough to be admitted to law colleges in most states, read here for more details.

As per a new study, AI-based GPT-4 can outperform most law school graduates on the bar exam, the gruelling two-day test aspiring attorneys must pass to practice law in the United States.

GPT-4, which was released this week by Microsoft-backed OpenAI, scored 297 on the bar exam in an experiment conducted by two law professors and two employees of legal technology company Casetext.

This score has placed GPT-4 in the 90th percentile of actual test takers and is enough to be admitted to practice law in most states, found the researchers, as reported by Economic Times.

The bar exam evaluates reasoning and knowledge and includes essays and performance tests meant to stimulate legal work, as well as multiple-choice questions.

"Large language models can meet the standard applied to human lawyers in nearly all jurisdictions in the United States by tackling complex tasks requiring deep legal knowledge, reading comprehension, and writing ability," the authors wrote.

As per the research, the new GPT-4 got nearly 76% of the bar exam's multiple-choice questions right, up from about 50% for ChatGPT, which was OpenAI's earlier large language model, outperforming the average human test-taker by more than 7%.

Read more:

• A judge should remain a judge forever and not turn into a politician: Former VC of NLUJA
• PIL filed in Delhi HC seeking inclusion of RTE Act as mandatory subject in law colleges