Connect with us

Accounting

Which generative AI model did best on the CPA exam? Depends on the section

Published

on

ChatGPT is no longer the only large language model to pass the CPA exam.

After ChatGPT 3.5 initially bombed the CPA exam and then version 4.0 passed, it does remain the top performer overall. However, like any human accountant, it has its strengths and weaknesses.

These were part of the findings of a recent paper from Case Western Reserve University and accounting automation solutions provider AIgency. The researchers systematically evaluated the performance of Google Gemini, ChatGPT-4, Claude, Mixtral and Llama-2b on multiple-choice questions from CPA test preparation tools.

Overall, they found that ChatGPT-4 scored the best, with Claude 3-opus coming in a close second, followed by Google Gemini Advanced, then Mixtral-8x7b-32768. Llama 2B-70b-4096 did the worst.

Source: William Zacher Jr. & Sanmukh Kuppannagari

However, as the results show, not every model did uniformly well on all sections. ChatGPT, while a strong performer overall, was especially good on the BAR section for business analysis and reporting. Meanwhile, although its weakest point is REG, the regulatory area that is mostly devoted to tax regulations, it did better on this section of the exam than any other model. Claude was the best performer in the AUD section on auditing and attestation. While its weakest point was FAR, the section on financial accounting and reporting, even there its performance was second only to ChatGPT. Gemini was the second strongest performer on the BAR section, but did not do so well on REG. Mixtral, overall, had decent enough scores compared to a human but would only pass BAR, making it a mediocre player compared to its peers. Llama was the only one that would not pass any section, and it did especially poorly on REG. It was also the only one that did worse than a human. The average score for human test takers on REG was 59.19%, according to the paper.

“The study revealed that while some LLMs have made significant advances in mimicking the complex decision-making skills required for CPA exams, there remains variability in performance across different sections of the test,” said the paper. “This variability underlines the importance of tailored training and specialization in developing LLMs for professional applications such as the CPA exams.”

To perform the test, the researchers drew their multiple choice questions from the Becker CPA test preparation suite. Google Gemini, Claude and ChatGPT-4 were accessed via their online platforms. Mixtral and Llama-2b models were accessed through the Groq platform, an advanced computational infrastructure for high-speed AI processing. The questions were directly copied and pasted into the AI platforms from Becker’s test preparation material without any additional prompting or modification to ensure each AI model received the questions in their original form as they would appear in a CPA exam context.

Becker’s platform randomized the questions in batches of 15 questions, which the research said further mitigated potential selection bias. The tester, responsible for inputting the questions into the AI models, deliberately refrained from reading or evaluating the questions beforehand to prevent any unconscious bias in the prompting process. For each question, the tester selected the AI model’s first response marked as “correct,” irrespective of any variations in the explanations or outputs provided by different models.

Each AI model was subjected to each multiple choice section of the CPA test three times, allowing for a comprehensive assessment of its performance across multiple attempts. The criterion for determining an AI model’s success in this study was achieving a passing score, defined as an average score of 75 or higher, on any given section.

The researchers said the data indicates there is no one universal model for all tasks, so it is important to use the right model for the right applications. For example, the paper concluded that ChatGPT is “the only real option for zero-shot BAR automation,” as “no other model came close to its performance, and it had a relatively narrow variance,” meaning that ChatGPT-4 could be used to help with automated financial statement preparation or additional forecasting. On the other hand, the researchers said Claude was probably better on auditing-related tasks, which the paper said “is a solid indication that it can be used for fraud detection and internal control validation.”

“It is apparent from the results that there is no clear-cut winner,” the researchers concluded. “Most companies utilizing AI to perform financial administration functions should use a software infrastructure that allows them to use multiple task-dependent AI models.”

However, the researchers did recommend that “model selection for AI in an applied accounting setting should avoid Llama-2B, which performed worse than any other model in every section.”

Continue Reading

Accounting

Continuous Auditing Transforms Corporate ERPs

Published

on

continuous auditing transforms corporate erps

As corporate accounting departments cross the threshold into late July 2026, the adoption of continuous, automated auditing systems has reached a definitive turning point. Driven by advances in artificial intelligence and deep integration with modern Enterprise Resource Planning (ERP) platforms, leading finance organizations are moving away from traditional, periodic post-hoc audits in favor of real-time, 100% transactional verification. This technological transition is redefining internal control environments, reducing compliance costs, and eliminating the structural delays inherent in legacy quarterly closing processes.

Unlike traditional auditing frameworks that rely on statistical sampling—a process that inevitably leaves operational blind spots—continuous auditing software monitors operational data feeds continuously. Every purchase order, electronic invoice, payroll disbursement, and cross-border wire transfer is automatically cross-referenced against established corporate governance parameters, regulatory tax schedules, and anti-fraud algorithms in real time. Anomalies or unauthorized ledger entries are flagged instantly, allowing internal audit teams to investigate and remediate compliance gaps immediately rather than months after the close of a financial period.

The implications for executive financial management are far-reaching. By embedding continuous verification directly into daily transaction workflows, chief financial officers gain uninterrupted visibility into the organization’s true financial standing. Real-time balance sheet auditing eliminates the severe operational bottlenecks associated with month-end and quarter-end financial reconciliations, freeing accounting professionals to focus on strategic financial modeling, tax planning, and capital allocation rather than manual data entry and spreadsheet consolidation.

However, implementing continuous auditing requires accounting leadership to invest heavily in data governance and technical upskilling. Internal audit teams must evolve from manual ledger reviewers into system architects capable of auditing complex algorithms and validating automated data pipelines. Accounting firms and corporate controllers that master continuous auditing will establish a resilient compliance framework capable of meeting stringent international regulatory standards with total transparency.

Continue Reading

Accounting

U.S. Imposes New 50% Tariffs on Canadian Imports Under Rare Legal Provision

Published

on

U.S. Imposes New 50% Tariffs on Canadian Imports Under Rare Legal Provision

WASHINGTON — In a major escalation of cross-border trade friction, U.S. President Donald Trump has signed executive orders imposing new 50% tariffs on a wide selection of Canadian exports, citing discriminatory practices by Ottawa targeting American auto, dairy, and beverage industries.

The new duties, announced Monday, will take effect in 30 days. They target a broad spectrum of consumer and industrial goods—ranging from wine, liquor, and milk products to commercial cement, furniture, clothing, and hockey equipment.

Untested Legal Mechanism

To enact the sweeping measures, the administration invoked Section 338 of the Tariff Act of 1930—a rarely used legal provision allowing the executive branch to levy additional tariffs of up to 50% on foreign nations deemed to discriminate against U.S. commerce.

White House officials noted that Section 338 addresses trade discrimination rather than national security or economic emergencies. The move comes months after prior global emergency tariffs faced legal challenges in domestic courts, signaling Washington’s pivot toward alternate statutory authorities to maintain import duties.

Senior administration officials briefed reporters that the measure directly responds to Canadian provincial bans on U.S. alcohol, restrictions on American vehicle exports, and import quota disparities affecting U.S. dairy and cheese producers relative to third-party trading partners.

“While the administration continues to secure reciprocal trade agreements globally, Canada retaliated against efforts to protect domestic industry,” U.S. Trade Representative Jamieson Greer stated.

USMCA Impact and Carve-Outs

Significantly, the newly ordered 50% duties will apply to designated items even if they otherwise comply with the United States-Mexico-Canada Agreement (USMCA).

However, the administration confirmed key targeted exemptions:

  • Energy products (including oil and natural gas)
  • Potash and critical minerals
  • Fish and seafood
  • Goods already governed by sector-specific duties (such as existing steel and aluminum tariffs)

Administration representatives emphasized that the tariffs do not stem from recent disputes concerning drifting Canadian wildfire smoke, noting that policy options regarding environmental spillover remain under separate review.

Canadian Response and Market Reaction

Following the White House announcement, the Canadian dollar experienced a sharp decline against the U.S. dollar, falling approximately 0.4% during evening trading.

Canadian Prime Minister Mark Carney issued a statement emphasizing that Canada’s earlier counter-duties had merely matched previous U.S. trade actions. “Canada stands ready to engage intensively to address outstanding issues with the U.S. to the mutual benefit of our citizens,” Carney stated, pointing to detailed proposals Ottawa submitted to modernize the USMCA framework.

Ontario Premier Doug Ford took a firmer stance, urging a “dollar-for-dollar” reciprocal response if the measures go into effect on August 19.

With a 30-day implementation window before the duties officially lock in, industry associations and trade groups on both sides of the border are calling for urgent bilateral negotiations to avert further supply chain disruption across North America.

Continue Reading

Accounting

Automated Continuous Auditing: Transforming Compliance and Real-Time Financial Oversight

Published

on

Transforming Compliance and Real-Time Financial Oversight

The traditional accounting paradigm—defined by periodic monthly closures and post-hoc annual audits—is rapidly giving way to continuous, automated financial oversight. As of July 2026, forward-thinking accounting practices and multinational corporate finance departments are leveraging continuous auditing systems powered by advanced machine learning models. These systems monitor operational transactions in real time, shifting audit methodologies from sample-based post-analysis to absolute, 100% transaction-level verification.

The operational advantages of continuous auditing are transformative. Standard auditing procedures historically relied on statistical sampling, which, despite rigorous methodology, inherently left gaps where anomalies or fraudulent transactions could go undetected for months. Modern continuous auditing platforms integrate directly with enterprise resource planning (ERP) databases, instantly cross-referencing purchase orders, invoices, bank feeds, and tax records. Any deviation from established control parameters or unusual transaction behavior triggers immediate flags for internal audit teams, dramatically reducing detection lag from quarters to seconds.

Beyond fraud prevention, continuous auditing fundamentally alters internal reporting and decision-making. Executive leadership no longer has to wait weeks after the close of a quarter to evaluate precise financial standing; real-time verified ledger data provides an uninterrupted view of operating margins, tax liabilities, and cash flow dynamics. This real-time visibility enables corporate controllers to adjust capital allocation strategies dynamically, mitigating liquidity constraints and capitalizing on emerging commercial opportunities far more efficiently than competitors bound to legacy reporting cycles.

However, implementing continuous auditing requires accounting professionals to acquire new analytical capabilities. The role of the auditor is evolving from manual data reconciliation toward system validation, algorithmic model governance, and strategic risk interpretation. Accounting firms and corporate finance departments must invest in continuous technical education, ensuring that audit staff possess the data engineering skills necessary to design, maintain, and evaluate complex automated compliance systems.

Continue Reading

Trending