Connect with us

Accounting

Microsoft researchers teach LLMs to use spreadsheets well

Published

on

Large language models like ChatGPT have traditionally had trouble reading and interacting with spreadsheets, limiting their application in this realm, but recent research from Microsoft claims to have found an answer. 

The paper, SPREADSHEETLLM: Encoding Spreadsheets for Large Language Models, described the problems LLMs typically face with spreadsheets and proposed what it called the “SheetCompressor” framework to address them. 

The issue LLMs have with spreadsheets has to do with tokenage requirements. LLMs, generally, run on “tokens,” which are the basic units of data the model processes. Tokens are words, character sets, or combinations of words and punctuation that are used by large language models to decompose text into. LLMs operate by converting input text into a series of tokens, which the model then uses to understand and generate responses. 

The number of tokens determines the computational cost and capacity needed to handle the input, making token management crucial, especially for complex data like spreadsheets. For example, the phrase, “I heard a dog bark loudly at a cat” would be represented by eight tokens, one for each unique word. In order to preserve system resources, many LLMs have token limits, but even in a limitless environment, complex jobs are resource intensive, with significant computational effort that affects both performance and efficiency. 

Typically, each part of a spreadsheet — even blank cells or repeating cells or those with irrelevant information — costs tokens, meaning even a simple spreadsheet has a much higher token requirement than traditional text. Furthermore, LLMs often struggle with spreadsheet-specific features such as cell addresses and formats, complicating their ability to effectively parse and utilize spreadsheet data. These challenges have limited just how much generative AI models can be applied to reading and interacting with spreadsheets. Considering how many spreadsheets the profession tends to use, this consequently limits their application towards deep accounting work. 

What Microsoft researchers discovered, in short, is that the LLM does not need to burn tokens reading and processing the entire spreadsheet. Instead people can create a compressed version of the document to function as something like an index, with markers or “anchors” indicating especially important information like totals. Additional compression comes from grouping together similar types of data like date columns. So, in a sense, the LLM does not work through the spreadsheet itself but instead references it via a much more efficient index. 

Complex spreadsheets are further supported through a concept called “chain of spreadsheet,” which is similar to “chain of thought” prompting. The method unfolds in two stages. First, the model identifies the table that is relevant to the query and determines the precise boundaries of the relevant content. This step ensures that only pertinent data is considered in the subsequent analysis. Then, the query and the identified table section are re-input into the LLM. The model then processes this information to generate an accurate response to the query.

“Through the CoS, SPREADSHEETLLM effectively handles complex spreadsheets by breaking down the process into manageable parts, thus enabling precise and context-aware responses,” said the paper. 

Experiments with this method found that it significantly increased performance on larger spreadsheets where token limits are a particular challenge. The F1 score (which is used to measure the accuracy of an AI model) for massive spreadsheets was 75% higher than GPT-4 and 19% higher than TableSense-CNN, another spreadsheet methodology for AI; for large spreadsheets, the difference was 45% and 17% respectively; for medium spreadsheets it was 13% and 5%; and for small spreadsheets it was 8%. Overall, the results show that while the method gets more effective the larger the spreadsheet, it can still improve the efficiency of even small spreadsheets. 

“Through a novel encoding method, SHEETCOMPRESSOR, this framework effectively addresses the challenges posed by the size, diversity, and complexity inherent in spreadsheets,” the paper concluded. “It achieves a substantial reduction in token usage and computational costs, enabling practical applications on large datasets. The fine-tuning of various cutting-edge LLMs further enhances the performance of spreadsheet understanding. Moreover, Chain of Spreadsheet, the framework’s extension to spreadsheet downstream tasks illustrates its broad applicability and potential to transform spreadsheet data management and analysis, paving the way for more intelligent and efficient user interactions.”

Implications

Donny Shimamoto, founder and managing director of accounting tech-focused accounting firm IntrapriseTechKnowlogies said, by enabling LLMs to “understand” tabular spreadsheets, accountants will have increased ability to either summarize or analyze a set of data. More than that, however, he said this will likely allow even non-accountants to do the same, removing the accountant as the middle person. However while some accountants may see this as a threat, he said what this would mainly do is clear the majority of simple inquiries from their plates, letting them save their energy for more complex questions and deeper analysis.

“Implementing something like this will require good testing to ensure that the risk of hallucinations is minimized, especially if it is going to help provide non-accountants with information to support decision-making,” said Shimamoto.

David Wood, a Bringham Young University accounting professor who specializes in AI within the profession, raised a similar point, as it would allow those without significant technical knowledge to do the same kinds of tasks that, previously, could only be done by seasoned accounting experts. He raised the example of novices being able to use generative AI to make spreadsheets that only expert professionals could put together. However, while he thinks this could be possible soon, he said that, despite the Microsoft research, it hasn’t arrived just yet.

“However, there are at least three challenges holding back using GenAI with spreadsheets: the size and complexity of the spreadsheets, and the required accuracy for most uses of spreadsheets. This paper takes a large step in the right direction, but it doesn’t solve all the challenges and more work will still be needed in each of these three areas. It would be a mistake to assume that after reading this paper, we have fully figured out how to use spreadsheets and GenAI together. More work is still needed. … I think the path these researchers are taking is significant, but the research “hasn’t arrived yet” meaning that more work is needed. The accuracy rates are just not high enough…yet. Hopefully this paves the way for the next researcher to move it forward further.” he said in an email.

Continue Reading

Accounting

AI-Driven Automation and Continuous Accounting Frameworks

Published

on

The accounting profession is undergoing a fundamental structural transition as enterprise finance departments shift from periodic month-end closes toward automated continuous accounting models. By integrating specialized machine learning algorithms directly into enterprise resource planning (ERP) platforms, chief accounting officers are transforming financial reporting from a retrospective exercise into a real-time operational asset.

The Shift from Periodic Close to Continuous Financial Reporting
Traditional accounting workflows heavily relied on manual data reconciliation, spreadsheet calculations, and multi-week closing cycles at the end of each fiscal period. In contrast, continuous accounting frameworks utilize automated software agents to process, validate, and post transactional data in real time as business activities occur.

Automated bank reconciliation tools cross-reference incoming bank feeds, invoice records, and purchase orders automatically. By resolving transactional variances instantly throughout the month, corporate accounting teams eliminate the traditional workload spikes associated with quarterly and annual closes.

Machine Learning in Audit Trails and Anomaly Detection
Advanced natural language processing (NLP) and machine learning tools are redefining internal audit and financial control environments. Automated systems analyze 100% of general ledger entries, identifying anomalous transactions, duplicate payments, and unauthorized journal entries in real time.

Rather than relying on random statistical sampling, corporate internal auditors can focus their attention on high-risk flags automatically surfaced by algorithmic monitoring platforms. This continuous risk assessment strengthens internal controls over financial reporting (ICFR) and significantly reduces fraud risk.

Evolving Roles for Accounting Professionals
As routine data entry and manual reconciliation tasks become fully automated, the skill set required for accounting professionals is shifting toward data analysis, system design, and strategic business advisory.
– Systems Governance: Accountants are increasingly responsible for monitoring algorithmic accuracy and managing data integration pipelines.
– Business Partnership: Finance professionals leverage real-time financial dashboards to advise operational leaders on margin management and working capital allocation.
– Regulatory Compliance Management: Accounting teams utilize automated platforms to ensure compliance with dynamic tax codes and international accounting standards.

Core Implementation Recommendations
1. Deploy Automated Reconciliation Tools: Integrate continuous transaction processing modules into existing enterprise ERP architectures.
2. Establish Algorithmic Governance Controls: Implement strict internal testing protocols to ensure automated accounting rules comply with GAAP/IFRS standards.
3. Reskill Accounting Teams: Invest in training finance staff on data analytics, workflow automation, and predictive financial modeling.

Continue Reading

Accounting

Global ESG Reporting Standards and Double Materiality Compliance

Published

on

Corporate accounting departments face expanding reporting expectations as international sustainability disclosure standards achieve regulatory enforcement across major global jurisdictions. Chief Accounting Officers (CAOs) and corporate controllers are establishing rigorous internal accounting controls to treat Environmental, Social, and Governance (ESG) metrics with the same data precision, auditability, and governance as traditional financial statements.

Regulatory Harmonization Under Global Sustainability Frameworks
The implementation of standardized sustainability reporting frameworks—notably rules established by international sustainability accounting boards—has created unified expectations for public and large private enterprises. Corporations must report standardized metrics covering greenhouse gas emissions (Scope 1, 2, and material Scope 3), energy utilization, workforce demographics, and supply chain governance.

In Europe and other participating international jurisdictions, double materiality principles are mandatory. Under double materiality, organizations must report both how external sustainability risks impact corporate financial performance, and how internal corporate operations affect surrounding environmental and social structures.

Integrating Sustainability Metrics into Core ERP Systems
To provide auditable non-financial data, enterprise organizations are integrating specialized carbon accounting and ESG management platforms directly into core ERP systems. Automated data collectors capture energy utility invoices, logistics fuel consumption metrics, and vendor compliance records in real time.

Establishing automated, traceable data pipelines ensures that non-financial reporting is supported by clear audit trails. This structured approach allows external financial auditors to provide reasonable assurance on sustainability disclosures during annual corporate reporting cycles.

Financial Impacts and Capital Market Disclosure
Accurate ESG reporting directly influences corporate cost of capital and institutional credit ratings. Commercial lenders and institutional asset managers systematically incorporate sustainability metrics into risk pricing models. Companies that demonstrate transparent, verifiable progress in operational energy efficiency and climate risk mitigation benefit from expanded access to green bond markets and lower debt pricing.

Action Steps for Accounting Leadership
1. Implement Double Materiality Frameworks: Conduct comprehensive assessments to identify material financial and operational sustainability metrics.
2. Build Auditable Non-Financial Data Pipelines: Automate ESG data collection within core accounting software to ensure data integrity.
3. Align Sustainability with Annual Financial Filings: Prepare non-financial disclosures concurrently with financial statements to satisfy regulatory audit expectations.

Continue Reading

Accounting

Modernizing Internal Controls: Machine Learning and Continuous Monitoring in Auditing

Published

on

Internal audit departments and corporate risk managers are modernizing internal control frameworks by shifting from periodic sampling techniques to continuous monitoring and machine learning analytics. As operational data volumes increase across enterprise organizations, automated control testing ensures financial integrity, prevents corporate fraud, and streamlines annual audit engagements.

The Limitation of Periodic Audit Sampling
Historically, internal and external auditors evaluated internal controls by reviewing random samples of financial transactions—often analyzing less than five percent of total ledger entries. In complex enterprise environments, periodic sampling methods carry inherent risks of overlooking localized financial misstatements, unauthorized disbursements, or operational control breakdowns.

In 2026, progressive internal audit functions are utilizing automated continuous monitoring platforms that evaluate one hundred percent of financial transactions in real time. Continuous control auditing systems continuously monitor general ledger entries, procurement approvals, and expense reimbursements across all operating subsidiaries.

AI-Powered Fraud Detection and Anomaly Identification
Machine learning models trained on historical corporate financial data excel at identifying subtle transactional anomalies that indicate potential fraud or operational error. Automated systems instantly flag duplicate invoice payments, unapproved vendor creation, unusual journal entry timing, and unauthorized override of authority thresholds.

When an anomaly is detected, the automated auditing platform generates an instant risk alert, allowing internal audit teams to investigate root causes immediately. Early detection prevents minor operational errors from escalating into material weaknesses in financial reporting.

Streamlining External Audit Preparation
Continuous internal control monitoring delivers significant benefits during annual external financial audits. External audit firms can review continuous audit logs and automated control testing documentation, reducing the time required for manual field testing.

This integrated approach lowers overall audit compliance fees, reduces administrative burdens on corporate accounting staff, and provides senior management and audit committees with real-time visibility into the organization’s overall risk profile.

Core Implementation Guidelines
1. Transition to 100% Data Testing: Replace legacy sampling methods with automated continuous audit monitoring systems.
2. Deploy Anomaly Detection Algorithms: Implement machine learning models to identify unauthorized transactions and operational control overrides.
3. Align Internal and External Audit Workflows: Coordinate continuous control testing protocols with external auditors to optimize annual compliance cycles.

Continue Reading

Trending