Large language models like ChatGPT have traditionally had trouble reading and interacting with spreadsheets, limiting their application in this realm, but recent research from Microsoft claims to have found an answer.
The issue LLMs have with spreadsheets has to do with tokenage requirements. LLMs, generally, run on “tokens,” which are the basic units of data the model processes. Tokens are words, character sets, or combinations of words and punctuation that are used by large language models to decompose text into. LLMs operate by converting input text into a series of tokens, which the model then uses to understand and generate responses.
The number of tokens determines the computational cost and capacity needed to handle the input, making token management crucial, especially for complex data like spreadsheets. For example, the phrase, “I heard a dog bark loudly at a cat” would be represented by eight tokens, one for each unique word. In order to preserve system resources, many LLMs have token limits, but even in a limitless environment, complex jobs are resource intensive, with significant computational effort that affects both performance and efficiency.
Typically, each part of a spreadsheet — even blank cells or repeating cells or those with irrelevant information — costs tokens, meaning even a simple spreadsheet has a much higher token requirement than traditional text. Furthermore, LLMs often struggle with spreadsheet-specific features such as cell addresses and formats, complicating their ability to effectively parse and utilize spreadsheet data. These challenges have limited just how much generative AI models can be applied to reading and interacting with spreadsheets. Considering how many spreadsheets the profession tends to use, this consequently limits their application towards deep accounting work.
What Microsoft researchers discovered, in short, is that the LLM does not need to burn tokens reading and processing the entire spreadsheet. Instead people can create a compressed version of the document to function as something like an index, with markers or “anchors” indicating especially important information like totals. Additional compression comes from grouping together similar types of data like date columns. So, in a sense, the LLM does not work through the spreadsheet itself but instead references it via a much more efficient index.
Complex spreadsheets are further supported through a concept called “chain of spreadsheet,” which is similar to “chain of thought” prompting. The method unfolds in two stages. First, the model identifies the table that is relevant to the query and determines the precise boundaries of the relevant content. This step ensures that only pertinent data is considered in the subsequent analysis. Then, the query and the identified table section are re-input into the LLM. The model then processes this information to generate an accurate response to the query.
“Through the CoS, SPREADSHEETLLM effectively handles complex spreadsheets by breaking down the process into manageable parts, thus enabling precise and context-aware responses,” said the paper.
Experiments with this method found that it significantly increased performance on larger spreadsheets where token limits are a particular challenge. The F1 score (which is used to measure the accuracy of an AI model) for massive spreadsheets was 75% higher than GPT-4 and 19% higher than TableSense-CNN, another spreadsheet methodology for AI; for large spreadsheets, the difference was 45% and 17% respectively; for medium spreadsheets it was 13% and 5%; and for small spreadsheets it was 8%. Overall, the results show that while the method gets more effective the larger the spreadsheet, it can still improve the efficiency of even small spreadsheets.
“Through a novel encoding method, SHEETCOMPRESSOR, this framework effectively addresses the challenges posed by the size, diversity, and complexity inherent in spreadsheets,” the paper concluded. “It achieves a substantial reduction in token usage and computational costs, enabling practical applications on large datasets. The fine-tuning of various cutting-edge LLMs further enhances the performance of spreadsheet understanding. Moreover, Chain of Spreadsheet, the framework’s extension to spreadsheet downstream tasks illustrates its broad applicability and potential to transform spreadsheet data management and analysis, paving the way for more intelligent and efficient user interactions.”
Implications
Donny Shimamoto, founder and managing director of accounting tech-focused accounting firm IntrapriseTechKnowlogies said, by enabling LLMs to “understand” tabular spreadsheets, accountants will have increased ability to either summarize or analyze a set of data. More than that, however, he said this will likely allow even non-accountants to do the same, removing the accountant as the middle person. However while some accountants may see this as a threat, he said what this would mainly do is clear the majority of simple inquiries from their plates, letting them save their energy for more complex questions and deeper analysis.
“Implementing something like this will require good testing to ensure that the risk of hallucinations is minimized, especially if it is going to help provide non-accountants with information to support decision-making,” said Shimamoto.
David Wood, a Bringham Young University accounting professor who specializes in AI within the profession, raised a similar point, as it would allow those without significant technical knowledge to do the same kinds of tasks that, previously, could only be done by seasoned accounting experts. He raised the example of novices being able to use generative AI to make spreadsheets that only expert professionals could put together. However, while he thinks this could be possible soon, he said that, despite the Microsoft research, it hasn’t arrived just yet.
“However, there are at least three challenges holding back using GenAI with spreadsheets: the size and complexity of the spreadsheets, and the required accuracy for most uses of spreadsheets. This paper takes a large step in the right direction, but it doesn’t solve all the challenges and more work will still be needed in each of these three areas. It would be a mistake to assume that after reading this paper, we have fully figured out how to use spreadsheets and GenAI together. More work is still needed. … I think the path these researchers are taking is significant, but the research “hasn’t arrived yet” meaning that more work is needed. The accuracy rates are just not high enough…yet. Hopefully this paves the way for the next researcher to move it forward further.” he said in an email.
The slim margins, trillions of dollars in tax cuts at stake and key missing details add up to great reasons for financial advisors and their clients to contact their members of Congress.
“Now’s the time to be doing it, because they’re starting to put together the legislation now,” said Mary Burke Baker, a government affairs counselor and the leader of the tax policy practice of law firm K&L Gates. “It’s important to let them know what’s important.”
That’s because every Republican member of Congress could exercise outsize influence on the process as President Donald Trump’s party extends the expiring provisions of the 2017 Tax Cuts and Jobs Act. Even though no one expects any steep tax increases as Congress confronts its year-end deadline, Burke Baker acknowledged that it “has to be difficult to advise clients to the extent that you can advise clients” on questions that may affect their payments to Uncle Sam — without any definitive answers until the passage of a bill that has yet to be written.
The elusive law appears far away from the finish line. Republicans are debating among themselves about how much they are willing to expand the federal budget deficit and whether they should pursue other priorities first. The intraparty squabbling could even provide an opening for Democrats to change the entire equation, if Trump, House Speaker Mike Johnson and Senate Majority Leader John Thune fail to align the GOP behind a way forward.
As they aim to prepare clients’ for the unknown possible impacts to say, estate taxes, deductions for state and local duties, Trump’s campaign promises or any number of other wish-list items among various constituencies, advisors could drive themselves crazy trying to stay abreast of every phase of an inevitably complicated political endeavor.
Instead, they should be counseling clients about “avoiding the temptation to act based on the news” of any particular day in the Beltway, said Ben Henry-Moreland, a former advisor who’s a senior financial planning nerd with the Kitces.com blog. While he said he doesn’t see “a high probability” that the current exemptions to the estate tax might revert to a lower level, Henry-Moreland suggested that advisors discuss the possibility with clients and prepare any necessary documents before December, just in case. If there are alterations to estate taxes in particular, they could find it incredibly difficult to draft new documents in a rush.
“It’s not necessarily, ‘Oh, here’s what X and Y congressmen are saying,’ but more, ‘Let’s take the big picture and figure out, is it really going to help you to act based on what you’re hearing on the news now, versus waiting until we’re going to know a little bit more?'” Henry-Moreland said. “Otherwise the documents can go in the shredder. It’s good to have some amount of flexibility, but you probably don’t want to make too many commitments yet.”
At this point, Trump and Congressional GOP leaders are also looking for leeway as they search for common ground on the cost of the legislation, possible tax expenditures that add to it or potential spending cuts that take away from it. To pass the law, they must navigate any number of twists and turns in coming months, with detours to keep every faction aboard and moving on a budgetary path that hasn’t even been laid out. For advisors and clients wondering how they’ll get to the ultimate destination, Republicans have barely embarked on their journey.
House and Senate budget resolutions tabbed the cost of tax legislation at north of $4 trillion over the next decade, but Trump’s plans may come with a price tag between $5 trillion and $11.2 trillion. Even if lawmakers let the Tax Cuts and Jobs Act provisions expire, the national debt is on pace to top its prior record of 106% of gross domestic product in 2029 and trigger so-called bond vigilantes’ ever-higher interest rates that would curtail economic growth. The arguments that new tariff revenue or higher federal receipts due to economic expansion from the tax cuts hold more sway among the White House and its allies than with budgetary experts.
To the toughest fiscal watchdogs, the mere $2 trillion in spending cuts over a decade in the House budget plan would only amount to a quarter of the necessary reductions, according to Maya MacGuineas, the president of the Committee for a Responsible Federal Budget, a bipartisan-led nonprofit policy research organization.
“For anyone who has made the case they support lower government spending, this is a pretty puny number, which is pretty darn close to a rounding error,” MacGuineas said in a statement. “It would be far better to use these savings as part of a larger debt reduction deal than to offset tax cuts. We have cut taxes and increased spending year after year since the last budget surplus in 2001, which is how our debt got so out of control. Lawmakers now need to face the reality that we should be adopting a debt deal rather than pursuing tax cuts or spending increases.”
But Republicans are not likely to abandon the main tax plank of their official campaign platform. In a speech on economic issues last fall, Speaker Johnson vowed to “keep those cuts in place to support job creation, along with the doubled guaranteed deduction and a strong child tax credit.” Last month, Majority Leader Thune introduced a bill called the “Death Tax Repeal Act” while expressing the hope that Congress “will not merely extend this exemption, but that we will get rid of this fundamentally flawed tax once and for all.”
Trump pledged frequently on the campaign trail to extend and expand the tax cuts, but the lofty goals of his administration and those of Trump’s allies in the conservative Project 2025 blueprint are now facing the political and fiscal calculus of passing major legislation through Congress. Trump has displayed a willingness to separate taxes from other legislative priorities, even if he has a clear preference.
“Well, I like one big beautiful bill. I always have. I always will. But if two is more certain, it does go a little bit quicker, because you can do the immigration stuff early,” he said in January.
Despite some earlier talk of passing the legislation by May, the “latter half of the year” sounds like a much better estimate for the timing, according to Erica York, the vice president of federal tax policy at the nonpartisan, nonprofit Tax Foundation’s Center for Federal Tax Policy.
“Congress tends to act at the last minute,” York said. “In an ideal world, we would get this taken care of very quickly, in a fiscally responsible way, so that people would have the certainty to make decisions. I think this will be a very long, drawn-out process, given the slim majority in the House.”
And the cost could balloon well above $7 trillion, if lawmakers include Trump’s other priorities such as ending taxes on tips and Social Security benefits or creating a deduction for the interest on auto loans for American-made cars, according to Jonathan Traub, a managing principal and the leader of the Tax Policy Group at consulting and professional services firm Deloitte Tax. In their recipe for tax cuts and spending pullbacks that go far beyond any undertaken by Elon Musk’s efforts, lawmakers are effectively trying to come up with a solution to the problem of, “‘How do you fit 7 trillion pounds of sugar into a $2 trillion sack,'” Traub said.
Take the deduction for state and local taxes, which, conveniently, is often referred to as SALT. Currently, taxpayers may deduct up to $10,000 — a level that Republicans from high-tax states such as New York and California say is too low. Trump, Johnson and Thune will need nearly all of those votes to pass the bill if they are going to do so without any Democrats’ support.
Using figures and policy options from guidance document compiled in January by Republicans on the House Ways and Means Committee, lawmakers could: double that limit for married couples at a cost of $100 to $200 billion over a decade; boost it to $15,000 for individuals and $30,000 for married couples ($500 billion); make only property taxes deductible but eliminate deductibility for income and sales taxes ($300 billion); get rid of the deduction for corporations to create $310 billion in savings against the cost; or eliminate the SALT deduction entirely to raise $1 trillion in revenue over a decade.
The issue “breaks down on regional lines” rather than ideological ones, which explains why the SALT discussion has been so hard for leaders of both major parties, Traub said.
“I don’t envy anybody in that process,” he said. “It’s a really difficult challenge. It has vexed leaders for years, and it will keep vexing them this year, as well.”
The idea of repealing the tax credits for green energy investments that President Joe Biden and the Democrats put in place through the Inflation Reduction Act could deliver savings of $800 billion and fit nicely into the Trump administration’s stated goal of slashing government spending for climate change. However, that may threaten manufacturing jobs and other economic benefits connected to projects in many Republican districts, according to Joe Hughes, a senior analyst for the Institute on Taxation and Economic Policy, which provides “data-driven recommendations to shape equitable and sustainable tax systems.” So cutting them could be tricky, as well.
“It would only pay for maybe about a third of the tax cuts to the wealthy,” Hughes said. “That issue is going to be awkward for Republican lawmakers, but I would highlight that as the biggest pay-for that they can come up with.”
For policy experts, the next important step will come with the requirement that Congress must agree to “identical budget resolutions” in both chambers, with instructions about whether the Senate will take up one or two bills subject to so-called reconciliation bills, Burke Baker said. That’s a Senate procedure enabling the passage of a bill with only a majority of 51 votes, rather than the 60 necessary to overcome a filibuster.
With Trump’s support, the House GOP is pursuing a “one big, beautiful bill” strategy encapsulating tax cuts as well as border security and other priorities. Republicans in the Senate are pushing for two reconciliation bills, which would delay passage of any tax legislation until later in the year. Burke Baker and other experts say that the longer it takes for the two chambers to reach agreement on a budget resolution, the more likely it will be for the Senate to prevail in waiting on the tax cuts until later in the year.
“It’s going to be difficult, even if both chambers were really rowing in the same direction,” she said. “It’s just a terribly complicated topic, and, if any of these issues were easier, they would have been taken care of earlier, and we wouldn’t even be talking about them right now.”
The procedural and policy topics could morph the debate into something altogether different if they stretch longer into the year. Otherwise, any tax changes are likely to fall “mostly on the corporate side” rather than on provisions affecting individual retail wealth management clients, Traub said. To him, repeal of green energy credits and deductions for corporate SALT and highly paid executives or an excise tax on stock buybacks would be more probable than any shifts in policies for municipal bond investments or mortgage interest.
If the Republican talks fall apart completely and lawmakers face the prospect of raising taxes in the year of a midterm election, the deduction for qualified business income for pass-through entities or even higher rates for some taxpayers could come up for debate if any Democrats’ votes are required for passage, Traub said.
“There’s a variety of things they could demand,” he said. “The universe of what is possible becomes quite a bit more dramatic.”
That scenario would represent a shocking outcome, though, for advisors and clients who don’t have much reason to expect a big tax hit from the legislation. Wealthier households will get more benefits from extending the expiring Tax Cuts and Jobs Act provisions than those with less than $400,000 in annual income. In a parallel universe, proposals such as raising corporate tax rates, placing foreign income of U.S. corporations in the same bracket as their domestic earnings or repealing the “Gingrich/Edwards loophole” may be on the table, Hughes said.
“There are plenty of options out there, and those are the sort of things that Republicans would be looking at and discussing if they were remotely serious about some sort of deficit-neutral tax reform,” he said. “There’s no goal of actual tax reform or of really helping the middle class here. The main goal here is to provide tax cuts to very wealthy individuals.”
Regardless, the complexities signal that there is “a good chance at this point” that passage of any bill waits until December, according to Henry-Moreland. Republicans won the trifecta with control of both houses of Congress and the White House, but passing a law entails much more than a simple agreement to push back the sunset date of the current rules under the Tax Cuts and Jobs Act or make them all permanent, he noted.
“I still don’t think that this bill is going to be a straight-up extension of TCJA. We have a different group of legislators, and we have different political and economic environments right now,” Henry-Moreland said. “There are so many moving pieces and so many different priorities right now. It’s going to be more of a TCJA replacement than an extension, per se.”
The debate currently revolves around factions among Republicans that are “pulling in the opposite direction,” with one seeking higher itemized deductions and the other trying to reduce the deficit, York said. The push-pull between them and Trump’s influence could leave advisors and their clients guessing until the end of the year.
“For each provision, you have a set of constituents who are vested in that provision existing, so it makes it politically difficult to say, ‘We’re going to cut it,” said York. “A dollar for something means a dollar less for something else.”
Top 25 firm Moss Adams announced that it has acquired the assets of 360 Cloud Solutions, LLC, a NetSuite Solution Provider, and 360 Cloud Apps, LLC, a SuiteCloud Developer Network partner and producer of the 360 Cloud Subscription Billing product.
Additionally, 360 Cloud App’s products, including its 360 Cloud Subscription Billing product and Salesforce CPQ connector, will become part of the firm’s NetSuite Implementation Services.
“At Moss Adams, we aim to not only provide world-class services but also play an integral part in our clients’ growth, advising them beyond just tax and compliance issues,” said Eric Miles, chairman and CEO of Moss Adams. “The addition of 360 Cloud Solutions and 360 Cloud Apps personnel and products strengthens our team, allowing us to both broaden our portfolio of services while simultaneously deepening our ability to grow, scale and modernize clients’ business management systems.”
With the purchase, Moss Adams, also a NetSuite Solution Provider and Alliance Partner, doubles the size of the firm’s NetSuite Implementation Services, augmenting existing resources and adding new product solutions.
Mark Steranka, consulting managing partner at Moss Adams, said that, as a firm that services mid-market companies, there are a lot of Netsuite users, and the purchase lets them be in a better position to meet their needs.
“360 Cloud Solutions joining Moss Adams adds to our already existing NetSuite practice and allows us to better meet client needs. We’re adding talent, products, and the opportunity to develop new, more robust products. What stood out to us with 360 Cloud Solutions is the common client-centric mindset we share and the quality of work they provide. We feel it’s a natural evolution of our two firms. With 360 Cloud Solutions, we’re doubling the size of our NetSuite practice,” he said.
The 360 Cloud Solutions and 360 Cloud Apps teams will join the existing Technology Consulting Services at Moss Adams, with plans to grow its services and products across a variety of industry sectors.
“We fully intend to leverage 360 Cloud Solutions’ deep NetSuite experience and product development capabilities to build on existing solutions and bring new ones to market. 360 Cloud Solutions will be fully integrated into the Moss Adams Technology Consulting practice. As to specifics around branding of the acquired entities, we’re still evaluating the best course of action there for our clients,” he said.
From Bitcoin to bogus easements, from ID theft to international skullduggery: Authorities have unveiled the top 10 IRS Criminal Investigation cases of 2024.
“Each year, I’m amazed with the variety of cases that make our top 10 list,” added IRS-CI chief Guy Ficco.
Representing the most high-profile and impactful cases of last year, these defendants scammed millions, duped investors into getting rich quick and tried to funnel money to terrorist organizations — and above all to themselves.