How to Avoid Paying More Than Your "Fair Share" of Taxes

(READ TIME: ~5 MIN)

TAKEAWAYS:

• Despite being a powerful lever to drive retirement success, many retirees don’t have a well-thought-out tax plan.
• A lack of planning for a handful of retirement milestones often leads to larger-than-needed (and expected) lifetime tax bills.
• Simple strategies exist to ensure retirees pay their “fair share” of taxes and nothing more.

A common belief is that taxes will decline during retirement. After all, our taxes increase along with our earnings throughout our working years, typically peaking late-career leading up to retirement. So, the opposite must hold: our taxes will decrease when our employment earnings stop. Right?? Not exactly! Unfortunately, this misconception can lead retirees to approach tax planning with less urgency than they would if they recognized how their inaction would result in more of their hard-earned savings being taken by Uncle Sam.

Culprits of A Higher Lifetime Tax Bill

While some people will pay lower taxes throughout retirement than during their working years, we often see the opposite with our clients – taxes will likely increase. This may be surprising since many retirees (and their advisors) underestimate the retirement income they can generate from their financial resources, like investments and Social Security benefits. On top of that, it’s easy to overlook how all the years of diligent savings and investment growth in tax-deferred retirement accounts, like 401(k)s and IRAs, have created a big tax obligation that must eventually be paid. Here’s an example of how things may play out from a tax perspective.

Figure 1. The effective tax rate for a married couple retiring at age 65 with $3M of investment assets ($2.25M in traditional IRAs and $750k in a taxable brokerage account). 4.25% flat state tax (MI).

As we would expect, there’s a dramatic decrease in this couple's taxes in the years immediately following retirement. This is due to following the “conventional” rule of thumb that says withdrawing from taxable accounts first (e.g., joint brokerage), followed by tax-deferred (e.g., traditional IRAs), then tax-free (e.g., Roth IRAs) is best. Although this approach provides an alluring respite from taxes in early retirement, it’s short-sighted and often results in larger-than-needed lifetime tax bills.

Our example shows that taxes are creeping upward for most of this couple’s retirement after the spike caused by their Social Security income, eventually surpassing where they were before retiring. A big culprit is their required minimum distributions (RMDs) from retirement accounts, which are taxed as ordinary income, like wages. Because this couple opted to follow the rule of thumb of withdrawing from their taxable account first, their IRAs' balances (and embedded tax obligation) continued to grow. Although investment growth is good, the fact that the IRS requires them to withdraw a larger proportion of their IRAs each year starting at age 75 -- even if they don’t need the extra income -- their income and taxes continue to rise. And the “widow’s penalty” is the cherry on top, which we will discuss next.

The Widow’s Penalty

It’s hard to imagine anything more difficult than losing a spouse and companion. And if the emotional toll isn’t hard enough, financial consequences can worsen the situation for the surviving spouse. In this case, the “widow’s penalty.”

Tax rates are higher for singles than for married couples filing joint tax returns. The table below shows that a couple with $200k of taxable income is in the 24% federal marginal tax bracket, whereas a single filer is in the 32% tax bracket – an 8% increase!

Figure 2. 2023 federal tax brackets.

This is worth our attention because if one spouse died in 2023, the surviving spouse would file a joint tax return for 2023 and switch to filing as single in 2024. For example, if a couple’s only income were $200k from traditional IRA withdrawals (i.e., ordinary income), the tax bill would increase from ~$35k when filing jointly to ~$43k when the surviving spouse files as single -- an $8k difference. That’s a ~23% increase in taxes despite the surviving spouse’s income remaining the same, hence the widow’s penalty.

It’s important to mention that the above example doesn’t consider the standard deduction. But if we take things one step further and factor in the surviving spouse losing half of their standard deduction ($30,700 for joint and $15,350 for single filers ages 65+) starting in the year they file taxes as a single taxpayer, their tax bill increases from ~$28k to ~$38k. That’s ~36% more taxes!

Admittedly, this is a simplified example that doesn’t consider other factors like state and Medicare taxes that can further penalize a surviving spouse. Many variables affect the magnitude of the widow’s penalty, such as the reduction or stoppage of Social Security and pension benefits and whether the deceased spouse had already begun taking required minimum distributions from their retirement accounts. The takeaway is that it’s essential to be aware of the financial implications that come with the death of a spouse and take steps to mitigate the risks they pose to your retirement.

Pay Your Fair Share (But No More)

Simple tax planning strategies can help you avoid unnecessarily high taxes throughout your lifetime. Often, by simply developing a plan that considers the sources and timing of withdrawals to create your retirement paycheck and pairing it with Roth IRA conversions, you can limit your tax bill to paying your fair share and nothing more.

If you are ready to forgo rules of thumb intended for the masses in favor of a tax plan customized to your unique circumstances, we are here to help. You can click here to schedule an informal, introductory Zoom call to get started.

ABOUT THRIVE RETIREMENT SPECIALISTS

Thrive Retirement Specialists is a retirement planning specialist dedicated to delivering a more thoughtful and strategic approach to retirement planning for those nearing or in retirement. We are a fee-only Registered Investment Advisor (RIA) offering a single, flat-fee service entitled ThriveRetire™ that goes far beyond what has traditionally been known as retirement planning.  ThriveRetire™ is an engaging ongoing 8-step retirement planning process and investment management service that seeks to identify all risks, assets, tools, and tactics to develop an optimal retirement plan designed to support your ideal retirement lifestyle and goals to the fullest extent possible.  With every interaction, we seek to inform and serve, so our clients can safely trust their ThriveRetire™ plan and process, leaving each client with the confidence and peace of mind to live a vibrant and full life through retirement.

ABOUT ANTHONY WATSON, CFA, CFP®, RICP®

Prior to founding Thrive Retirement Specialists, Tony spent eight years serving as the Chief Investment Officer of a firm where he provided advice and investment management services to over 600 individuals representing at the time over $1.5 billion of investments. Before this, Tony served as Vice President at J.P. Morgan Private Bank, where he advised high- and ultra-high net worth individuals on all matters of wealth, including investments, portfolio construction, portfolio management, and retirement planning.

ABOUT MICHAEL NEMICK, CFP®

Prior to joining Thrive Retirement Specialists, Mike served as a Senior Financial Planner at an established comprehensive wealth management firm where he served high net worth clients and mentored the firm's financial planners.  Mike has served more than 240 high net worth individuals and families with aggregate investable assets of nearly $500 million by guiding all aspects of their financial well-being, including retirement planning, investments, tax planning, and goal clarification.