The Homeownership 'Hidden Tax' Your paid-off home isn't actually free. Many retirees celebrate paying off their mortgage, completely unaware of the escalating 'hidden tax' of home maintenance. Over time, a once-perfect family home transforms into a relentless drain on both physical energy and fixed-income finances.