The question of whether you should pay off your mortgage is a complex one and everyone has an opinion. Some radio talk show hosts say all debts should be eliminated as fast as possible, including your mortgage. Debt presumes on the future they say. Your ability to pay might be impacted by health, job, or other unforeseen factors.