Maybe you could meet in the middle. Instead of only working 2-3 more years, why not work 5-6? That way you can exceed your financial goals. 5 years flies by so fast, you will barely tell the difference.
I like the idea of semi-retiring. It's my goal by the time I'm 50.