TSP share prices for Quicken

Have a question about your personal investments? No matter how simple or complex, you can ask it here.
Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

TSP share prices for Quicken

Post by Simbilis » Sun Jan 06, 2013 12:43 pm

I couldn't find an up-to-date source for TSP fund share price data in a format that could be easily imported into Quicken, so I wrote a script to retrieve it from the TSP Share Price History page.

You can download the CSV file directly. It's updated every trading day within a half-hour or so of when the TSP site is updated. For Quicken to import the price history data, you'll need to use the fund names from the CSV file as your Quicken security names.

If you prefer, you can maintain your own copy of the CSV data using the Python script.

Thanks,

Sim
Last edited by Simbilis on Sat Sep 16, 2017 10:15 am, edited 11 times in total.

User avatar
Kuckie
Posts: 158
Joined: Tue Feb 23, 2010 10:59 am

Re: TSP share prices for Quicken

Post by Kuckie » Sun Jan 06, 2013 8:15 pm

You are better than those guys at Quicken who haven’t made any significant code improvements in years, (still no TSP access) but expect users to upgrade for their few cosmetic changes, and of course new bugs. Even Vanguard provides for direct and automatic TSP access.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Sun Jan 06, 2013 9:01 pm

[Revision of previous uninformed response]

Looks like Intuit is demanding a huge licensing fee for QFX from TSP, and TSP is ignoring them. That leaves us stuck. Might be time to look at GnuCash, although that won't help with the TSP problem.

thomas716
Posts: 8
Joined: Sat Mar 12, 2011 4:31 pm

Re: TSP share prices for Quicken

Post by thomas716 » Mon Jan 07, 2013 10:41 am

Kuckie wrote:You are better than those guys at Quicken who haven’t made any significant code improvements in years, (still no TSP access) but expect users to upgrade for their few cosmetic changes, and of course new bugs. Even Vanguard provides for direct and automatic TSP access.


Kuckie,

How do you track the TSP from Vanguard? I've been trying to figure out how to do that and I must be missing something. Thanks.

texasdiver
Posts: 2269
Joined: Thu Jun 25, 2009 12:50 am
Location: Vancouver WA

Re: TSP share prices for Quicken

Post by texasdiver » Mon Jan 07, 2013 11:08 am

I've been in the same boat for years. There is no good solution. Your choices are basically:

1. Check the current TSP share prices on the TSP web site periodically and enter those manually into Quicken (what I do every few weeks or when I feel like it)

2. Use some proxy fund for the TSP funds. There are close or identical funds you can use for all the TSP funds except the G fund. For example, the Vanguard Developed Markets Index (VIDMX) is a good proxy for the I-Fund and the Vanguard Extended Markets Index (VEXAX) is a good proxy for the S-Fund. The share prices don't match so you just have to adjust your share numbers to make the totals come out but then Quicken will track the portfolio value more or less accurately. I do this when I use the Morningstar Portfolio X-Ray so that I can evaluate my entire portfolio but I don't bother to do this in Quicken because it is easy enough to update the share prices manually when I care to. Plus, my TSP accounts are legacy accounts and not receiving active contributions.

3. Use some other tool to track your portfolio. Mint, for example, will track your TSP portfolio no problem and will update your share values. It is a mystery to me who Mint can manage to do this and not Quicken since Quicken bought Mint a year or two ago. I guess it is as the previous poster says...they are trying to extort money out of the TSP to use their propriety system and the TSP is rightly telling them to stuff it.

User avatar
Kuckie
Posts: 158
Joined: Tue Feb 23, 2010 10:59 am

Re: TSP share prices for Quicken

Post by Kuckie » Mon Jan 07, 2013 6:41 pm

How do you track the TSP from Vanguard? I've been trying to figure out how to do that and I must be missing something.

Sorry, I found out that Vanguard has closed account aggregation linking outside accounts, like the TSP, but still provides services for existing users. I don't know why. See their comments: https://personal.vanguard.com/us/help/FAQTechHelpCashEdgeContent.jsp#1a

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Mon Jan 07, 2013 10:46 pm

texasdiver wrote:I've been in the same boat for years. There is no good solution.

Well, except scraping TSP's site for the prices :happy See Google spreadsheet link above.

texasdiver wrote:It is a mystery to me who Mint can manage to do this and not Quicken since Quicken bought Mint a year or two ago. I guess it is as the previous poster says...they are trying to extort money out of the TSP to use their propriety system and the TSP is rightly telling them to stuff it.

It's much simpler to maintain a scraper in an online app than in a client-side app. I'm providing the TSP scrape for free because I use it myself, but if TSP changes their site and breaks it there's no guarantee I'll be able to fix it in a timely way, and that's likely to upset my "customers" (if there are any - it may just be the three of us).

thomas716
Posts: 8
Joined: Sat Mar 12, 2011 4:31 pm

Re: TSP share prices for Quicken

Post by thomas716 » Tue Jan 08, 2013 7:06 am

Kuckie wrote:
How do you track the TSP from Vanguard? I've been trying to figure out how to do that and I must be missing something.

Sorry, I found out that Vanguard has closed account aggregation linking outside accounts, like the TSP, but still provides services for existing users. I don't know why. See their comments: https://personal.vanguard.com/us/help/FAQTechHelpCashEdgeContent.jsp#1a

Thank you for the information. At least I know I'm not going crazy and missing something simple I should have clicked on.

TheMightyQuinn
Posts: 22
Joined: Tue Jun 26, 2012 5:23 pm

Re: TSP share prices for Quicken

Post by TheMightyQuinn » Thu Jan 10, 2013 1:15 pm

Great work and thanks a bunch for this!

How often do you plan on updating it?

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Fri Jan 11, 2013 10:28 pm

TheMightyQuinn wrote:How often do you plan on updating it?


I'm just updating it now with today's prices. This weekend I'll rewrite the script to update the spreadsheet directly, and then it'll be synced every day as soon as the TSP site's prices are updated (roughly).

TheMightyQuinn
Posts: 22
Joined: Tue Jun 26, 2012 5:23 pm

Re: TSP share prices for Quicken

Post by TheMightyQuinn » Wed Jan 16, 2013 11:58 am

Strange. The spreadsheet updated last night with the correct prices however when I import into quicken it gives me strange prices around 1/2 of what they should be. I'm not sure the cause since the spreadsheet prices are correct.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Thu Jan 17, 2013 7:40 pm

Weird. I don't see that problem for the funds that I hold. Can you tell which funds have the wrong prices and for what period(s), according to Quicken?

TheMightyQuinn
Posts: 22
Joined: Tue Jun 26, 2012 5:23 pm

Re: TSP share prices for Quicken

Post by TheMightyQuinn » Fri Jan 18, 2013 1:08 am

Sure. I just imported the latest ones and it did the same thing. Here's what Quicken tells me:

C Fund - $10.03
F Fund - $9.97
G Fund - $10
S Fund - $10.05

But this is obliviously not what's in the spreadsheet, so I'm clueless where these numbers come from.

You're not seeing the same thing on your end?

TheMightyQuinn
Posts: 22
Joined: Tue Jun 26, 2012 5:23 pm

Re: TSP share prices for Quicken

Post by TheMightyQuinn » Fri Jan 18, 2013 1:25 am

Okay, I may have found the problem. I changed the file name, re-imported, and it works now. My hunch was the filename "TSP Fund Price History - Quicken(2).csv", so I renamed it and it worked. I''ll try it again on the next update to see if it really is the filename.
Thanks again for doing this.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Fri Jan 18, 2013 6:38 am

Those prices are the earliest ones in the file (June 2 2003). I don't think it's the price data - Quicken is somehow picking up the wrong date, and using that to price your TSP portfolio.

Changing the import file name *shouldn't* have any effect. Quicken has behaved oddly for me too, though - temporarily displaying incorrect account names, changing the opening balances of previously reconciled accounts, etc. Another reason to look at GnuCash.

Default User BR
Posts: 7501
Joined: Mon Dec 17, 2007 7:32 pm

Re: TSP share prices for Quicken

Post by Default User BR » Fri Jan 18, 2013 12:35 pm

TheMightyQuinn wrote:Okay, I may have found the problem. I changed the file name, re-imported, and it works now. My hunch was the filename "TSP Fund Price History - Quicken(2).csv", so I renamed it and it worked. I''ll try it again on the next update to see if it really is the filename.

When time you see (2) or other number in the filename, that usually means you downloaded a file and there was already one of the same name. Most browsers won't overwrite files on downloads.


Brian

TheMightyQuinn
Posts: 22
Joined: Tue Jun 26, 2012 5:23 pm

Re: TSP share prices for Quicken

Post by TheMightyQuinn » Sat Jan 19, 2013 1:29 am

This time renaming the file didn't help, but opening and then resaving the file in excel worked.

TheMightyQuinn
Posts: 22
Joined: Tue Jun 26, 2012 5:23 pm

Re: TSP share prices for Quicken

Post by TheMightyQuinn » Wed Jan 23, 2013 3:57 pm

Just to confirm, it seems I have to open and save the CSV file in Excel in order for Quicken to properly import the prices. I believe Quicken doesn't like the google docs CSV format.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Wed Jan 23, 2013 4:39 pm

It would be better to post them in native CSV anyway. I just used a Google docs spreadsheet because I don't have any other way to publish it.

I'll look around for a convenient host.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Sat Feb 02, 2013 10:50 am

TheMightyQuinn wrote:Strange. The spreadsheet updated last night with the correct prices however when I import into quicken it gives me strange prices around 1/2 of what they should be. I'm not sure the cause since the spreadsheet prices are correct.


I finally replicated this defect. It turns out that Quicken sometimes(?) requires the price file to be sorted in increasing date order (most recent prices at the end). I'll look at changing the order in the next export. In the meantime, you can use "Data/Sort Sheet By Column" to fix the problem if you experience it.

TheMightyQuinn
Posts: 22
Joined: Tue Jun 26, 2012 5:23 pm

Re: TSP share prices for Quicken

Post by TheMightyQuinn » Mon Feb 04, 2013 4:56 pm

Thanks for the info. Right now instead of saving the file I open it in Excel and then save it. After that the import works every time.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Mon Feb 04, 2013 8:17 pm

TheMightyQuinn wrote:Right now instead of saving the file I open it in Excel and then save it. After that the import works every time.


Could you please download the CSV version (link removed, see above) and see if it works without the Excel step?
Last edited by Simbilis on Fri Jul 19, 2013 7:03 pm, edited 1 time in total.

TheMightyQuinn
Posts: 22
Joined: Tue Jun 26, 2012 5:23 pm

Re: TSP share prices for Quicken

Post by TheMightyQuinn » Fri Feb 08, 2013 1:22 am

Sorry, I haven't downloaded TSP data until today.

Yes, it worked without a hitch. I was able to download and open in Quicken with the correct prices bypassing the excel step.

Thanks again!

skellabudd
Posts: 1
Joined: Wed Jun 26, 2013 9:31 am

Re: TSP share prices for Quicken

Post by skellabudd » Wed Jun 26, 2013 9:34 am

Hi Simbilis,

Can you share your python code with me? email: [Personally identifiable email removed by admin LadyGeek. Use PM instead.]
Thanks

AndrewJSmith
Posts: 3
Joined: Sat Jan 25, 2014 11:31 am

Re: TSP share prices for Quicken

Post by AndrewJSmith » Sat Jan 25, 2014 11:35 am

Could you share with me as well? I'm really new to Quicken and could also use any set up advice you can provide. I've got my funds set up now though thanks to your spreadsheet. Could you provide me some info as to how to use the script as well? Never used one before. Thanks. [Personally identifiable email removed by admin LadyGeek. Use PM instead.]

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Sat Jan 25, 2014 12:13 pm

AndrewJSmith wrote:Could you provide me some info as to how to use the script as well? Never used one before.


You're in luck - you don't need the script. The CSV file is updated every trading day within 10 minutes of when the TSP share prices are published. Just download and import it using "File/Import/Import security prices from CSV file".

The script is more of interest to programmers, nerds, and those concerned that I might accidentally :oops: (or on purpose :twisted: ) be providing incorrect price data. If you're sure you fit in one of those categories, please PM me your email address. If you're not conversant with Python and BeautifulSoup, it's probably not for you.

TheMightyQuinn
Posts: 22
Joined: Tue Jun 26, 2012 5:23 pm

Re: TSP share prices for Quicken

Post by TheMightyQuinn » Sat Jan 25, 2014 2:47 pm

I just want to thank you again for doing this. I download the share prices from your csv file every week or two and it's been a great help in keeping my portfolio up to date! :beer

AndrewJSmith
Posts: 3
Joined: Sat Jan 25, 2014 11:31 am

Re: TSP share prices for Quicken

Post by AndrewJSmith » Sat Jan 25, 2014 6:43 pm

Sweet. You're the man. I was going crazy trying to figure it all out.

Belendez
Posts: 5
Joined: Tue Feb 11, 2014 1:22 pm

Re: TSP share prices for Quicken

Post by Belendez » Tue Feb 11, 2014 1:27 pm

Hi,
I found this website and usds the TSP Folder in CVS in quicken, it was great to use. My question is that I have to come to this website each time I want to download the file with new prices. It went to Dropbox but it does not automatically update.
Thanks

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Tue Feb 11, 2014 4:12 pm

I'm not sure I understand your question. The linked CSV file is updated at the end of every trading day just after the TSP site is updated. You can see on the Dropbox site how long it's been since the last update. You need to download a fresh copy (using the same link) and import it into Quicken every time you want to update your stored TSP share prices.

AndrewJSmith
Posts: 3
Joined: Sat Jan 25, 2014 11:31 am

Re: TSP share prices for Quicken

Post by AndrewJSmith » Sat Feb 15, 2014 7:30 pm

How can I setup Quicken to update my TSP shares at each contribution? Is that possible or do I need to manually edit the number of shares I have every two weeks?

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Sat Feb 15, 2014 11:09 pm

Right now, I know of no other way than doing it manually.

It may be possible to scrape it from the "Recent Transactions" page or the quarterly statement PDF, but I haven't really looked at that. For the time saved, it doesn't seem worth it.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Wed Mar 05, 2014 9:36 pm

I've finally captured a complete year of financial history in sufficient detail that I can do a clean conversion from Quicken 2013 to GnuCash. GnuCash is free/libre, and has both its own TSP site scraper (Finance::Quote::TSP) and a Python API that lets me feed it quote data directly.
Also, it isn't Quicken! :sharebeer

As a result, I no longer need the CSV export. There's no reason to shut it off, as it's fully automated, but I won't be paying close attention to it anymore. If you use this data and something seems wrong, please leave me a PM or a note on this thread, and I'll take a look. If anyone would like to take it over, the source is always available.

Cheers!

Sim

Sparx
Posts: 1
Joined: Fri Mar 07, 2014 12:59 pm

Re: TSP share prices for Quicken

Post by Sparx » Fri Mar 07, 2014 1:09 pm

I would like to see the script -- I was planning to do something similar and I'm curious to see how you made it work. I'm a newcomer to Python and am still learning from other people's examples. That said, I would rather import the data into Octave or something other than Quicken. As far as I know, Quicken hasn't made a version of their software for my Mac in years.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Thu Mar 27, 2014 6:20 pm

Looks like the TSP site now supports CSV downloads, but not in Quicken's preferred format. I'll leave my scrape up for now, but I expect that there'll be any number of conversion scripts soon.

Kudos, FRTIB :beer

Sim

peddler12
Posts: 105
Joined: Sat Sep 03, 2011 10:01 pm

Re: TSP share prices for Quicken

Post by peddler12 » Thu Mar 27, 2014 6:33 pm

I tried importing this file into Quicken 2014. I was unsuccessful. Anything I can do to get it to work?

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Thu Mar 27, 2014 7:01 pm

peddler12 wrote:I tried importing this file into Quicken 2014. I was unsuccessful. Anything I can do to get it to work?

You'll need a script to convert it from its current format to something Quicken can read. You could use a spreadsheet to reformat it by hand, but that kind of defeats the purpose.

Belendez
Posts: 5
Joined: Tue Feb 11, 2014 1:22 pm

Re: TSP share prices for Quicken

Post by Belendez » Thu Mar 27, 2014 7:05 pm

Hi I have Quicken 2014 and your file has worked perfectly. Not sure why he can't use.
Thanks again.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Thu Mar 27, 2014 7:13 pm

Belendez wrote:Hi I have Quicken 2014 and your file has worked perfectly. Not sure why he can't use.

I thought Peddler was talking about the TSP file :confused

Peddler, if you meant that you can't import the file provided by TSP Share Price History page, then my previous answer applies. If you meant that you can't import the file linked at the top of this thread, then try using "File/Import/Import security prices from CSV file".

Belendez
Posts: 5
Joined: Tue Feb 11, 2014 1:22 pm

Re: TSP share prices for Quicken

Post by Belendez » Thu Mar 27, 2014 7:24 pm

Sorry I might have misread the comment.

peddler12
Posts: 105
Joined: Sat Sep 03, 2011 10:01 pm

Re: TSP share prices for Quicken

Post by peddler12 » Thu Mar 27, 2014 7:36 pm

No valid prices found to import is the message I got. Glad to know it will work in 2014. I just need to figure out what I'm doing wrong.

Mike

peddler12
Posts: 105
Joined: Sat Sep 03, 2011 10:01 pm

Re: TSP share prices for Quicken

Post by peddler12 » Thu Mar 27, 2014 7:50 pm

I have it straightened out. I had to rename the securities. It works now. Thank you.

Mike

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Thu Mar 27, 2014 8:02 pm

I spoke too soon. This must be the first day it's been available, because it's definitely broken the script - no prices after the 3/26 close. If it's not hard to fix, I'll do a manual refresh tonight.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Thu Mar 27, 2014 8:14 pm

Ok, fixed, but not in a very robust way. It'll work for the time being, though.

Belendez
Posts: 5
Joined: Tue Feb 11, 2014 1:22 pm

Re: TSP share prices for Quicken

Post by Belendez » Thu Mar 27, 2014 8:34 pm

Are you telling us that the TSP website has messed up your file. That is not good news. I have love it!!!

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Thu Mar 27, 2014 9:40 pm

Actually, they improved their site and made my kludgy scrape (almost) obsolete.

Don't worry :happy . My code will probably continue to work for the foreseeable future. If not, though, it's much easier now for someone else to reimplement it.

peddler12
Posts: 105
Joined: Sat Sep 03, 2011 10:01 pm

Re: TSP share prices for Quicken

Post by peddler12 » Thu May 08, 2014 7:21 pm

Is there a reason that the CSV file has not updated for six days?

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Thu May 08, 2014 7:35 pm

peddler12 wrote:Is there a reason that the CSV file has not updated for six days?

I forgot to restart the Dropbox agent. Sorry...

peddler12
Posts: 105
Joined: Sat Sep 03, 2011 10:01 pm

Re: TSP share prices for Quicken

Post by peddler12 » Thu May 08, 2014 7:41 pm

Thank you for responding so quickly and for fixing the problem.

wdegregory
Posts: 1
Joined: Tue Jun 10, 2014 7:59 pm

Re: TSP share prices for Quicken

Post by wdegregory » Tue Jun 10, 2014 8:02 pm

Sim,

I am very much interested in your Python script. This is something I have been meaning to do for a while but never had the time. Do you think it would be possible to also scrape data off statements? Let me know best way to get file.

K

Post Reply