TSP share prices for Quicken

Have a question about your personal investments? No matter how simple or complex, you can ask it here.
User avatar
LadyGeek
Site Admin
Posts: 39979
Joined: Sat Dec 20, 2008 5:34 pm
Location: Philadelphia
Contact:

Re: TSP share prices for Quicken

Post by LadyGeek » Tue Jun 10, 2014 8:49 pm

Can you make the source code available on Google Drive (or Dropbox)?

I'll be happy to add your code to the wiki: Using open source software for portfolio analysis
To some, the glass is half full. To others, the glass is half empty. To an engineer, it's twice the size it needs to be.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Sat Jul 19, 2014 7:55 am

LadyGeek, sorry, I didn't notice your message. The script is here, but the recent TSP site update broke it - my copy kept working only because it already had a fully populated history file (link).

I'll take a look and see if I can hack up something that retrieves and parses TSP's new CSV download. That would be a better solution anyway.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Thu Aug 21, 2014 11:12 pm

Ok, the Python script has been rewritten to take advantage of direct CSV download from the TSP site. I haven't tested the output directly in Quicken, because I don't use it anymore. If the import stops working, this thread is the place to complain!

impdust
Posts: 11
Joined: Sun Sep 07, 2014 2:41 pm

Re: TSP share prices for Quicken

Post by impdust » Sun Sep 07, 2014 2:44 pm

I've probably been using this file for about a year now. Just wanted to say thank you for continuing to support something that you're not even using yourself. Its greatly appreciated. It makes it real easy to keep the prices updated in Quicken.

User avatar
LadyGeek
Site Admin
Posts: 39979
Joined: Sat Dec 20, 2008 5:34 pm
Location: Philadelphia
Contact:

Re: TSP share prices for Quicken

Post by LadyGeek » Sun Sep 07, 2014 4:20 pm

impdust, welcome! Thanks for the incentive.

I should have done this sooner, but the Python script is now in the wiki. See: Using open source software for portfolio analysis

Also, Thrift Savings Plan (under "See also")

I tested this in Linux with a resulting CSV file of 24,612 entries (06/02/2003 through 09/05/2014). I didn't test the Quicken import.
To some, the glass is half full. To others, the glass is half empty. To an engineer, it's twice the size it needs to be.

Belendez
Posts: 5
Joined: Tue Feb 11, 2014 1:22 pm

Re: TSP share prices for Quicken

Post by Belendez » Mon Sep 08, 2014 7:58 am

I agree thank you, this work so well for computer inliterates. It helps me update quicken in a very easy way.

impdust
Posts: 11
Joined: Sun Sep 07, 2014 2:41 pm

Re: TSP share prices for Quicken

Post by impdust » Thu Jan 22, 2015 7:57 pm

Looks like the script stopped working after the holiday weekend, it's still showing the download from the 16th.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Thu Jan 22, 2015 9:21 pm

The script was fine, but the Dropbox client was not.

This is the third time for that problem - I seem to be on a 4 month reboot schedule :oops: . It may be time to host the script and the file on an AWS instance with its own web server instead of using Dropbox.

impdust
Posts: 11
Joined: Sun Sep 07, 2014 2:41 pm

Re: TSP share prices for Quicken

Post by impdust » Fri Jan 23, 2015 7:13 pm

Thanks for fixing it. I download it all the time and really appreciate you taking the time to provide it.

travelfar
Posts: 112
Joined: Mon Nov 17, 2008 12:31 pm

Re: TSP share prices for Quicken

Post by travelfar » Fri Jan 23, 2015 7:42 pm

It's odd that Intuit's Quicken does not track TSP when Mint, also owned by Intuit and a free, competing platform, does so without issue.

impdust
Posts: 11
Joined: Sun Sep 07, 2014 2:41 pm

Re: TSP share prices for Quicken

Post by impdust » Sat Jan 24, 2015 12:40 pm

My understanding is it has to do with Quickens business model. They charge companies to provide their information to customers. If they freely provided TSP fund prices, ever other company would expect Quicken to provide theirs for free. Whereas Mint makes money through advertising and recommending services, so the more they provide the more customers they'll attract and the more money they'll make.

impdust
Posts: 11
Joined: Sun Sep 07, 2014 2:41 pm

Re: TSP share prices for Quicken

Post by impdust » Wed Feb 25, 2015 4:30 pm

Looks like the 4 months came early this time. The last update is the file from Friday.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Wed Feb 25, 2015 5:31 pm

Dagnabbit. Ok, back in sync.

impdust
Posts: 11
Joined: Sun Sep 07, 2014 2:41 pm

Re: TSP share prices for Quicken

Post by impdust » Wed Feb 25, 2015 6:46 pm

Excellent. Thanks again for continuing to support it.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Wed May 27, 2015 9:33 pm

The TSP share price history files have moved to a new site. You can find the CSV file and script there.

A Quicken share price history for most Vermont Higher Education Investment Plan funds from early 2013 to the present is also available.

impdust
Posts: 11
Joined: Sun Sep 07, 2014 2:41 pm

Re: TSP share prices for Quicken

Post by impdust » Sat May 30, 2015 9:02 am

Thanks for continuing to provide the file.

If anyone using windows 8 wants to use task scheduler to automatically download this file periodically you can create a scheduled task with this command line:

Code: Select all

powershell.Exe -command "& {$client = new-object System.Net.WebClient;$client.DownloadFile('https://www.likhite.net/scrape/tspQuicken.csv','C:\Temp\tspQuicken.csv')}"

User avatar
NoRoboGuy
Posts: 722
Joined: Fri Apr 01, 2011 11:07 pm
Location: Just west of Austin TX

Re: TSP share prices for Quicken

Post by NoRoboGuy » Sun May 31, 2015 5:29 pm

Simbilis wrote:The TSP share price history files have moved to a new site. You can find the CSV file and script there.

A Quicken share price history for most Vermont Higher Education Investment Plan funds from early 2013 to the present is also available.


Thanks so much for keeping this data available.
There is no free lunch.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Sun May 31, 2015 9:23 pm

Impdust's comment made me realize that if you have a client that can continue an interrupted download, there's an easy way to speed up share price retrieval. For instance, with wget you would run:

Code: Select all

wget -c https://www.likhite.net/scrape/tspQuicken.csv


This will append new prices since your last download to your local CSV file. There may be a way to do this with impdust's command, but I don't willingly do Windows.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Tue Oct 20, 2015 3:20 pm

As of yesterday, the TSP share price page changed again, and the download is out of commission. I'll have it working again ASAP.

Sim

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Tue Oct 20, 2015 3:35 pm

Simbilis wrote:As of yesterday, the TSP share price page changed again, and the download is out of commission. I'll have it working again ASAP.


Doh. Only the URL changed, not the form. All fixed.

Sim

impdust
Posts: 11
Joined: Sun Sep 07, 2014 2:41 pm

Re: TSP share prices for Quicken

Post by impdust » Tue Oct 20, 2015 4:58 pm

Thanks for continuing to maintain it, it makes it so easy to keep my quicken updated. :beer

peddler12
Posts: 99
Joined: Sat Sep 03, 2011 10:01 pm

Re: TSP share prices for Quicken

Post by peddler12 » Thu Nov 12, 2015 11:11 pm

Bump for assistance.

User avatar
LadyGeek
Site Admin
Posts: 39979
Joined: Sat Dec 20, 2008 5:34 pm
Location: Philadelphia
Contact:

Re: TSP share prices for Quicken

Post by LadyGeek » Thu Nov 12, 2015 11:18 pm

What do you need help with? From your previous posts, it sounded like you got everything figured out.
To some, the glass is half full. To others, the glass is half empty. To an engineer, it's twice the size it needs to be.

peddler12
Posts: 99
Joined: Sat Sep 03, 2011 10:01 pm

Re: TSP share prices for Quicken

Post by peddler12 » Fri Nov 13, 2015 12:04 am

I bumped for snwbrdr18.

User avatar
NoRoboGuy
Posts: 722
Joined: Fri Apr 01, 2011 11:07 pm
Location: Just west of Austin TX

Re: TSP share prices for Quicken

Post by NoRoboGuy » Sat May 28, 2016 8:29 am

For some reason my Excel will no longer open files from this site. Apparently it says the certificate expired?

https://www.likhite.net/scrape/tspQuicken.csv
There is no free lunch.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Sat May 28, 2016 10:52 am

NoRoboGuy wrote:For some reason my Excel will no longer open files from this site. Apparently it says the certificate expired?


Excel is right, the certificate has expired. It was free with the domain name, but I don't need it myself, so I'm reluctant to renew. If you're unable (or do not want) to override Excel and accept the cert, you should be able to download from your browser. It will display an error and prompt you, but will allow it.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Sat May 28, 2016 11:10 am

For those not wanting to deal with the expired cert, the data is now also available at http://www.likhite.net/scrape/tspQuicken.csv

User avatar
NoRoboGuy
Posts: 722
Joined: Fri Apr 01, 2011 11:07 pm
Location: Just west of Austin TX

Re: TSP share prices for Quicken

Post by NoRoboGuy » Wed Jun 01, 2016 9:37 pm

Simbilis wrote:
NoRoboGuy wrote:For some reason my Excel will no longer open files from this site. Apparently it says the certificate expired?


Excel is right, the certificate has expired. It was free with the domain name, but I don't need it myself, so I'm reluctant to renew. If you're unable (or do not want) to override Excel and accept the cert, you should be able to download from your browser. It will display an error and prompt you, but will allow it.


I want to override the expired cert, but Excel 2013 will not let me, and I cannot figure out how to override it. Yes, I can manually download the CSV file, but before now it was downloading and updating the values in Excel automatically. Now it will not let me add your site to the trusted locations list. When I try it says I have the wrong security settings (even though I have it set to accept web data and run macros), and I am still getting data from another site without issue.
There is no free lunch.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Wed Jun 01, 2016 10:46 pm

Try changing the download URL to start with HTTP instead of HTTPS. That should dodge the problem.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Mon Sep 05, 2016 4:18 pm

The cert has been renewed. The HTTPS URL should be working properly again.

impdust
Posts: 11
Joined: Sun Sep 07, 2014 2:41 pm

Re: TSP share prices for Quicken

Post by impdust » Thu Sep 08, 2016 9:04 pm

Working for me. Thanks for continuing to provide this file.

sketchy9
Posts: 115
Joined: Mon Oct 25, 2010 2:10 pm

Re: TSP share prices for Quicken

Post by sketchy9 » Wed Dec 07, 2016 12:44 pm

Thank you for providing this file! One issue I've noted since December 1, upon importing the file into Quicken, it is interpreting the dates with the month and day swapped. For instance, the prices for December 4 are being pulled from April 12. Not sure how or why this is happening-- I'm assuming nothing has changed on your end. Just wanted to throw that out there.

impdust
Posts: 11
Joined: Sun Sep 07, 2014 2:41 pm

Re: TSP share prices for Quicken

Post by impdust » Wed Dec 07, 2016 6:07 pm

I'm pulling the one from https://www.likhite.net/scrape/tspQuicken.csv and the dates are importing fine into Quicken for me.

In the CSV file I see the latest date as "12/6/2016", and checking in Quicken it shows price history for that date.

sketchy9
Posts: 115
Joined: Mon Oct 25, 2010 2:10 pm

Re: TSP share prices for Quicken

Post by sketchy9 » Tue Sep 12, 2017 11:58 pm

It seems that the scraping site is not working anymore. It's too bad there's no automatic way to get TSP prices into Quicken.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Wed Sep 13, 2017 11:13 am

The instance had stopped responding. The scrape should be back to normal now.

Sim

impdust
Posts: 11
Joined: Sun Sep 07, 2014 2:41 pm

Re: TSP share prices for Quicken

Post by impdust » Sat Sep 16, 2017 10:08 am

Thanks again for continuing to support this , it saves me so much time.

A note for everyone, the certificate changed and the www isn't included as part of the server name, so if you want to avoid the certificate error use this url https://likhite.net/scrape/tspQuicken.csv

If you're using that powershell command I previously posted to automatically download the file you'll want to remove the www from it, otherwise it will throw a "The underlying connection was closed: Could not establish trust relationship for the SSL/TLS secure channel." error.

Simbilis
Posts: 53
Joined: Sat Nov 03, 2012 12:29 pm

Re: TSP share prices for Quicken

Post by Simbilis » Sat Sep 16, 2017 10:14 am

You're very welcome, Impdust. Glad it's of use.

I recently replaced the Gandi cert with one from https://letsencrypt.org/, and I hadn't thought about the 'www' prefix. I'll update the URL in the first post.

sketchy9
Posts: 115
Joined: Mon Oct 25, 2010 2:10 pm

Re: TSP share prices for Quicken

Post by sketchy9 » Sat Sep 16, 2017 11:25 am

Thanks for maintaining this. It's up and running again for me.

:sharebeer

Post Reply