Home Page link  

Trimming down my Quicken data files

 

Quicken Personal Finance Discussions - Quicken - personal finance software discussions

 Post an article  get this group's latest topics as an RSS feed add this group's latest topics to your My MSN content add this group's latest topics to your My Yahoo content  add this group's latest topics to your Google content  YahooMyWeb Yahoo!  Google Google  Windows Live Favorites Windows Live  del.icio.us del.icio.us  digg digg  Add to Netscape Netscape
Subject Author Date
Trimming down my Quicken data files Jeff 06-04-2007
Posted by Jeff on June 6, 2007, 6:23 am
Please log in for more thread options
> Jeff wrote:
>> Running Quicken Deluxe 2006 in Windows XP.
>>
>> My Quicken data files are getting large enough that they are
>> causing a
>> significant slowdown in Quicken's operations whenever it need
>> to
>> accept a downloaded transaction on my poor PC. It does not
>> help that
>> I keep my Quicken data files in an encrypted folder on my PC
>> which
>> probably adds time to the processing.
>>
>> So I would like to reduce the size of my Q files to speed up
>> operations. I have data that goes back many years and I would
>> like to
>> archive some of these years with the ability to access them
>> again -
>> on the rare chance I would need them again. How do I go about
>> doing
>> that?
>> BTW, what are the QEL and QPH files which alone measure over
>> 10 and 7
>> MB respectively in addition to the main data file of 35 MB?
>
> My first choice would be to make sure my hardware was not
> involved in the slowdown; once you archive, it will be
> increasingly difficult to maintain access to the archived data.
> Before I archive to increase response time, I'll buy some better
> hardware.

I do not think it is a hardware thing because the notebook I am using is
only 1 year old and not a cheap basic model. It even has 2 G Ram
without using Vista. The hard drive is regularly fragmented and I have
the same trouble when I use Quicken on my desktop PC which, though
older, is also not a relic. It may have to do with the files being on an
encrypted drive but I need to have that for security.

> I think R.C. already mentioned that the QEL file contains data
> relating to online features; in and of itself, I don't think it
> is a cause of slowness.
>
> And I think R.C.pointed out that the QPH file is your price
> history; it definitely can be involved in slow response time.
> Someone in the Quicken Forums just posted that they wrote a
> program that would clean out the price history of unwanted
> prices ... you might try asking that poster if they would share
> the program.

I will do that. Thanks for the pointer.

Would the accumulated price history in the QPH file consist of data I
may have accidentally downloaded at one time from Quicken or it that
data Quicken acquires from the monthly broker downloads which obviously
give the security prices at the times of purchase and sales?

> Baring getting help from some other program, you could do some
> manual pruning of the price history your own, though it could be
> a bit cumbersome.

Just so I know what that data consists of, where and how do I do that.

> Before doing anything, if you'd like to test to see what effect
> the price history is having on processing your downloads, try
> backing up your current data to a new folder (to create a test
> file), using Windows to delete the QPH file from that new
> folder, have Quicken open the file in the new folder - then do a
> download to that new file (which will have an empty price
> history when you start the download). Since the only change
> you'll be making to the data (before the download) is to have an
> empty price history, you should get a feel for what the effect
> of your price history is on your download processing speed.

Excellent idea. Will definitely do that. But, just for the record and
to avoid a misunderstanding, it is not the download speed that is the
problem especially as I have a very fast internet connection.

Where the problem lies for me is that
a) when "accepting" each downloaded sale transaction

("Accept dopwnloaded transactions into transaction list", and I click on
"accept" on each one to accept it)

Quicken takes a number of seconds to process "each" accepted transaction
before I can move on to the next one to accept and these seconds add up
if one has a lot of transaction to "accept" every month.

b) certain busy accounts definitely take much longer to open within
Quicken than others - which though a nuiscance, I could live with
because it only affects certain accounts and is a one time delay.

> My guess is, as you have already noted (or implied) that the
> majority of your slowness is on account of investment data of
> one sort or another.

That is the only place I am having trouble: accepting transactions on
certain busy investment accounts

> If that's true, your ability to improve your response time by
> archiving may be quite limited. Just using Quicken's archiving
> capabilities only works in chunks of data that can be defined by
> a range of dates; that works fine for non-investment data, but
> not so well for investment data.

I was afraid of that. It is in some investment accounts that I am
having trouble. The rest are OK.

By your using the term "archiving" above, I assume you mean the year end
reduction function. Correct?

> Still assuming the major problem is in investment data; other
> than just pruning your price history, I think your best bet
> would be to work out some system where you decide which old
> investments you no longer need - such as you sold the last share
> 5 years ago - and manually delete all the transactions for those
> (and their price history which is not deleted automatically by
> Quicken).
>
> [Actually, if you get to the point of wanting to delete
> investment transactions, I think Q2006 has a way that you can
> delete multiple investment transactions at once. You can post
> back if you get to that point.]

I guess this form of deleting removes them forever rather than archive
them for later availability.

Thanks John. As usual you are a fountain of knowledge. Do not know what
this newsgroup would do without you. Thank you for taking the time to
try to help.

Jeff



Posted by John Pollard on June 6, 2007, 1:38 pm
Please log in for more thread options
Jeff wrote:
>> Jeff wrote:
>>> Running Quicken Deluxe 2006 in Windows XP.
>>>
>>> My Quicken data files are getting large enough that they are
>>> causing a
>>> significant slowdown in Quicken's operations whenever it
>>> need
>>> to
>>> accept a downloaded transaction on my poor PC. It does not
>>> help that
>>> I keep my Quicken data files in an encrypted folder on my PC
>>> which
>>> probably adds time to the processing.
>>>
>>> So I would like to reduce the size of my Q files to speed up
>>> operations. I have data that goes back many years and I
>>> would
>>> like to
>>> archive some of these years with the ability to access them
>>> again -
>>> on the rare chance I would need them again. How do I go
>>> about
>>> doing
>>> that?
>>> BTW, what are the QEL and QPH files which alone measure over
>>> 10 and 7
>>> MB respectively in addition to the main data file of 35 MB?
>>
>> My first choice would be to make sure my hardware was not
>> involved in the slowdown; once you archive, it will be
>> increasingly difficult to maintain access to the archived
>> data.
>> Before I archive to increase response time, I'll buy some
>> better
>> hardware.
>
> I do not think it is a hardware thing because the notebook I
> am using
> is only 1 year old and not a cheap basic model. It even has 2
> G Ram
> without using Vista. The hard drive is regularly fragmented
> and I
> have the same trouble when I use Quicken on my desktop PC
> which,
> though older, is also not a relic. It may have to do with the
> files
> being on an encrypted drive but I need to have that for
> security.
>
>> I think R.C. already mentioned that the QEL file contains
>> data
>> relating to online features; in and of itself, I don't think
>> it
>> is a cause of slowness.
>>
>> And I think R.C.pointed out that the QPH file is your price
>> history; it definitely can be involved in slow response time.
>> Someone in the Quicken Forums just posted that they wrote a
>> program that would clean out the price history of unwanted
>> prices ... you might try asking that poster if they would
>> share
>> the program.
>
> I will do that. Thanks for the pointer.
>
> Would the accumulated price history in the QPH file consist of
> data I
> may have accidentally downloaded at one time from Quicken or
> it that
> data Quicken acquires from the monthly broker downloads which
> obviously give the security prices at the times of purchase
> and sales?

There are at least 4 ways prices get in your price history:
Quicken quotes/historical-price downloads, Quicken updates from
your financial institution holdings downloads, the entry of
investment transactions that involve a price ... if there is not
already a price in your history for that date, and user manual
updates of the price history.

>> Baring getting help from some other program, you could do
>> some
>> manual pruning of the price history your own, though it could
>> be
>> a bit cumbersome.

> Just so I know what that data consists of, where and how do I
> do that.

The most straight forward method is to Edit Price History and
delete the prices you do not need. You can apply some logic to
choosing the prices to delete, such as deleting prices that date
prior to your ownership of a security or after you sold all
shares of a security. Possibly deleting non-month end prices
for periods for which you only look at month end market values.
Etc.

>> Before doing anything, if you'd like to test to see what
>> effect
>> the price history is having on processing your downloads, try
>> backing up your current data to a new folder (to create a
>> test
>> file), using Windows to delete the QPH file from that new
>> folder, have Quicken open the file in the new folder - then
>> do a
>> download to that new file (which will have an empty price
>> history when you start the download). Since the only change
>> you'll be making to the data (before the download) is to have
>> an
>> empty price history, you should get a feel for what the
>> effect
>> of your price history is on your download processing speed.

> Excellent idea. Will definitely do that. But, just for the
> record
> and to avoid a misunderstanding, it is not the download speed
> that is
> the problem especially as I have a very fast internet
> connection.

Sorry, my phrasing was not good (should have said something
like, " ... your downloaded transaction processing speed" or
your "Accept speed"). I did/do understand the problem you're
having; none of my suggestions were addressed to the actual
download time ... just to the "Accept" time.

> Where the problem lies for me is that
> a) when "accepting" each downloaded sale transaction
>
> ("Accept dopwnloaded transactions into transaction list", and
> I click
> on "accept" on each one to accept it)
>
> Quicken takes a number of seconds to process "each" accepted
> transaction before I can move on to the next one to accept and
> these
> seconds add up if one has a lot of transaction to "accept"
> every
> month.
> b) certain busy accounts definitely take much longer to open
> within
> Quicken than others - which though a nuiscance, I could live
> with
> because it only affects certain accounts and is a one time
> delay.

>> My guess is, as you have already noted (or implied) that the
>> majority of your slowness is on account of investment data of
>> one sort or another.

> That is the only place I am having trouble: accepting
> transactions on
> certain busy investment accounts

>> If that's true, your ability to improve your response time by
>> archiving may be quite limited. Just using Quicken's
>> archiving
>> capabilities only works in chunks of data that can be defined
>> by
>> a range of dates; that works fine for non-investment data,
>> but
>> not so well for investment data.
>
> I was afraid of that. It is in some investment accounts that
> I am
> having trouble. The rest are OK.

> By your using the term "archiving" above, I assume you mean
> the year
> end reduction function. Correct?

Yes. But that feature seems to be broken in the newer versions
of Quicken. The suggestion has been to use the Quicken "File
Operations > Copy" feature, rather than the Year End feature.
But both suffer from the same limitations for your purposes.

>> Still assuming the major problem is in investment data; other
>> than just pruning your price history, I think your best bet
>> would be to work out some system where you decide which old
>> investments you no longer need - such as you sold the last
>> share
>> 5 years ago - and manually delete all the transactions for
>> those
>> (and their price history which is not deleted automatically
>> by
>> Quicken).
>>
>> [Actually, if you get to the point of wanting to delete
>> investment transactions, I think Q2006 has a way that you can
>> delete multiple investment transactions at once. You can
>> post
>> back if you get to that point.]

> I guess this form of deleting removes them forever rather than
> archive
> them for later availability.

Yes it does; but what I forgot to mention in my previous post is
that you can just keep a backup, prior to deleting any data, for
your "archived" data.

--
John Pollard
First initial underscore Last name at mchsi dot com
Please reply to newsgroup




Posted by Jeff on June 6, 2007, 4:31 pm
Please log in for more thread options
John Pollard wrote:
> Jeff wrote:
>>> Jeff wrote:
>>>> Running Quicken Deluxe 2006 in Windows XP.
>>>>
>>>> My Quicken data files are getting large enough that they are
>>>> causing a
>>>> significant slowdown in Quicken's operations whenever it
>>>> need
>>>> to
>>>> accept a downloaded transaction on my poor PC. It does not
>>>> help that
>>>> I keep my Quicken data files in an encrypted folder on my PC
>>>> which
>>>> probably adds time to the processing.
>>>>
>>>> So I would like to reduce the size of my Q files to speed up
>>>> operations. I have data that goes back many years and I
>>>> would
>>>> like to
>>>> archive some of these years with the ability to access them
>>>> again -
>>>> on the rare chance I would need them again. How do I go
>>>> about
>>>> doing
>>>> that?
>>>> BTW, what are the QEL and QPH files which alone measure over
>>>> 10 and 7
>>>> MB respectively in addition to the main data file of 35 MB?
>>>
>>> My first choice would be to make sure my hardware was not
>>> involved in the slowdown; once you archive, it will be
>>> increasingly difficult to maintain access to the archived
>>> data.
>>> Before I archive to increase response time, I'll buy some
>>> better
>>> hardware.
>>
>> I do not think it is a hardware thing because the notebook I
>> am using
>> is only 1 year old and not a cheap basic model. It even has 2
>> G Ram
>> without using Vista. The hard drive is regularly fragmented
>> and I
>> have the same trouble when I use Quicken on my desktop PC
>> which,
>> though older, is also not a relic. It may have to do with the
>> files
>> being on an encrypted drive but I need to have that for
>> security.
>>
>>> I think R.C. already mentioned that the QEL file contains
>>> data
>>> relating to online features; in and of itself, I don't think
>>> it
>>> is a cause of slowness.
>>>
>>> And I think R.C.pointed out that the QPH file is your price
>>> history; it definitely can be involved in slow response time.
>>> Someone in the Quicken Forums just posted that they wrote a
>>> program that would clean out the price history of unwanted
>>> prices ... you might try asking that poster if they would
>>> share
>>> the program.
>>
>> I will do that. Thanks for the pointer.
>>
>> Would the accumulated price history in the QPH file consist of
>> data I
>> may have accidentally downloaded at one time from Quicken or
>> it that
>> data Quicken acquires from the monthly broker downloads which
>> obviously give the security prices at the times of purchase
>> and sales?
>
> There are at least 4 ways prices get in your price history:
> Quicken quotes/historical-price downloads, Quicken updates from
> your financial institution holdings downloads, the entry of
> investment transactions that involve a price ... if there is not
> already a price in your history for that date, and user manual
> updates of the price history.
>
>>> Baring getting help from some other program, you could do
>>> some
>>> manual pruning of the price history your own, though it could
>>> be
>>> a bit cumbersome.
>
>> Just so I know what that data consists of, where and how do I
>> do that.
>
> The most straight forward method is to Edit Price History and
> delete the prices you do not need. You can apply some logic to
> choosing the prices to delete, such as deleting prices that date
> prior to your ownership of a security or after you sold all
> shares of a security. Possibly deleting non-month end prices
> for periods for which you only look at month end market values.
> Etc.
>
>>> Before doing anything, if you'd like to test to see what
>>> effect
>>> the price history is having on processing your downloads, try
>>> backing up your current data to a new folder (to create a
>>> test
>>> file), using Windows to delete the QPH file from that new
>>> folder, have Quicken open the file in the new folder - then
>>> do a
>>> download to that new file (which will have an empty price
>>> history when you start the download). Since the only change
>>> you'll be making to the data (before the download) is to have
>>> an
>>> empty price history, you should get a feel for what the
>>> effect
>>> of your price history is on your download processing speed.
>
>> Excellent idea. Will definitely do that. But, just for the
>> record
>> and to avoid a misunderstanding, it is not the download speed
>> that is
>> the problem especially as I have a very fast internet
>> connection.
>
> Sorry, my phrasing was not good (should have said something
> like, " ... your downloaded transaction processing speed" or
> your "Accept speed"). I did/do understand the problem you're
> having; none of my suggestions were addressed to the actual
> download time ... just to the "Accept" time.
>
>> Where the problem lies for me is that
>> a) when "accepting" each downloaded sale transaction
>>
>> ("Accept dopwnloaded transactions into transaction list", and
>> I click
>> on "accept" on each one to accept it)
>>
>> Quicken takes a number of seconds to process "each" accepted
>> transaction before I can move on to the next one to accept and
>> these
>> seconds add up if one has a lot of transaction to "accept"
>> every
>> month.
>> b) certain busy accounts definitely take much longer to open
>> within
>> Quicken than others - which though a nuiscance, I could live
>> with
>> because it only affects certain accounts and is a one time
>> delay.
>
>>> My guess is, as you have already noted (or implied) that the
>>> majority of your slowness is on account of investment data of
>>> one sort or another.
>
>> That is the only place I am having trouble: accepting
>> transactions on
>> certain busy investment accounts
>
>>> If that's true, your ability to improve your response time by
>>> archiving may be quite limited. Just using Quicken's
>>> archiving
>>> capabilities only works in chunks of data that can be defined
>>> by
>>> a range of dates; that works fine for non-investment data,
>>> but
>>> not so well for investment data.
>>
>> I was afraid of that. It is in some investment accounts that
>> I am
>> having trouble. The rest are OK.
>
>> By your using the term "archiving" above, I assume you mean
>> the year
>> end reduction function. Correct?
>
> Yes. But that feature seems to be broken in the newer versions
> of Quicken. The suggestion has been to use the Quicken "File
> Operations > Copy" feature, rather than the Year End feature.
> But both suffer from the same limitations for your purposes.
>
>>> Still assuming the major problem is in investment data; other
>>> than just pruning your price history, I think your best bet
>>> would be to work out some system where you decide which old
>>> investments you no longer need - such as you sold the last
>>> share
>>> 5 years ago - and manually delete all the transactions for
>>> those
>>> (and their price history which is not deleted automatically
>>> by
>>> Quicken).
>>>
>>> [Actually, if you get to the point of wanting to delete
>>> investment transactions, I think Q2006 has a way that you can
>>> delete multiple investment transactions at once. You can
>>> post
>>> back if you get to that point.]
>
>> I guess this form of deleting removes them forever rather than
>> archive
>> them for later availability.
>
> Yes it does; but what I forgot to mention in my previous post is
> that you can just keep a backup, prior to deleting any data, for
> your "archived" data.

Thank you very much John. That helps explain a lot.

Jeff



Posted by JM on June 6, 2007, 9:01 am
Please log in for more thread options
> Running Quicken Deluxe 2006 in Windows XP.
>
> My Quicken data files are getting large enough that they are causing a
> significant slowdown in Quicken's operations whenever it need to accept
> a downloaded transaction on my poor PC. It does not help that I keep my
> Quicken data files in an encrypted folder on my PC which probably adds
> time to the processing.
>
> So I would like to reduce the size of my Q files to speed up operations.
> I have data that goes back many years and I would like to archive some
> of these years with the ability to access them again - on the rare
> chance I would need them again. How do I go about doing that?
>
> BTW, what are the QEL and QPH files which alone measure over 10 and 7 MB
> respectively in addition to the main data file of 35 MB?
>
> Thanks.
>
> Jeff

Jeff

If you really want to do it you can trim your file - including
investment transactions - by using the File Copy routine. In the Copy
pop-up window, you specify the date range to be preserved and uncheck
the two boxes - 'Include All Prior Uncleared Transactions' and
'Include All Prior Investment Transactions'.

The Copy routine handles non-investment accounts satisfactorily - the
old transactions are deleted and the new beginning balance for each
account is automatically adjusted.

The Copy routine wreaks havoc with an investment account:

1) For securities held on the cutoff date - all prior info is lost -
acquisition date, acquisition cost [cost basis], any reinvested
dividends, splits, ROC, etc, etc - this info is all deleted/lost - you
can be left with meaningless data.

2) QW does not carry over the beginning cash balance [if it is other
than zero].

You can get around these problems with some advance preparation - I
have done this in a test file.

Assume a cutoff date of 01/01/2002 [5+ yrs history]
Open a portfolio view for the cutoff date and note all security
holdings as of this date - recommend you print a copy.
Also, note the beginning cash balance for each investment account for
this date - e.g., cash balances for 12/31/2001.
Enter a Corporate Acquisition transaction for each security holding -
e.g., MSFT buys MSFT at 1:1 sh/sh on 01/01/2002. Note that this
procedure creates a register entry that will carry forward the
acqusition date and cost basis for each security.to the cutoff date.
Execute the File Copy routine per above.
Open the new trimmed file and delete the 'Shares Removed' transactions
datedl 01/01/2002. These are the Shares Removed created by the CorpAcq
above.
Insert an 'Opening Balance' transactions for each investment account
dated 01/01/2002.

Your investment accounts should now be in balance.

As indicated above, I have done this in a test file and it works. It
is tedious. It is also prone to input error so backup before
launching. in to it.

Would I recommend all users do this - NO!! - I'll second RC's and
John's earlier observations/comments.


Posted by Jeff on June 6, 2007, 4:33 pm
Please log in for more thread options
JM wrote:
>> Running Quicken Deluxe 2006 in Windows XP.
>>
>> My Quicken data files are getting large enough that they are causing
>> a significant slowdown in Quicken's operations whenever it need to
>> accept a downloaded transaction on my poor PC. It does not help
>> that I keep my Quicken data files in an encrypted folder on my PC
>> which probably adds time to the processing.
>>
>> So I would like to reduce the size of my Q files to speed up
>> operations. I have data that goes back many years and I would like
>> to archive some of these years with the ability to access them again
>> - on the rare chance I would need them again. How do I go about
>> doing that?
>>
>> BTW, what are the QEL and QPH files which alone measure over 10 and
>> 7 MB respectively in addition to the main data file of 35 MB?
>>
>> Thanks.
>>
>> Jeff
>
> Jeff
>
> If you really want to do it you can trim your file - including
> investment transactions - by using the File Copy routine. In the Copy
> pop-up window, you specify the date range to be preserved and uncheck
> the two boxes - 'Include All Prior Uncleared Transactions' and
> 'Include All Prior Investment Transactions'.
>
> The Copy routine handles non-investment accounts satisfactorily - the
> old transactions are deleted and the new beginning balance for each
> account is automatically adjusted.
>
> The Copy routine wreaks havoc with an investment account:
>
> 1) For securities held on the cutoff date - all prior info is lost -
> acquisition date, acquisition cost [cost basis], any reinvested
> dividends, splits, ROC, etc, etc - this info is all deleted/lost - you
> can be left with meaningless data.
>
> 2) QW does not carry over the beginning cash balance [if it is other
> than zero].
>
> You can get around these problems with some advance preparation - I
> have done this in a test file.
>
> Assume a cutoff date of 01/01/2002 [5+ yrs history]
> Open a portfolio view for the cutoff date and note all security
> holdings as of this date - recommend you print a copy.
> Also, note the beginning cash balance for each investment account for
> this date - e.g., cash balances for 12/31/2001.
> Enter a Corporate Acquisition transaction for each security holding -
> e.g., MSFT buys MSFT at 1:1 sh/sh on 01/01/2002. Note that this
> procedure creates a register entry that will carry forward the
> acqusition date and cost basis for each security.to the cutoff date.
> Execute the File Copy routine per above.
> Open the new trimmed file and delete the 'Shares Removed' transactions
> datedl 01/01/2002. These are the Shares Removed created by the CorpAcq
> above.
> Insert an 'Opening Balance' transactions for each investment account
> dated 01/01/2002.
>
> Your investment accounts should now be in balance.
>
> As indicated above, I have done this in a test file and it works. It
> is tedious. It is also prone to input error so backup before
> launching. in to it.
>
> Would I recommend all users do this - NO!! - I'll second RC's and
> John's earlier observations/comments.

Thank you very much,

Jeff



Similar ThreadsPosted
Trimming Down My Quicken Data File, Part II January 9, 2008, 10:54 pm
Quicken 2007 & non-us data files August 22, 2006, 3:51 pm
How do you Sync Quicken data files? October 29, 2007, 8:48 am
How do You Sync Quicken Data Files, Part II January 20, 2008, 1:44 pm
Sharing Quicken Data Files With Other Users of XP Computer? November 21, 2006, 4:18 pm
Location of data files July 7, 2006, 8:33 pm
Data Files - Experimenting May 7, 2008, 7:42 pm
DATA FILES ARE IN VIRTUAL FOLDER June 26, 2008, 2:33 pm
Moving Q2008 Cash Manager data files... what do I need? April 9, 2008, 2:29 am
Quicken Files February 21, 2007, 9:12 pm

Contact Us | Privacy Policy
This site is not affiliated with Intuit - makers of Quickbooks and Quicken software
This site is not affiliated with Sage Software - makers of Peachtree accounting software
XML SitemapXML Sitemap