Memory Management
Hi Mark,
I have been able to generate some strategies in G Evolution following your advice on reducing the island size configuration. All is working well. However,
I can't after about 2000 strategies memory is completely full. I don't get the chance to save strategies before is freezes and have to force it to close. This means I lose all strategies generated.
Note: I have about 1700 strategies in initial population databank when I am running genetic evolution.
Should I clear these initial strategies data bank as well when memory is rising?
Should the system save incrementally as it goes along? - otherwise I have to sit around ready to jump in to save or save incrementally.
Have these problems got anything to do with the handling of Java?
I used to leave the system running for days...now can't! A few hours and its struggling!
Can't upload the log file because its exceeding 2 MB.
-
Votes 0
-
Project StrategyQuant X
-
Type Bug
-
Status Fixed
-
Priority Normal
History
j
MF
j
Jojo
30.07.2018 13:34Hi Mark,
After I load the initial population my memory is at about 4 GB. Initially, my CPU load is about 50% - affinity settings at 4/8 threads.
Trades within the Initial strategies - Lowest 200, highest 3000 and median 380 - i think.
So what I have started doing is keep an eye on the memory - when rises to 10, I save and clear from the results data bank and start again. I don't think this is how you designed it to run.
MF
Mark Fric
08.08.2018 09:58Status changed from New to Fixed
we made improvements in memory allocation, now SQ uses less memory allowing to work also with thousands of strategies.
Votes: 0
© Copyright. All rights reserved. ProjectPanel.com
It could be possibly related to these 1700 strategies you have in Initial population.
Can you tell me how big is your memory after you load these 1700 strategies and before you start the builder?
How many trades do these initial strategies have in average?