Not using memory to store strategies
if I enable storage of strategies to drive instead of mem it still loads all strategies to memory in re-tester. So loading 35 k strategies :) takes 50 gig of ram. And even if I have more ram then 50 gig SQx still get unresponsive.. So whats the problem here why have a setting storing strategies to drive if it do not work.
Attachments
No attachments
-
Votes 0
-
Project StrategyQuant X
-
Type Bug
-
Status Refused
-
Priority Normal
History
m
MF
m
MF
Mark Fric
29.05.2019 13:28Status changed from Waiting for information to Refused
as I wrote above, strategies are always stored in the memory. So the recommendation is to not try to work with that many strategies. When you have 35k strategies, with 1000 orders each, it is 35 mil. orders. When you also have MC or WF results stored for the strategy, it can easily be 100x that.
In any case, I tried to load 20k strategies (made a copy of those you sent). It took around 11 GB RAM, and work with SQ is relatively normal, no big lagging in the UI.
We made many optimizations in the recent builds, they probably helped as well.
m
Votes: 0
© Copyright. All rights reserved. ProjectPanel.com
Could you attach a few of your strategies so I can check what takes so much memory?
Perhaps we can add an option to not save Monte Carlo and WF results to files to save memory when you load them next time.