SQX Only uses 23% of avaliabble memory and reports out of memory

I have 128GB of memory, SQX is on "let program determine amount of memory - Recommended"



It never uses more than 30GB - and after several hours stops because it is out of memory??


I guess there is no harm setting it manually to 128GB then?


04:55:19 Databank synchronized to files - 0 records updated in 0.05 s. 04:55:19 Starting databank synchronization... 04:55:19 Databank synchronized to files - 0 records updated in 0.00 s. 04:55:19 Starting databank synchronization... 04:55:19 Databank synchronized to files - 0 records updated in 0.00 s. 04:55:19 Starting databank synchronization... 02:55:19 Databank synchronized to files - 0 records updated in 0.05 s. 02:55:19 Starting databank synchronization... 02:55:19 Databank synchronized to files - 0 records updated in 0.00 s. 02:55:19 Starting databank synchronization... 02:55:19 Databank synchronized to files - 0 records updated in 0.00 s. 02:55:19 Starting databank synchronization... 01:12:55 Tested Strategy 9.14.268 - Main test - OK in 0.21 s. - Cross check - Walk-Forward Optimization - OK in 4126.53 s. 01:12:55 Tested Strategy 9.38.315 - Main test - OK in 0.14 s. - Cross check - Walk-Forward Optimization - OK in 260.45 s. 01:12:54 Project finished 01:12:33 Retest WF 10,000 : Project stopped 01:12:33 Retest WF 10,000 : Genetic engine finished with exception java.lang.OutOfMemoryError: GC overhead limit exceeded at org.jdom2.CloneBase.clone(CloneBase.java:108) at org.jdom2.Attribute.clone(Attribute.java:573) at org.jdom2.Element.clone(Element.java:1448) at org.jdom2.Element.clone(Element.java:105) at org.jdom2.Element.clone(Element.java:1460) at org.jdom2.Element.clone(Element.java:105) at org.jdom2.Element.clone(Element.java:1460) at org.jdom2.Element.clone(Element.java:105) at org.jdom2.Element.clone(Element.java:1460) at org.jdom2.Element.clone(Element.java:105) at org.jdom2.Element.clone(Element.java:1460) at org.jdom2.Element.clone(Element.java:105) at org.jdom2.Element.clone(Element.java:1460) at org.jdom2.Element.clone(Element.java:105) at org.jdom2.Element.clone(Element.java:1460) at org.jdom2.Element.clone(Element.java:105) at org.jdom2.Element.clone(Element.java:1460) at org.jdom2.Element.clone(Element.java:105) at org.jdom2.Element.clone(Element.java:1460) at SQ.Internal.XmlStrategyModifier.createStrategyVariation(XmlStrategyModifier.java:23) at com.strategyquant.tradinglib.StrategyBase.createStrategyVariation(Unknown Source) at com.strategyquant.tradinglib.optimization.OptimizerBacktestEvaluator.evaluateCandidate(Unknown Source) at com.strategyquant.tradinglib.optimization.OptimizerBacktestEvaluator.evaluateCandidate(Unknown Source) at com.strategyquant.tradinglib.gp.GPEvaluationJob.call(Unknown Source) at com.strategyquant.tradinglib.gp.GPEvaluationJob.call(Unknown Source) at com.strategyquant.gridlib.compute.performer.MultithreadComputePerformer$1.run(Unknown Source) at com.strategyquant.gridlib.concurrent.ThreadPool$TaskExecutor.run(Unknown Source) at java.base/java.lang.Thread.run(Thread.java:834) 01:08:34 Retest WF 10,000 : Tested Strategy 9.59.315 - Main test - OK in 0.21 s. - Cross check - Walk-Forward Optimization - OK in 279.20 s. 01:03:54 Retest WF 10,000 : Tested Strategy 9.32.237 - Main test - OK in 0.16 s. - Cross check - Walk-Forward Optimization - OK in 230.46 s. 01:00:04 Retest WF 10,000 : Tested Strategy 9.17.242

Attachments
No attachments
  • Votes 0
  • Project StrategyQuant X
  • Type Bug
  • Status Fixed
  • Priority Normal

History

N
#1

nathan

28.02.2019 07:30

Task created

TB
#2

Tomas Brynda

28.02.2019 20:28

Status changed from New to Fixed

Yes, you can choose the option "Set maximum memory to" in memory settings. The recommended option is ussually used for computers with lower RAM capacity.


Next release should solve some excessive memory consumption issues. OutOfMemoryErrors should no longer occur under normal circumstances


Votes: 0

Drop files to upload

or

choose files

Max size: 5MB

Not allowed: exe, msi, application, reg, php, js, htaccess, htpasswd, gitignore

...
Wait please