Builder stops because SQ runs out of memory

I have this issue way too many times with 116 that is attached. I saw in FAQ the command to extend the memory for SQ but I do not know how to apply it.  I never had this problem in build115.

Can you help, please.

Attachments
2018-12-22_2120.png
(13.75 KiB)
  • Votes +7
  • Project StrategyQuant X
  • Type Bug
  • Status Fixed
  • Priority Normal

History

rg
#1

Robert Gergelyi

22.12.2018 21:26

Task created

In the settings I tried every options but nothing helps. I get this memory failure around every half an hour when running the builder.
m
#2

mabi

23.12.2018 01:32

Try this freeware. Worked for me before now I do not have any problem thought but I am still using it I see now :)


https://www.koshyjohn.com/software/memclean/

t
#3

tnickel

23.12.2018 07:01

the memory consumption of the new SQ 116 is very big.

I have the same problem.

I use 60 GB, but over night calculation the memory is full

rg
#4

Robert Gergelyi

23.12.2018 08:38
@mabi this is a good workaround. Thanks!
rg
#5

Robert Gergelyi

23.12.2018 08:44
@tnickel, How many strategies do you create per hour with your 60GB system?
Rr
#6

Partizanas

23.12.2018 10:00

Attachment Screenshot_1.png added

Attachment Screenshot_2.png added

Attachment Screenshot_3.png added

Attachment Screenshot_4.png added

Same problem.after half hour SQX is used full PC RAM on 1 Threads... 

something wrong with the memory cleaning, B115 it was not

Rr
#7

Partizanas

23.12.2018 19:31
This problem is only genetic evolution building,on retest and random generation memory cleaning working good.
m
#8

Martin

24.12.2018 00:23
Voted for this task.
MF
#9

Mark Fric

26.12.2018 14:00
can you please provide a few examples of build settings?
i
#10

altuğ ankaralı

26.12.2018 16:14
Voted for this task.
Rr
#11

Partizanas

26.12.2018 16:35

Attachment Build.cfx added

m
#12

mkjones320

28.12.2018 15:46

Hi,

I have tried Genetic build with multiple different memory settings and cleanup options.   Its giving me the 85% memory consumption error on every setting I have tried.  8gb (1hr cleanup), 12gb (15min cleanup), 16gb (5min cleanup, and 28gb (No Cleanup).   Build 116 will run for about an hr. maybe shorter depending on how many instances you have running and how much memory you have and then stop.

Thanks,

mkjones320

m
#13

mkjones320

28.12.2018 15:46
Voted for this task.
g
#14

geektrader

29.12.2018 18:07
Voted for this task.
g
#15

geektrader

29.12.2018 18:08
I can confirm this too. Any longer genetic building with many generations (~500+) results in memory being filled up more and more, even if the database of strategies does not really grow. This wasn´t the case in build 115. Seems like a leak somewhere in your code that even the GC can´t collect because it is still referenced somewhere.
Rr
#16

Partizanas

29.12.2018 18:48
Voted for this task.
AC
#17

AC1962

29.12.2018 23:08
Voted for this task.
MF
#18

Mark Fric

31.12.2018 08:27

Status changed from New to Fixed

it is fixed, I found the problem. It was really caused by Genetic engine, it didn't clean its old results when it was restarted, so the memoty keep on growing.
NF
#19

giantj

02.01.2019 09:26
Voted for this task.

Votes: +7

Drop files to upload

or

choose files

Max size: 5MB

Not allowed: exe, msi, application, reg, php, js, htaccess, htpasswd, gitignore

...
Wait please