Enable "Store Chart Data" Option on strategy building will leave huge temporary file

Temp is around 200-300 GB when I run SQX for 1-3 hours. I check task manager it shows that SQX writes to disk at a rate around 60MB/s.


I use SDD drive so this will wear out my SSD very quick plus I cannot run SQX for long before disk get full.

Please check the picture I've attached. The settings file is corrupt now because the disk is full and when I change the settings, the settings file get corrupt.  Any idea why?
Attachments
Annotation 2019-09-16 220118.png
(351.06 KiB)
  • Votes 0
  • Project StrategyQuant X
  • Type Bug
  • Status Fixed
  • Priority Normal

History

PS
#1

ps21

16.09.2019 18:02

Task created

h
#2

hankeys

16.09.2019 18:17
and i have another one question - what for are those DAT files in INTERNAL - TESTFILES?


isnt those some duplicates for user - data?

t
#3

tnickel

17.09.2019 00:20

it is helpfull if you attach your setting.

I checked this on my computer. The size of my internal directory is fixed.

No increasing.


I will check this over night.


possible the setting cause this problem??


PS
#4

ps21

17.09.2019 04:02
@tnickel The settings file was lost during the incident. I'll try to replicate the problem today.
PS
#5

ps21

17.09.2019 09:04

Attachment project.cfx added

Hi guys,


 I just found that store chart data in build option cause this. I also attach settings file that maybe replicate the problem with this comment.


 I set build settings to stop generate when there 100 strategies. Maybe store chart data use more disk space for the tempory file, but 200-300 GB size this is insane. My SQX also writes to disk at the rate about 50-60 MB/s.


TT
#6

Tamas

20.09.2019 13:02
Please uncheck Store chart data on Trading options tab and delete temp files under /internal/tmp/stock.


It will be fixed in the next version.

MF
#7

Mark Fric

24.09.2019 13:36

Status changed from New to Fixed

fixed, it should delete temp files when not needed.



> and i have another one question - what for are those DAT files in INTERNAL - TESTFILES?

> isnt those some duplicates for user - data?


those are data feeds in binary format, somehting like FXT files for MT4. It isn't as same as user/data/ because data feed can be composed of multiple symbols.

But you can delete these files anytime, they will be recreated when needed by SQ.


PS
#8

ps21

09.10.2019 09:12

Subject changed from SQX Temp file is 200+ GB to Enable "Store Chart Data" Option on strategy building will leave huge tempory file

PS
#9

ps21

09.10.2019 11:54

Subject changed from Enable "Store Chart Data" Option on strategy building will leave huge tempory file to Enable "Store Chart Data" Option on strategy building will leave huge temporary file


Votes: 0

Drop files to upload

or

choose files

Max size: 5MB

Not allowed: exe, msi, application, reg, php, js, htaccess, htpasswd, gitignore

...
Wait please