Updating from 115 to 116 and from 116 to 117 deletes 85% of strategies in builder data bank

Auto update from 115 to 116 deleted 85% of strategies from the builder databank.... 9221 became 1362, the remaining strategies have been deleted from the hard drive during update.



I had a backup anyway after similar experiences of data loss when updating versions in the past.


Today I updated from 116 to 117 and the same thing append...7859 strategies were deleted from the hard drive during the update from  /projects/builder/databanks/results

Attachments
No attachments
  • Votes +1
  • Project StrategyQuant X
  • Type Bug
  • Status Fixed
  • Priority High

History

N
#1

nathan

07.01.2019 12:03

Task created

MF
#2

Mark Fric

08.01.2019 09:59

Status changed from New to Waiting for information

Priority changed from Normal to High

Nathan, I can't believe this is possible, update doesn't overwrite or delete anything in projects or databanks. 


How exactly did you updated it? Using the autoupdater when it told you there is a new version?


Can't there be another reason for that? For example that the files that were "deleted" were in fact damaged?



N
#3

nathan

08.01.2019 10:20
I used the auto-updater upon launch when it asked...I know, I don't get it either...chalked it off to a one off first time, but when it happened again going from 116 to 117 thought I better flag it.


After restoring the files from a backup first time it happened, I was working with them fine in re-tester/optimizer etc. Whether or not this means they were damaged or not I dont know, but re-tester and optimizer loaded them fine at least and I could work with them. Then from 116-117 they were deleted again during the update (builder/results only each time)


I can try a fresh install of 117, then see if it goes away moving from 117-118 at the end of the month, but I am loathe to do a fresh install (although it is always my preference)...all my settings, tick data, project settings etc take an age to set back up, especially downloading the tick data. Is there a fool-proof way of doing a fresh install and bringing all existing data and settings (builder, retester, optimiser etc)  across so I can simply pickup where I left off work-wise following a fresh install? I tried simply copying across the 'user' folder and all subfolders and files below it around build 113/114 but that went wrong, and tick data didn't show up. Is there a process that works? Overwite all, none, some...more folders than 'user' and its subfolders? Happy to try it there is and it doesn't cost me a day to set things back up again.

MF
#4

Mark Fric

08.01.2019 10:35
I will try to reproduce it, but can you describe to me how exactly did you made an upgrade?


You had version 116 with XXX strategies in Builder databank. Does it mean that when you closed SQ and the restarted SQ again you still saw those XXX in databank, right? 

Are you sure they were saved to disc and not only in memory?


Then you started SQ again, it shows you message that there is a new version. You updated it, started new version of SQ and you saw only YYY strategies, in databank, and the rest was lost?

Were they also deleted from the disc?


N
#5

nathan

08.01.2019 11:05

You had version 116 with XXX strategies in Builder databank. Does it mean that when you closed SQ and the restarted SQ again you still saw those XXX in databank, right? 

Are you sure they were saved to disc and not only in memory?   


Correct. 9221 in the builder/results data bank. Saved to disk. I know this for sure because I manually backed them up before doing the update after my previous experience of losing them going from 115 to 116.



Then you started SQ again, it shows you message that there is a new version. You updated it, started new version of SQ and you saw only YYY strategies, in databank, and the rest was lost?

Were they also deleted from the disc?


Yes, and Yes. I launched SQX and it asked if I wanted to update, I said yes. After update completed and SQX opened there were only 1362/9221 strategies left. I checked the folder on the hard drive and this also contained only 1362 strategies, the remainder had been deleted from the hard drive too.


If there is any way to do a fresh install and maintain all my setting and data, please let me know. I am not really trusting the current 'updated' installation, and would like to do a fresh install. I can do a fresh install of 116 if you like, bring across all my settings, data and strategies etc, then have auto update upgrade it to 117 and see if it happens again?

MF
#6

Mark Fric

08.01.2019 12:08
It cannot be an issue of updater, the only explanation I have is that b117 somehow wasn't able to load these strategies. Do you have them backed up by chance?


If you make a clean install and then copy /user folder from your old installation you'll copy all your projects, settings, strategies and data to the new installation, but you'll probably also overwrite a few new configurations that were a part of update.

N
#7

nathan

08.01.2019 12:30
Yes, I always backup before upgrading SQX.


I will make a fresh install of 116, copy across the User folder (overwrite all), then let the auto update take it to 117 - that way I will also get new configurations in 117. Not a completely 'clean' installation, but semi-clean. Lets see how it goes.

g
#8

geektrader

11.01.2019 08:21
Voted for this task.
MF
#9

Mark Fric

18.02.2019 14:10

Status changed from Waiting for information to Fixed


Votes: +1

Drop files to upload

or

choose files

Max size: 5MB

Not allowed: exe, msi, application, reg, php, js, htaccess, htpasswd, gitignore

...
Wait please