I have a folder of generated strategies loaded to sqx in 2 different databanks. Then did SPP retest on both databanks (which basically have the same list of strategies). But the retest gave inconsistent results everytime. Attached is a screenshot of different results shown I did with SPP retest. (Results to BTC SPP 2 ; BTC to BTC SPP)
Status changed from New to Waiting for information
I don't see what setting and filtering you use.
I don't think this is a bug - depending on your configuration the optimization is probably genetic, and the exact result it is dependent on randomly generated first generation. So every optimization run could be different.
It is possible that you optimize by too many parameters (have too many total combinations) or have too little Max optimizations steps configured - in both cases it searches very big parameter space with limited total number of optimizations.
Attachment 3.png added
In my tests the number of strategies that pass SPP is different, and it is because of the reasons I explained - too little maximum optimization steps compared to number of possible configuration.
Unfortunately your strategy didn't contain the SPP setting you used, so I still don't know the exact configuration of your retests.
Can you attach the configs of your Retest tasks?
Status changed from Waiting for information to Refused
When I use your config repeatedly I small differences every pass - sometimes 22, sometimes 24 strategies out of 120 pass.
But this is normal, there is no bug.
The max number of optimization steps is limited to 1000, so it doesn't do brute force optimization with all the possible outcomes, but only a selection based on genetics. It will be slightly different for every run.
If you'll increase max optimization steps to 2000 or 5000 you should see smaller and smaller variation in the results.
In my opinion 5000 optimizations is enough to make it reliable.
Right now, I am running on B130. And that is what I get, just a small margin of difference. But not when I used B131 before, a big number gap is the difference. I wont be able to reproduce the error now because I am still running on B130. But I hope you reconsider this error since other users have also shared that they do have problems with SPP retest on B131.