B130,467 Futures And Sesssion

This weekend i have tried in all possible ways to get the Ultimate Data for futures to work and had no luck, After awile i figure out that the issue has to do with sessions. If you take for example @ES.D and make a session starting from 08:30 and end 15:15 SQX seems to make the session run from 09:00 to 15:15 and make every h1 bar close at even Hours which makes the reults not matching in Tradestation.



here us a session starting from 08:30 to 15:15 but it starts somehow 09:00 instead, This goes for all futures so in the end nothing seems to get same result in Tradestation/SQX please make proper test to this cause atm then only thing working for me is to export data from Tradestation to SQX which is alot of work. And sad part is that i need to export data for all time frames so @ es needs to be exported M5, M30 H1 H4 and so on Really is a nightmare.






Attachments
image-0.png
(76.50 KiB)
  • Votes +1
  • Project StrategyQuant X
  • Type Bug
  • Status Fixed
  • Priority Urgent

History

EN
#1

Pliskenss

03.04.2021 16:35

Task created

EN
#2

Pliskenss

06.04.2021 19:56
Voted for this task.
TB
#3

Tomas Brynda

07.04.2021 10:00

Status changed from New to Fixed

Hi Pliskenss,

Tradestation doesn't have H1 timeframe, it has M60 instead.

If you set M60 timeframe in retester, the bar times should match in both platforms.

Also check if your symbol in SQ is set to be an end of bar type.


Best regards,

Tomas

EN
#4

Pliskenss

07.04.2021 10:28

Attachment image-0.png added

Attachment image-1.png added

image-0.png
(229.54 KiB)
image-1.png
(117.51 KiB)
Dosent work 


look at this from a startegy in builder im using your data from ultimate @cc


Black is tradestation  for example 2009-02-09 entry in Tradestation 09:45 and in Sqx same trade entry at 11:00 and results are completly different have to do with time?, Both are set to M60 

EN
#5

Pliskenss

07.04.2021 10:31

Attachment image-0.png added

image-0.png
(70.52 KiB)
if i open Sqx and do a view analyze on the data provided for the symbol that comes with DAta Manager and set it to H1 its completly wrong compared to Tradestation

exchange starts at 06:45 in tradestation and the next abr closes at 07:45 08:45 and so on


EN
#6

Pliskenss

07.04.2021 10:32
Same goes for all futures not open at even hours, Prove me wrong:)?
TB
#7

Tomas Brynda

07.04.2021 10:40

Status changed from Fixed to Waiting for information

Ok, please attach your backtested strategy (.sqx file) and I will check that
EN
#8

Pliskenss

07.04.2021 10:47

Attachment Strategy 14120.sqx added

Strategy 14120.sqx
(45.46 KiB)
TB
#9

Tomas Brynda

07.04.2021 11:21

Status changed from Waiting for information to Fixed

Attachment results.png added

Attachment tradingOptions.png added

tradingOptions.png
(79.31 KiB)
results.png
(146.12 KiB)
Thank you for your quick feedback.

I went through your last settings from the strategy and I noticed that you don't have any session set in Trading Options settings.

If I define the right session in Data Manager and select it in Trading Options, I get the right bar times - see the attached screenshots.

If you use NoSession, the bars are calculated like for 24/7 forex where the bars start every day at 00:00.


Best regards,

Tomas

EN
#10

Pliskenss

07.04.2021 11:35

Attachment image-0.png added

Attachment image-1.png added

image-1.png
(197.50 KiB)
image-0.png
(111.09 KiB)
Now the times are there but still dosent match results


look at trades taken black is 

EN
#11

Pliskenss

07.04.2021 11:36

Attachment image-0.png added

image-0.png
(73.37 KiB)
And there is still now way to compare the data in DataManager set H1 and with session for CC its still wrong


EN
#12

Pliskenss

07.04.2021 11:37

Attachment image-0.png added

image-0.png
(27.81 KiB)
this is the session set



EN
#13

Pliskenss

07.04.2021 11:44

Attachment image-0.png added

Attachment image-1.png added

image-0.png
(9.24 KiB)
image-1.png
(91.53 KiB)
I think it takes the wrong closing bars when testing thats the reason why the result is so different, 


Sqx test with result i mean 0.11 different in Profitfactor and almost 20 000 in profit , And i have other results that is 50% different from tradestation an i belive it has to do with closing time of bars

TB
#14

Tomas Brynda

07.04.2021 17:14

Status changed from Fixed to In progress

TB
#15

Tomas Brynda

08.04.2021 09:22

Status changed from In progress to Waiting for information

The result differences are probably caused by some incorrect settings.

Can you attach your study and instrument configs?

EN
#16

Pliskenss

08.04.2021 09:40

Attachment Strategy 11175.sqx added

Attachment Build.cfx added

Attachment Test CL.mht added

Attachment Strategy 11175.pdf added

Test CL.mht
(2.26 MiB)
Strategy 11175.pdf
(188.68 KiB)
Strategy 11175.sqx
(41.09 KiB)
Build.cfx
(31.19 KiB)
Alright this test i fresh from this morning on CL 60 min, All test that i export tradestation data to SQX and test with works but not the data that is with the program. anyway this is the test and im using your default future config, The indicator settings im not sure what to send but i never touch them.


But just say what you want and i give it


Also sending report from tradestation and result in SQX


TB
#17

Tomas Brynda

08.04.2021 09:59
Ok thank you for the info.


The thing is various brokers use various rollover methods and thus the data can be slightly different during the rollover periods.

From our experience, it is a good practise to develop strategies on our data (as it is a quality data and also it is a simplest option) and then during filtering process retest the strategies using data exported from your trading platform.

It is a kind of a robustness test. Strategies that work good on both data are the best candidates to run live on an account.


Sometimes you will find strategies that have very different results. Those are probably sensitive to data and overfitted.


If the strategy gives matching results using data exported from Tradestation I suppose there's no bug on our side.


EN
#18

Pliskenss

08.04.2021 10:17

Attachment image-0.png added

Attachment image-1.png added

image-0.png
(60.43 KiB)
image-1.png
(70.68 KiB)
Well for me i cant use this data its to bad compared to Tradestation, I mean i cant have results in SQX that differ so much cause i then have to recheck in tradestaion on every startegy, SO i guess i have to export in the future, Still find it strange that when using session and use view analyze data with correct session that the candles dont close at right time?


Getting same issue when using 1min exchange data from tradestation aswell so that cant be used Either, So i have to Export the correct timeframe for every Futures , But if there nothing to do i have to keep going with that.


Think i need to look at a god RPA that exports and takes in data from tradestation, Cause if im going to import end export M5 - Daily its prob days of work everytime 


But thanks or what do i say :)


Bummer


TB
#19

Tomas Brynda

08.04.2021 10:27
It should be completely fine to just export M1 data from TS and import it into SQ.

SQ will compute any higher timeframes automatically. I think the problem is that DataManager has only a few predefined timeframes when viewing data and it doesn't include M60, only H1 which is computed differently.

H1 rounds to whole hours, but M60 leaves the minutes as it is and computes hourly intervals from the beginning time.

EN
#20

Pliskenss

08.04.2021 10:39

Attachment Strategy 24103.pdf added

Attachment CC 60Min.mht added

Strategy 24103.pdf
(246.67 KiB)
CC 60Min.mht
(3.28 MiB)

Dosent work either spent hours on this aswell this is reults from tradestation and SQX


Using 1min data from tradestation



TB
#21

Tomas Brynda

10.05.2021 08:34

Status changed from Waiting for information to Fixed

From the pdf I can tell you have not used the right settings during backtest. 

The candle times are different. SQ order times are full hours so it seems like you either haven't set a session in Trading Options or used invalid one.


Please make sure:

  1. Your data is set to be end of bar time in Data Manager
  2. You use Tradestation / Multicharts engine in Data settings
  3. You have the right session set in Trading Options

Votes: +1

Drop files to upload

or

choose files

Max size: 5MB

Not allowed: exe, msi, application, reg, php, js, htaccess, htpasswd, gitignore

...
Wait please