<- Back to Tasks

Compressed data files

Can you keep data files compressed as XZ, bzip2 or GZ? This should speed up reading by reduced disk I/O time. Also, backups etc will be quicker. As data is read more often than it is written. Best to be read efficient with fast-reduced I/O and reduced storage.


XZ provides best compression and supports random access file also https://tukaani.org/xz/xz-javadoc/org/tukaani/xz/SeekableXZInputStream.html



Attachments
No attachments
  • Votes +5
  • Project StrategyQuant X
  • Type Feature
  • Status New
  • Priority Normal

History

E
#1

Emmanuel

15.01.2023 10:10
Voted for this task.
HF
#2

Vence_Jo

27.08.2023 15:10
Voted for this task.
Wv
#3

eNeRGy Burns

28.08.2023 22:45
Voted for this task.
Wv
#4

eNeRGy Burns

28.08.2023 22:47
I always see just one CPU core used for file access in SQX. The backup when closing SQX is always very slow. Don't know if this feature will make this better. Or what bottleneck or limitation that is about? But every improvement made here is welcome.
RF
#5

rafael.munhoz@live.com

08.11.2023 00:55
Voted for this task.
Votes: +5

Drop files to upload

or

choose files

Max size: 5MB

Not allowed: exe, msi, application, reg, php, js, htaccess, htpasswd, gitignore

...
Wait please