cancel
Showing results for 
Search instead for 
Did you mean: 

Can't read splayed tables bigger than 38 GB

A_L_V_
New Contributor
Have folder structure: C:/dir/2014.01.01/exampleTable C:/dir/2014.01.01/sym ... do \cd dir/2014.01.01 exampleTable:get:`exampleTable If folder less than 38 GB typing exapleTable or a more specific query will work, else get +.... error. Is there a way to further splay / partition the table to reduce size?
3 REPLIES 3

charlie
New Contributor II
New Contributor II
>C:/dir/2014.01.01/exampleTable
>C:/dir/2014.01.01/sym

is unusual; you should have just the one sym file at the root
C:/dir/sym

or you'll run into other problems later.

And rather than loading tables in the same way as several emails ago, just use

\l c:/dir

and then query using

select … from exampleTable where date=2014.01.01

You can have partitions split into segments -

http://code.kx.com/wiki/JB:KdbplusForMortals/segments

For 32bit, you need to get each table in each partition to less than ~500MB.

A_L_V_
New Contributor
Thank you. There seems to be no imediately obvious way we can segment it to 500 mb. A single instrument on a single day may have more data than that 😞

A_L_V_
New Contributor
* immediate