Multiple Small Under Table Directory

[util1 table_2_108]$ ls -ltrh
total 202G
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:35 1.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:35 2.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:35 3.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:35 4.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:35 5.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:35 6.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:35 7.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:35 8.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:35 9.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:35 10.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:35 11.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:35 12.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:35 13.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 14.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 15.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 16.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 17.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 18.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 19.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 20.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 21.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 22.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 23.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 24.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 25.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 26.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 27.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 28.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 29.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 30.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 31.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 32.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 33.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 34.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 35.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 36.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 37.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 38.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 39.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 40.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 41.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 42.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 43.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 44.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 45.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 46.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 47.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 48.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 49.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 50.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 51.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 52.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 53.4096.mapd
-rw-r–r-- 1 omnisci omnisci 16M Mar 29 01:36 54.4096.mapd

We are using Importer to use Load Data.

This utilized 202GB space, however when i created a Table as select * command, new Table created with Table size 2GB

Hi @Sumit,

As I wrote about your performance problems, It seems that inserting small batches of records (I used copy command) is going to create a huge amount of Metadata files (the 16mb).

The ctas command is likely to create the table with just an epoch, so the huge diffefence