Orc not faster than csv in Hive? Orc not faster than csv in Hive? hadoop hadoop

Orc not faster than csv in Hive?


As per my experience ORC is faster. Using ORC File for every HIVE table should extremely beneficial to get fast response times for your HIVE queries. I think you have to enable the vectorization, Vectorized query execution improves performance of operations like scans, aggregations, filters and joins, by performing them in batches of 1024 rows at once instead of single row each time.

set hive.vectorized.execution.enabled = true;    set hive.vectorized.execution.reduce.enabled = true;  

there are many ways to improve the hive performance like Tez execution, cost based query optimization(CBO) etc.