The most significant new feature in Apache Hive 2, to be included in the upcoming HDP 2.5 release is a technical preview of LLAP (Live Long and Process). LLAP enables as fast as sub-second SQL analytics on Hadoop by intelligently caching data in memory with persistent servers that instantly process SQL queries. Since LLAP is an evolution of the Hive architecture it does all this with the same comprehensive ANSI standard SQL support and proven scale that Hive has long been known for.
LLAP Key Benefits
- LLAP enables as fast as sub-second query in Hive by keeping all data and servers running and in-memory all the time, while retaining the ability to scale elastically within a YARN cluster.
- LLAP, along with Apache Ranger enables fine-grained security for the Hadoop ecosystem, including data masking and filtering, by providing interfaces for external clients like Spark to read.
- LLAP is great for cloud because it caches data in memory and keeps it compressed, overcoming long cloud storage access times and stretching the amount of data you can fit in RAM.
Even better, you can try the LLAP technical preview for yourself in the HDP 2.5 Technical Preview Sandbox, get started here http://hortonworks.com/tech-preview-hdp-2-5/