Using Hive to Optimize Query Executions with Partitioning

Continue to explore the versatility of Apache Hive among today’s most popular data warehouses in this 10-video Skillsoft Aspire course. Learners are shown ways to optimize query executions including the powerful technique of partitioning data sets. The hands-on course assumes previous work with Hive tables using the Hive query language and in processing complex data types along with theoretical understanding of improving query performance by partitioning very large data sets. Demonstrations focus on basics of partitioning and how to create partitions and load data into them. Learners work with both Hive-managed tables and external tables to see how partitioning works for each; then watch navigating to the shell of the Hadoop master node and creating new directories in the Hadoop file system. Observe dynamic partitioning of tables and how this simplifies loading of data into partitions. Finally you explore how using multiple columns in a table can partition data within it. During this course learners will acquire a sound understanding of how exactly large data sets can be partitioned into smaller chunks improving query performance.