Overview: A caching system management used in SparkSQL/Apache Spark and HDFS Requirements: SparkSQL, ApacheSpark, HDFS, Data caching algorithm and English skills. Motivation: We are now using the HDFS to store and manage the data. And we do also the data analytics using SparkSQL in Apache Spark. Normally, the Application Driver of Apache Spark will load […]
Archive for the ‘Data analytic, Programming’ Category
Semantic Caching Demo on SparkSQL and HDFS
February 24th, 2020 
Posted in Data analytic, Programming, Graduate 
Comments Off on Semantic Caching Demo on SparkSQL and HDFS