COMP7305A - Cluster and cloud computing

Semester 2, 2020-21

Instructor
Professor C.L. Wang
Teaching assistants
Mr. Guoxuan Chen
Miss Xueyu Wu
Syllabus This course offers an overview of current cloud technologies, and discusses various issues in the design and implementation of cloud systems. Topics include cloud delivery models (SaaS, PaaS, and IaaS) with motivating examples from Google, Amazon, and Microsoft; virtualization techniques implemented in Xen, KVM, VMWare, and Docker; distributed file systems, such as Hadoop file system; MapReduce and Spark programming models for large-scale data analysis, networking techniques in cluster and hyper-scale data centers. The students will learn the use of Amazon EC2 to deploy applications on cloud, and implement a SPARK application on a Xen-enabled PC cluster as part of their term project.
Introduction by Instructor

This course provides an introduction into the technologies behind cloud computing. A combination of lectures and hands-on programming assignment and term project expose the student to the leading cloud computing paradigms (e.g., Amazon EC2, Hadoop MapReduce, Spark). The lecture part will provide an overview of the underlying clustering technologies that make cloud computing possible (e.g., cluster networking, virtual machines). The students will complete a simple assignment using Amazon EC2 individually and a term project with a group of 4 students. In the term project, the students will build a private Cloud on a PC cluster with 4 Linux machines and participate in the design, assembling, configuring, and benchmarking of the private cloud system. The software stack will include Linux, Xen, Ganglia, Hadoop, and Spark. Each group is required to turn in a project report and give a project presentation and a live demo at the end of the semester.

Special Note: The maximum class size is limited to 90 students due to the limited number of PCs in our lab.

Learning Outcomes
Course Learning Outcomes Relevant Programme Learning Outcome
CLO1. Able to master the key technologies about the Cluster and Cloud Computing, and be able to contrast similar technologies. PLO.4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16
CLO2. Able to self-learn the latest Cloud Computing technologies and build their own Cloud system on a PC cluster. PLO.3, 6, 7, 8, 9, 10, 11, 12
View Programme Learning Outcomes
Pre-requisites The students are expected to install various open-source cloud software in their Linux cluster, and exercise the system configuration and administration. Basic understanding of Linux operating system and some programming experiences (C/C++, Java, or Python) in a Linux environment are required.
Compatibility Students who have taken " ICOM6041 An introduction to cloud computing" should not be allowed to take COMP7305.
Topics covered
Course Content No. of Hours Course Learning Outcomes
1. Introduction of Cloud Computing 3 CLO1
2. Cloud Service Models: SaaS, PaaS, and IaaS 3 CLO1
3. Using Public Cloud Amazon EC2 (workshop) 3 CLO1 & COL2
4. MapReduce and Hadoop File System 3 CLO1
5. Xen, Hadoop, and Spark Installation (workshop) 3 CLO1 & COL2
6. Virtualization Techniques (Xen, VMWare, KVM, Docker, Kubernetes) 6 CLO1
7. Apache Spark 3 CLO1
8. Cluster Networking (ARP, VLAN/VXLAN, NAT) 3 CLO1
9. Data Center Networking and SDN 3 CLO1
 
Assessment
Description Type Weighting * Examination Period ^ Course Learning Outcomes
Port a simple Java/Python application on a public Cloud (Amazon EC2) Continuous Assessment 15% - CLO2
Build a real Cloud system using Xen (or Kubernetes) and Apache Hadoop on a PC cluster, develop applications using Spark programming model. Continuous Assessment 35% - CLO2
Written exam covers all taught content in the course.
Written Examination 50% May 10 to 29, 2021 CLO1
* The weighting of coursework and examination marks is subject to approval
^ The exact examination date uses to be released when all enrolments are confirmed after add/drop period by the Examinations Office.  Students must oblige to the examination schedule. Students should NOT enrol in the course if they are not certain that they will be in Hong Kong during the examination period.  Absent from examination may result in failure in the course. There is no supplementary examination for all MSc curriculums in the Faculty of Engineering.
Course materials Recommended readings:
  • Available from the course webpage
Session dates
Date Time Venue Remark
Session 1 18 Jan 2021 (Mon) 7:00pm - 10:00pm MW-T2 Hybrid
Session 2 25 Jan 2021 (Mon) 7:00pm - 10:00pm MW-T2 Hybrid
Session 3 1 Feb 2021 (Mon) 7:00pm - 10:00pm MW-T2 Hybrid
Session 4 8 Feb 2021 (Mon) 7:00pm - 10:00pm MW-T2 Hybrid
Session 5 22 Feb 2021 (Mon) 7:00pm - 10:00pm MW-T2 Hybrid
Session 6 1 Mar 2021 (Mon) 7:00pm - 10:00pm MW-T2 Hybrid
Session 7 15 Mar 2021 (Mon) 7:00pm - 10:00pm Online Online Zoom only
Session 8 22 Mar 2021 (Mon) 7:00pm - 10:00pm MW-T2 Hybrid
Session 9 29 Mar 2021 (Mon) 7:00pm - 10:00pm MW-T2 Hybrid
Session 10 12 Apr 2021 (Mon) 7:00pm - 10:00pm MW-T2 Hybrid
MW - Meng Wah Complex
Add/drop 18 January, 2021 - 1 February, 2021
Quota 70   [For MSc(CompSc) students]
20   [For MDASC students]
Back