COMP7305B - Cluster and cloud computing

Summer Semester, 2018-19

Instructor
Professor C.L. Wang
Teaching assistants
Mr. Junjie Wang
Ms. Zhaorui Zhang
Syllabus This course offers an overview of current cluster and cloud technologies, and discusses various issues in the design and implementation of cluster and cloud systems. Topics include cluster architecture, cluster middleware, and virtualization techniques (e.g., Xen, KVM) used in modern data centers. We will discuss three types of Cloud computing platforms, including SaaS, PaaS, and IaaS, by providing motivating examples from companies such as Google, Amazon, and Microsoft; and introduce Hadoop MapReduce and Spark programming paradigms for large-scale data analysis.
Introduction by Instructor

This course provides an introduction into the technologies behind cloud computing. A combination of lectures and hands-on programming assignment and term project expose the student to the leading cloud computing paradigms (e.g., Amazon EC2, Hadoop MapReduce, Spark). The lecture part will provide an overview of the underlying clustering technologies that make cloud computing possible (e.g., cluster networking, virtual machines). The students will complete a simple assignment using Amazon EC2 individually and a term project performed in groups of 3-4 students. In the term project, the students will build a private Cloud on a PC cluster with at least 3 machines and participate in the design, assembling, configuring, and benchmarking of the private cloud system. The software stack will include Linux, Xen, Ganglia, Hadoop, and Spark. Each group is required to turn in a project report and give a project presentation and a live demo at the end of the semester.

Special Note: This class is mainly for MDASC students. The quota for MSc(CompSc) student is limited to 10.
Learning Outcomes
Course Learning Outcomes Relevant Programme Learning Outcome
CLO1. Able to master the key technologies about the Cluster and Cloud Computing, and be able to contrast similar technologies. PLO.4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16
CLO2. Able to self-learn the latest Cloud Computing technologies and build their own Cloud system on a PC cluster. PLO.3, 6, 7, 8, 9, 10, 11, 12
View Programme Learning Outcomes
Pre-requisites The students are expected to exercise the systems configuration and administration under a Linux cluster. Basic understanding of Linux operating system and some experiences in system level programming (C/C++ or Java) are required.
Compatibility Students who have taken " ICOM6041 An introduction to cloud computing" should not be allowed to take COMP7305.
Topics covered
Course Content No. of Hours Course Learning Outcomes
1. Introduction of Cloud Computing 3 CLO1
2. Cloud Service Models: SaaS, PaaS, and IaaS 3 CLO1
3. Using Public Cloud Amazon EC2 (workshop) 3 CLO1 & COL2
4. MapReduce and Hadoop File System 3 CLO1
5. Xen, Hadoop, and Spark Installation (workshop) 3 CLO1 & COL2
6. Virtualization Techniques (Xen, VMWare, KVM, LXC) 3 CLO1
7. Apache Spark 3 CLO1
8. Cluster Networking (ARP, VLAN/VXLAN, NAT) 3 CLO1
9. Data Center Networking in Facebook and Google 3 CLO1
10. Software Defined Network (SDN) 3 CLO1
 
Assessment
Description Type Weighting * Examination Period ^ Course Learning Outcomes
Port a simple Java application on a public Cloud (Amazon EC2) Continuous Assessment 10% - CLO2
Build a real Cloud system using Xen and Hadoop Yarn on a PC cluster and develop applications using MapReduce or Spark programming model. Continuous Assessment 40% - CLO2
Written exam covers all taught content in the course.
 Written Examination 50% August 12 to 17, 2019 CLO1
* The weighting of coursework and examination marks is subject to approval
^ The exact examination date uses to be released when all enrolments are confirmed after add/drop period by the Examinations Office.  Students must oblige to the examination schedule. Students should NOT enrol in the course if they are not certain that they will be in Hong Kong during the examination period.  Absent from examination may result in failure in the course. There is no supplementary examination for all MSc curriculums in the Faculty of Engineering.
Course materials Recommended readings:
  • Available from the course webpage
Session dates
Date Time Venue Remark
Session 1 12 Jun 2019 (Wed) 7:00pm - 10:00pm CB-C  
Session 2 17 Jun 2019 (Mon) 7:00pm - 10:00pm CB-A  
Session 3 19 Jun 2019 (Wed) 7:00pm - 10:00pm CB-C  
Session 4 24 Jun 2019 (Mon) 7:00pm - 10:00pm CB-A  
Session 5 26 Jun 2019 (Wed) 7:00pm - 10:00pm CB-C  
Session 6 3 Jul 2019 (Wed) 7:00pm - 10:00pm CB-C  
Session 7 8 Jul 2019 (Mon) 7:00pm - 10:00pm CB-A  
Session 8 10 Jul 2019 (Wed) 7:00pm - 10:00pm CB-C  
Session 9 15 Jul 2019 (Mon) 7:00pm - 10:00pm CB-A  
Session 10 18 Jul 2019 (Thu) 7:00pm - 10:00pm CB-A  
CB - Chow Yei Ching Building
Add/drop 10 June, 2019 - 17 June, 2019
Quota 10   [For MSc(CompSc) & other Engineering TPG students]
Moodle course website
  • HKU Moodle: http://moodle.hku.hk/course/view.php?id=66091 (Login using your HKU Portal UID and PIN)

    - Please note that the instructor maintains and controls when to release the Moodle teaching website to students.
    - Enrolled students should visit the Moodle teaching website regularly for latest announcements, course materials, assignment submission, discussion forum, etc.
Back