CSE-745 – Parallel and High Performance Computing
Instructor: Dr. Sergey Mashchenko
Course outline: HTML
- December 16 is the deadline for your Course Project.
- Starting from Lecture 3, you can start bringing your laptop to class, to participate in hands on activities.
- If you are not a SHARCNET user, please apply for an account. See the instructions here . (If your supervisot doesn't have a SHARCNET account, please ask him/her to apply first.) You will need the SHARCNET account to do practical assignments and course project.
- Home assignments and projects are best to run on orca development nodes (if orca is offline, you can use development nodes on saw; as saw has only 8 cores per node, your speedup should be slightly less than 8). You have to
- Login to orca: "ssh orca.sharcnet.ca"
- Login to one of the four development nodes, orc-dev1, orc-dev2, orc-dev3, or orc-dev4, e.g. "ssh orc-dev4".
- For accurate timings of your code, make sure the node is not busy: run the "top" command, and check the top lines - if one or more CPUs are actively used (utilization >50%), logout, and login to another development node, until you find the one which is empty.
- You should run the code a few times and choose the best timing.
- Instructions for accessing SHARCNET clusters by Windows users:
- Download and install a free Windows program Mobaxterm (Personal Edition).
- In the main (black) window, type "ssh email@example.com" to login to our cluster orca, where user_name is your SHARCNET user name. Don't save your password in mobaxterm (it will ask for it), as it will use a very insecure Windows way of storing passwords.
- After you login to a cluster, in the left window you can access the remote file system browser.
- Mobaxterm has a pretty decent built-in text editor, which can be used to edit remote files (simply double-click on a file name). To create a new remote file, click on the button "Create new file" on top of the file browser window.
- In the same spot, the buttons "Download selected files" and "Upload to current folder" can be used to copy data from the cluster to you machine, and vice versa.
notes (in PDF format):
- Sep. 9, Lecture 1 (notes): Introduction to HPC computing
- Sep. 16, Lecture 2 (notes): Introduction to HPC computing (continued)
- Sep. 23, Quiz 1 and Lecture 3 (notes): OpenMP (Overview; Getting started; Constructs: parallel regions)
- Sep. 30, Lecture 4 (notes): OpenMP (Worksharing constructs: loop, sections, single)
- Oct. 7, Lecture 5, Home assignment #1 (OpenMP) given; (notes): OpenMP (Data environment; Synchronization)
- Oct. 14, Lecture 6 (notes): OpenMP (cont. synchronization; runtime functions)
- Oct. 21, Lecture 7, Home assignment #1 (OpenMP) due (notes): OpenMP (last OpenMP lecture: Pitfalls, Case Studies)
- Oct. 28, Lecture 8, Quiz 2 (OpenMP), Home assignment #2 (OpenMP) given; (notes): MPI (Introduction; Understanding communications)
- Nov. 4, Lecture 9, (notes): MPI (Collective Communications, Communicators, Topologies)
- Nov. 11, Lecture 10, Home assignment #2 (OpenMP) due, Home assignment #3 (MPI) given (notes): MPI (cont. Topologies, Grouping Data for Communication, Design and Coding of Parallel Programs)
- Nov. 18, Lecture 11 (notes): MPI (last MPI lecture; cont. Design and Coding of Parallel Programs, Designing Parallel Algorithms, Parallel Libraries)
- Nov. 25, Lecture 12, Quiz 3 (MPI), Home assignment #3 (MPI) due; Tutorial on parallel debugging and profiling.
- Dec. 16, Course project is due (MPI).
read PDF files on this page you will need the free Acrobat PDF Reader.