Parallel Programming (Parallel and Distributed Computing (2022)) (SE, HPC)

Type: Normative

Department: system design




SemesterAmount of hoursLecturerGroup(s)
432Associate Professor Shuvar R. Y.ФеП-21

Laboratory works

SemesterAmount of hoursGroupTeacher(s)

Опис навчальної дисципліни

As a result of taking this course, the student will:


the basic principles underlying parallel and distributed computing, the concepts of modern programming modern approaches to the organization of distributed computing, the architecture of distributed computing systems and the peculiarities of organizing distributed information processing. Have skills in creating and debugging parallel and distributed programs. Have methods and tools of software for parallel and distributed computer systems;

be able to:

apply knowledge to solve applied problems, namely to manage and implement the interaction of processes, model parallel computing, create and debug parallel and distributed programs, build parallel algorithms, create programs using many processes (threads). Implement synchronous or asynchronous variants of parallel processes using MPI / OpenMP / CUDA libraries, using standard tools of the C programming language.

Recommended Literature

V. Yu. Algorithmic languages and basics of programming: language C. Textbook – Zhytomyr: ZHYTOMYR STATE TECHNICAL UNIVERSITY, 2007. 328 p.
2) Rolshchikov V.B.. Technologies of distributed systems and parallel computing. Lecture notes. Odesa: ODEKU 2016. 155 p.
3) Chandra, R., Dagum, L., Kohr, D., Maydan, D., McDonald, J., and Melon, R. (2000). Parallel Programming in OpenMP. San Francisco, CA: Morgan Kaufmann Publishers.
4) OpenMP Common Core: Making OpenMP Simple Again – Tim Mattson, Helen He, Alice Koniges (2019).
5) William Gropp Ewing Lusk, Anthony Skjellum. Using MPI, third edition: Portable Parallel Programming with the Message-Passing Interface (Scientific and Engineering Computation) Paperback – November 7, 2014
6) Petrenko A. I. Workshop on grid technologies: a textbook / A. I. Petrenko, S. Y. Svistunov, G. D. Kiselev – K. : NTUU “KPI”, 2011. 580 p.
7) Edward Kandrot. CUDA by Example: An Introduction to General-Purpose GPU Programming. Michigan, April 2012.
8) Ruud van der Pas, Eric Stotzer and Christian Terboven. Using OpenMP – The Next Step, 2017.
9) Semerenko, V. P. Technologies of parallel computing: a textbook / Semerenko V. P. – Vinnytsia: VNTU, 2018. – 104 p.
10) Barbara Chapman, Gabriele Jost, Ruud van der Pas. Using OpenMP: portable shared memory parallel programming (Scientific and Engineering Computation). Cambridge, Massachusetts: The MIT Press, 2008. – 353 pp.
11) HTCondor Version 10.2.1 Manual. Available at:



Завантажити силабус