Scribd
Upload
159 views

Parallel

The document outlines the objectives and units of a course on parallel computing. The objective is to understand parallel programming models, challenges, and how to program heterogeneous systems using MPI, OpenMP, CUDA and OpenCL. The units cover fundamentals of parallel computing, challenges of parallel programming, shared memory programming with OpenMP, MPI programming, and programming heterogeneous processors with CUDA and OpenCL. The course aims to provide knowledge of parallel computing models and techniques, and skills in MPI and heterogeneous programming.

Uploaded by

Shanntha Joshitta
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
159 views

Parallel

The document outlines the objectives and units of a course on parallel computing. The objective is to understand parallel programming models, challenges, and how to program heterogeneous systems using MPI, OpenMP, CUDA and OpenCL. The units cover fundamentals of parallel computing, challenges of parallel programming, shared memory programming with OpenMP, MPI programming, and programming heterogeneous processors with CUDA and OpenCL. The course aims to provide knowledge of parallel computing models and techniques, and skills in MPI and heterogeneous programming.

Uploaded by

Shanntha Joshitta
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 4

SUB : PARALLEL COMPUTING SUB CODE :

OBJECTIVE
To identify the scope for parallelism in a program, understand the various parallel programming
models and the challenges involved in parallel programming, learn the basics of MPI and
programming with them, and the programming of heterogeneous systems using CUDA and
OpenCL

UNIT I
FUNDAMENTALS OF PARALLEL COMPUTING :
Need for Parallel Computing – Parallel Computer Models – ILP, TLP and Data Parallelism
– Parallel Programming Overview – Processes, Tasks and Threads – Parallel Programming
Models – Shared Memory Programming – Message Passing Paradigm – Interaction and
Communication – Interconnection Networks.

UNIT II
CHALLENGES OF PARALLEL PROGRAMMING :
Identifying Potential Parallelism – Techniques for Parallelizing Programs – Issues – Cache
Coherence issues – Memory Consistency Models – Maintaining Memory Consistency –
Synchronization Issues – Performance Considerations.

UNIT III
SHARED MEMORY MODELS AND OPENMP PROGRAMMING :
OpenMP Execution Model – Memory Model and Consistency – Open MP Directives – Run
Time Library Routines – Handling Data and Functional Parallelism – Performance
Considerations.

UNIT IV
MPI PROGRAMMING :
The MPI Programming Model – MPI Basics – Circuit Satisfiability – Global Operations
– Asynchronous Communication – Collective Communication – Other MPI Features –
Performance Issues – Combining OpenMP and MPI.

UNIT V
PROGRAMMING HETEROGENEOUS PROCESSORS :
GPU Architecture – Basics of CUDA – CUDA Threads – CUDA Memories – Synchronization
Handling – Performance Issues – Application Development. Introduction to OpenCL.
TEXT BOOKS:

1. John L. Hennessey and David A. Patterson, “Computer Architecture – A quantitative


approach”, Morgan Kaufmann / Elsevier Publishers, 5th. Edition, 2012.

2. Peter S. Pacheco, “An Introduction to Parallel Programming”, Morgan Kaufmann, 2011.

3. Michael J Quinn, “Parallel programming in C with MPI and OpenMP”, Tata McGraw Hill,
2003.

4. David B. Kirk and Wen-mei W. Hwu, “Programming Massively Parallel Processors”,


Morgan Kaufmann, 2010.

REFERENCES:
1. Ananth Grama, George Karypis, Vipin Kumar and Anshul Gupta, “Introduction to Parallel
Computing”, Second Edition, Pearson Education Limited, 2003.

2. Shameem Akhter and Jason Roberts, “Multi-core Programming”, Intel Press, 2006.

3. Ian Foster, “Designing and Building Parallel Programs: Concepts and Tools for Parallel
Software Engineering”, Addison Wesley Longman Publishing Co., USA, 1995.

4. David E. Culler, Jaswinder Pal Singh, “Parallel Computing Architecture: A hardware/


Software approach” , Morgan Kaufmann / Elsevier Publishers, 1999.

5. OpenMP Programmer’s Manual.

6. MPI Programmer’s Manual


CO1 Acquire the basic knowledge of parallel computing and its classification
CO2 Ability to understand the techniques for parallelizing programs
CO3 Understand the various models
CO4 Acquire the knowledge of MPI programming
CO5 Create applications using threads and memories

You might also like