parallel programming on clusters

Oct 8, 2010 at 12:59pm
Hi all

I am a Ph.D student of Physics and recently a cluster of 32 nodes has been installed in my department. Since I am a senior and do a lot of programming in C++ (as I make mathematical models for Complex Systems), therefore I have been asked to learn parallel programming and learn to use the cluster and in turn, teach my junior fellows.
Parallel programing is worth learning

Can somebody PLEASE direct me to some good programs(codes) in C++, which can teach me ::

1) how to make parallel programs (as I will first learn to run them on a dual-processor computer)

2) and how to run them on clusters.


Regards
Alice
Oct 8, 2010 at 1:52pm
someone I know might have said:
Alice, you can do parallel programming in C++ only in Wonderland...

Anyway, look up MPI and OpenMP.
Oct 8, 2010 at 2:27pm
closed account (z05DSL3A)
You may find the following book useful:
The Art of Concurrency: A Thread Monkey's Guide to Writing Parallel Applications
by Clay Breshears
Description wrote:
If you're looking to take full advantage of multi-core processors with concurrent programming, this practical book provides the knowledge and hands-on experience you need. "The Art of Concurrency" is one of the few resources to focus on implementing algorithms in the shared-memory model of multi-core processors, rather than just theoretical models or distributed-memory architectures. The book provides detailed explanations and usable samples to help you transform algorithms from serial to parallel code, along with advice and analysis for avoiding mistakes that programmers typically make when first attempting these computations. Written by an Intel engineer with over two decades of parallel and concurrent programming experience, this book will help you: understand parallelism and concurrency; explore differences between programming for shared-memory and distributed-memory; learn guidelines for designing multithreaded applications, including testing and tuning; discover how to make best use of different threading libraries, including Windows threads, POSIX threads, OpenMP, and Intel Threading Building Blocks; and, explore how to implement concurrent algorithms that involve sorting, searching, graphs, and other practical computations. "The Art of Concurrency" shows you how to keep algorithms scalable to take advantage of new processors with even more cores. For developing parallel code algorithms for concurrent programming, this book is a must.
Topic archived. No new replies allowed.