Parallel Programming with Python

Book Description

Develop efficient parallel systems using the robust Python environment

Overview

• Demonstrates the concepts of Python parallel programming
• Boosts your Python computing capabilities
• Contains easy-to-understand explanations and plenty of examples

In Detail

Starting with the basics of parallel programming, you will proceed to learn about how to build parallel algorithms and their implementation. You will then gain the expertise to evaluate problem domains, identify if a particular problem can be parallelized, and how to use the Threading and Multiprocessor modules in Python.

The Python Parallel (PP) module, which is another mechanism for parallel programming, is covered in depth to help you optimize the usage of PP. You will also delve into using Celery to perform distributed tasks efficiently and easily. Furthermore, you will learn about asynchronous I/O using the asyncio module. Finally, by the end of this book you will acquire an in-depth understanding about what the Python language has to offer in terms of built-in and external modules for an effective implementation of Parallel Programming.

This is a definitive guide that will teach you everything you need to know to develop and maintain high-performance parallel computing systems using the feature-rich Python.

What you will learn from this book

• Explore techniques to parallelize problems
• Integrate the Parallel Python module to implement Python code
• Execute parallel solutions on simple problems
• Achieve communication between processes using Pipe and Queue
• Use Celery Distributed Task Queue
• Implement asynchronous I/O using the Python asyncio module
• Create thread-safe structures

Approach

A fast, easy-to-follow and clear tutorial to help you develop Parallel computing systems using Python. Along with explaining the fundamentals, the book will also introduce you to slightly advanced concepts and will help you in implementing these techniques in the real world.

Who this book is written for

If you are an experienced Python programmer and are willing to utilize the available computing resources by parallelizing applications in a simple way, then this book is for you. You are required to have a basic knowledge of Python development to get the most of this book.

Table of Contents

Chapter 1: Contextualizing Parallel, Concurrent, and Distributed Programming
Chapter 2: Designing Parallel Algorithms
Chapter 3: Identifying a Parallelizable Problem
Chapter 4: Using the threading and concurrent.futures Modules
Chapter 5: Using Multiprocessing and ProcessPoolExecutor
Chapter 6: Utilizing Parallel Python
Chapter 7: Distributing Tasks with Celery
Chapter 8: Doing Things Asynchronously

中文：

书名：Parallel Programming with Python

使用健壮的Python环境开发高效的并行系统

Overview

• Demonstrates the concepts of Python parallel programming
• 提升您的Python计算能力
• 包含简单易懂的说明和大量的示例

In Detail

从并行编程的基础开始，您将继续学习如何构建并行算法及其实现。然后，您将获得评估问题域、确定特定问题是否可以并行化以及如何使用Python中的线程和多处理器模块的专业知识。

Python并行(PP)模块是另一种并行编程机制，本文深入介绍了它，以帮助您优化PP的使用。您还将深入研究如何使用芹菜高效、轻松地执行分布式任务。此外，您还将了解使用asyncio模块的异步I/O。最后，在本书结束时，您将深入了解在有效实现并行编程的内置和外部模块方面，Python语言必须提供什么。

这是一本权威指南，将教您使用功能丰富的Python开发和维护高性能并行计算系统所需了解的所有知识。

你将从这本书中学到什么

• 探索问题并行化的技术
• 集成并行Python模块以实现Python代码
• Execute parallel solutions on simple problems
• Achieve communication between processes using Pipe and Queue
• 使用芹菜分布式任务队列
• Implement asynchronous I/O using the Python asyncio module
• 创建线程安全的结构

Approach

这是一篇快速、易懂、清晰的教程，帮助您使用Python开发并行计算系统。除了解释基本原理外，本书还将向您介绍略微高级的概念，并将帮助您在现实世界中实施这些技术。

这本书是为谁写的

如果您是一名经验丰富的Python程序员，并且愿意通过以简单的方式并行化应用程序来利用可用的计算资源，那么这本书就是为您准备的。您需要具备基本的Python开发知识，才能更好地阅读本书。

目录表

第1章：并行、并发和分布式编程的上下文
第2章：设计并行算法
Chapter 3: Identifying a Parallelizable Problem
第4章：使用线程和并发。期货模块
Chapter 5: Using Multiprocessing and ProcessPoolExecutor
Chapter 6: Utilizing Parallel Python
第7章：用芹菜分配任务
第8章：异步处理