Distributed computing with Python harness the power of multiple computers using Python through this fast-paced informative guide
Harness the power of multiple computers using Python through this fast-paced informative guide About This Book You'll learn to write data processing programs in Python that are highly available, reliable, and fault tolerant Make use of Amazon Web Services along with Python to establish a powerf...
| Otros Autores: | |
|---|---|
| Formato: | Libro electrónico |
| Idioma: | Inglés |
| Publicado: |
Birmingham :
Packt Publishing
2016.
|
| Edición: | 1st edition |
| Colección: | Community experience distilled.
|
| Materias: | |
| Ver en Biblioteca Universitat Ramon Llull: | https://discovery.url.edu/permalink/34CSUC_URL/1im36ta/alma991009630177106719 |
Tabla de Contenidos:
- Cover; Copyright; Credits; About the Author; About the Reviewer; www.PacktPub.com; Table of Contents; Preface; Chapter 1: An Introduction to Parallel and Distributed Computing; Parallel computing; Distributed computing; Shared memory versus distributed memory; Amdahl's law; The mixed paradigm; Summary; Chapter 2: Asynchronous Programming; Coroutines; An asynchronous example; Summary; Chapter 3: Parallelism in Python; Multiple threads; Multiple processes; Multiprocess queues; Closing thoughts; Summary; Chapter 4: Distributed Applications - with Celery; Establishing a multimachine environment
- Installing CeleryTesting the installation; A tour of Celery; More complex Celery applications; Celery in production; Celery alternatives - Python-RQ; Celery alternatives - Pyro; Summary; Chapter 5: Python in the Cloud; Cloud computing and AWS; Creating an AWS account; Creating an EC2 instance; Storing data in Amazon S3; Amazon elastic beanstalk; Creating a private cloud; Summary; Chapter 6: Python on an HPC Cluster; Your typical HPC cluster; Job schedulers; Running a Python job using HTCondor; Running a Python job using PBS; Debugging; Summary
- Chapter 7: Testing and Debugging Distributed ApplicationsThe big picture; Common problems - clocks and time; Common problems - software environments; Common problems - permissions and environments; Common problems - the availability of hardware resources; Challenges - the development environment; A useful strategy - logging everything; A useful strategy - simulating components; Summary; Chapter 8: The Road Ahead; The first two chapters; The tools; The cloud and the HPC world; Debugging and monitoring; Where to go next; Index
