Wang Distributed Machine Learning with Python

Accelerating model training and serving with distributed systems
1. Auflage 2022
ISBN: 978-1-80181-721-9
Verlag: De Gruyter
Format: EPUB
Kopierschutz: 0 - No protection

E-Book, Englisch, 284 Seiten

No detailed description available for "Distributed Machine Learning with Python".

Autoren/Hrsg.

Wang, Guanhua

Fachgebiete

• Mathematik | Informatik EDV | Informatik Informatik Künstliche Intelligenz Spracherkennung, Sprachverarbeitung
• Mathematik | Informatik EDV | Informatik Informatik Mensch-Maschine-Interaktion Informationsarchitektur
• Mathematik | Informatik EDV | Informatik Daten / Datenbanken Data Warehouse
• Mathematik | Informatik EDV | Informatik Daten / Datenbanken Datenbankdesign & Datenbanktheorie

Inhaltsverzeichnis

Table of Contents - Splitting Input Data

- Parameter Server and All-Reduce
- Building a Data Parallel Training and Serving Pipeline
- Bottlenecks and Solutions
- Splitting the Model
- Pipeline Input and Layer Split
- Implementing Model Parallel Training and Serving Workflows
- Achieving Higher Throughput and Lower Latency
- A Hybrid of Data and Model Parallelism
- Federated Learning and Edge Devices
- Elastic Model Training and Serving
- Advanced Techniques for Further Speed-Ups

Über Autor(innen)

Wang Guanhua:

Guanhua Wang is a final-year Computer Science PhD student in the RISELab at UC Berkeley, advised by Professor Ion Stoica. His research lies primarily in the Machine Learning Systems area including fast collective communication, efficient in-parallel model training and real-time model serving. His research gained lots of attention from both academia and industry. He was invited to give talks to top-tier universities (MIT, Stanford, CMU, Princeton) and big tech companies (Facebook/Meta, Microsoft). He received his master's degree from HKUST and bachelor's degree from Southeast University in China. He also did some cool research on wireless networks. He likes playing soccer and runs half-marathon multiple times in the Bay Area of California.