Deep Learning at Scale

Synopsis

Bringing a deep-learning project into production at scale is quite challenging. To successfully scale your project, a foundational understanding of full stack deep learning, including the knowledge that lies at the intersection of hardware, software, data, and algorithms, is required.This book illustrates complex concepts of full stack deep learning and reinforces them through hands-on exercises to arm you with tools and techniques to scale your project. A scaling effort is only beneficial when it's effective and efficient. To that end, this guide explains the intricate concepts and techniques that will help you scale effectively and efficiently.You'll gain a thorough understanding of:How data flows through the deep-learning network and the role the computation graphs play in building your modelHow accelerated computing speeds up your training and how best you can utilize the resources at your disposalHow to train your model using distributed training paradigms, i.e., data, model, and pipeline parallelismHow to leverage PyTorch ecosystems in conjunction with NVIDIA libraries and Triton to scale your model trainingDebugging, monitoring, and investigating the undesirable bottlenecks that slow down your model trainingHow to expedite the training lifecycle and streamline your feedback loop to iterate model developmentA set of data tricks and techniques and how to apply them to scale your training modelHow to select the right tools and techniques for your deep-learning projectOptions for managing the compute infrastructure when running at scale

Copyright:

2024

Book Details

Book Quality:

Publisher Quality

ISBN-13:

9781098145248

Related ISBNs:

9781098145286, 9781098145255

Publisher:

O'Reilly Media

Date of Addition:

06/18/24

Copyrighted By:

Suneeta Mall.

Adult content:

No

Language:

English

Has Image Descriptions:

No

Categories:

Nonfiction, Computers and Internet

Submitted By:

Bookshare Staff

Usage Restrictions:

This is a copyrighted book.