NVIDIA GTC 2021 is a week-long event that shares breakthroughs in AI, data center, accelerated computing, healthcare, gaming technology, and more. This year, GTC 2021 is hosting over 50 different sessions related to PyTorch.

See below for the list of sessions that mention or include PyTorch. You can register for the event for free and view the full listing of the session catalogue. Make sure you are logged in and the links below will take you directly to the relevant session.

PyTorch-based Sessions

1. PyTorch Performance Tuning Guide [S31831]
2. Profiling PyTorch Models for NVIDIA GPUs [S31644]
3. Dynamic Shapes First: Advanced GPU Fusion in…

Authored by Cassie Breviu, Microsoft Cloud Developer Advocate

We have collaborated with PyTorch and the PyTorch community to create a new tutorial to help new and experienced machine learning practitioners get started with PyTorch. We are excited to announce the new machine learning tutorial that is now available! We love contributing to open source and this collaboration was a blast! Let’s take a look at the journey that got us here and learn a bit more about the tutorial that was created.

First let’s talk about our “Learn the Basics” tutorial co-authored with PyTorch that aims to help both…

The recent addition of Glow compiler support within NXP’s eIQ™ machine learning (ML) software development platform has been well received by the ML development community. Glow, which is a compiler that interfaces to the PyTorch machine learning framework. The Glow ML compiler is designed to help developers optimize neural network graphs and generate code for target hardware devices such as low-power MCUs. The generated code can then be integrated into a high-level framework such as an NXP MCUXpresso Software Development Kit (SDK) project.

Last fall we explored how developers can use Glow for inferencing neural network models on low-power NXP…

We’re proud to announce our first PyTorch Ecosystem Day. The virtual, one-day event will focus completely on our Ecosystem and Industry PyTorch communities!

PyTorch is a deep learning framework of choice for academics and companies, all thanks to its rich ecosystem of tools and strong community. As with our developers, our ecosystem partners play a pivotal role in the development and growth of the community.

We will be hosting our first PyTorch Ecosystem Day, a virtual event designed for our ecosystem and industry communities to showcase their work and discover new opportunities to collaborate.

PyTorch Ecosystem Day will be held…

Authors: John Trenkle, Jaya Kawale and the Tubi ML Team

In this blog series, our aim is to highlight the nuances of Machine Learning in Tubi’s Ad-based Video on Demand (AVOD) space as practiced at Tubi. Machine Learning helps solve myriad problems involving recommendations, content understanding and ads. We extensively use PyTorch for several of these use cases as it provides us the flexibility, computational speed and ease of implementation to train large scale deep neural networks using GPUs.

Who is Tubi and what do we do?

With 33 million active monthly users and over 2.5 billion hours of content watched last year, Tubi is one of the…

Authors: David Novotny, Roman Shapovalov, Nikhila Ravi, Shubham Goel, Georgia Gkioxari, Justin Johnson, Jeremy Reizenstein, Patrick Labatut, Wan-Yen Lo

Intro

PyTorch3D is a highly modular and optimized library with unique capabilities designed to facilitate 3D deep learning with PyTorch. PyTorch3D provides a set of frequently used 3D operators and loss functions for 3D data that are fast and differentiable, as well as a modular differentiable rendering API. Researchers can use these features in deep learning systems right away. (For a primer on PyTorch3D and differentiable rendering have a look at our tutorial at the PyTorch hackathon).

Implicit Shape Rendering

Today…

Authors: Michael Galarnyk, Richard Liaw, and Robert Nishihara

Machine learning today requires distributed computing. Whether you’re training networks, tuning hyperparameters, serving models, or processing data, machine learning is computationally intensive and can be prohibitively slow without access to a cluster. Ray is a popular framework for distributed Python that can be paired with PyTorch to rapidly scale machine learning applications.

This post covers various elements of the Ray ecosystem and how it can be used with PyTorch!

What is Ray

Authors: Sridharan, Srinivas; Tsai, Louie; Kalamkar, Dhiraj D; Shiryaev, Mikhail; Durnov, Dmitry

Introduction

The modern deep learning models are growing at an exponential rate, and those latest models could grow their parameters from million to billions. To train those modern models within hours, distributed training is a better option for those big models.

In this article, we distributed the DLRM model by using PyTorch with different backends, and shed light on the performance benefit of oneCCL backend.

Intel® oneAPI Collective Communications Library

The Intel® oneAPI Collective Communications Library (oneCCL) enables developers and researchers to more quickly train newer and deeper models. …