Authors: Ashkan Yousefpour, Davide Testuggine, Alex Sablayrolles, and Ilya Mironov

Introduction

In our previous blog post, we went over the basics of the DP-SGD algorithm and introduced Opacus, a PyTorch library for training ML models with differential privacy. In this blog post, we explain how performance-improving vectorized computation is done in Opacus and why Opacus can compute “per-sample gradients” a lot faster than “microbatching” (read on to see what all these terms mean!)

Context

Recall that differential privacy is all about worst-case guarantees, which means we need to check the gradient of each and every sample in a batch of data.

Conceptually…


Author: Michael Fitzke

Creating a better world for pets like Idly who belongs to the family of one of PyTorch’s original developers.

1 in 4 dogs, and 1 in 5 cats, will develop cancer at some point in their lives. Pets today have a better chance of being successfully treated than ever, thanks to advances in early recognition, diagnosis and treatment.

AI and Cancer

“This is one of the biggest challenges in veterinary pathology. Do you think you can solve it?” Pathologists Dr. Edwards and Dr. Whitley asked in our first meeting. It was December 2018, and our team, Next Generation Technologies, had been founded that year to solve some of the most complex challenges at Mars through technology…


Author: Team PyTorch

The Applied ML Summit is a half-day digital event kicking off on June 10th, bringing together professional data scientists, ML engineers and researchers from across the globe.

The event promises to provide interactive technical tutorials to support building, deploying and managing models with Vertex AI, as well as insights from innovators including Francois Chollet of Google and Tony Jabara of Spotify, and panels with Uber, L’Oreal, WPP and more. The content has been designed to help you build MLOps frameworks, sharpen your skillset and grow your career.

See below the sessions focused on PyTorch. …


Authors: John Trenkle, Jaya Kawale and the Tubi ML Team

Understanding the nuanced relationships between movies, TV shows, viewers, actors, genres is like trying to understand a complex tapestry of fractals — — it’s tricky, but there is structure there. (Illustration 118225042 © Keilaneokow | Dreamstime.com)

In this blog series, we aim to highlight the nuances of Machine Learning in Tubi’s Ad-based Video on Demand (AVOD) space as practiced at Tubi. Machine Learning helps solve myriad problems involving recommendations, content understanding and ads. We extensively use PyTorch for several of these use cases as it provides us the flexibility, computational speed and ease of implementation to train large-scale deep neural networks using GPUs.

Who is Tubi and what do we do?

With 33 million active monthly users and over 2.5 billion hours of content watched last year, Tubi is one of the leading platforms…


Author: Team PyTorch

The first PyTorch Ecosystem Day, a virtual event designed for the PyTorch ecosystem and industry communities to showcase their work and discover new opportunities to collaborate, kicks off next week on Wednesday, April 21st Pacific Time. Attendees have the opportunity to engage in discussions on new developments, trends, challenges, and best practices with PyTorch through poster sessions, keynotes, and a unique networking opportunity hosted through Gather.Town.

Ahead of the event, our team sat down with a few of the speakers to learn more about their work on PyTorch, trends they are seeing in the ever-growing community, and…


NVIDIA GTC 2021 is a week-long event that shares breakthroughs in AI, data center, accelerated computing, healthcare, gaming technology, and more. This year, GTC 2021 is hosting over 50 different sessions related to PyTorch.

See below for the list of sessions that mention or include PyTorch. You can register for the event for free and view the full listing of the session catalogue. Make sure you are logged in and the links below will take you directly to the relevant session.

PyTorch-based Sessions

  1. PyTorch Performance Tuning Guide [S31831]
  2. Profiling PyTorch Models for NVIDIA GPUs [S31644]
  3. Dynamic Shapes First: Advanced GPU Fusion in…


Authored by Cassie Breviu, Microsoft Cloud Developer Advocate

We have collaborated with PyTorch and the PyTorch community to create a new tutorial to help new and experienced machine learning practitioners get started with PyTorch. We are excited to announce the new machine learning tutorial that is now available! We love contributing to open source and this collaboration was a blast! Let’s take a look at the journey that got us here and learn a bit more about the tutorial that was created.

First let’s talk about our “Learn the Basics” tutorial co-authored with PyTorch that aims to help both…


Glow is a compiler that interfaces to the PyTorch machine learning framework.

The recent addition of Glow compiler support within NXP’s eIQ™ machine learning (ML) software development platform has been well received by the ML development community. Glow, which is a compiler that interfaces to the PyTorch machine learning framework. The Glow ML compiler is designed to help developers optimize neural network graphs and generate code for target hardware devices such as low-power MCUs. The generated code can then be integrated into a high-level framework such as an NXP MCUXpresso Software Development Kit (SDK) project.

Last fall we explored how developers can use Glow for inferencing neural network models on low-power NXP…


We’re proud to announce our first PyTorch Ecosystem Day. The virtual, one-day event will focus completely on our Ecosystem and Industry PyTorch communities!

PyTorch is a deep learning framework of choice for academics and companies, all thanks to its rich ecosystem of tools and strong community. As with our developers, our ecosystem partners play a pivotal role in the development and growth of the community.

We will be hosting our first PyTorch Ecosystem Day, a virtual event designed for our ecosystem and industry communities to showcase their work and discover new opportunities to collaborate.

PyTorch Ecosystem Day will be held…


Authors: John Trenkle, Jaya Kawale and the Tubi ML Team

This abstract work evokes complex networks, genomics and reels of film simultaneously (source: “Snacce” by jez.atkinson is licensed under CC BY 2.0)

In this blog series, our aim is to highlight the nuances of Machine Learning in Tubi’s Ad-based Video on Demand (AVOD) space as practiced at Tubi. Machine Learning helps solve myriad problems involving recommendations, content understanding and ads. We extensively use PyTorch for several of these use cases as it provides us the flexibility, computational speed and ease of implementation to train large scale deep neural networks using GPUs.

Who is Tubi and what do we do?

With 33 million active monthly users and over 2.5 billion hours of content watched last year, Tubi is one of the…

PyTorch

PyTorch is an open source machine learning platform that provides a seamless path from research prototyping to production deployment.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store