Endangered species can be difficult to study, as they are elusive, and the very act of observing them can disrupt their lives. Now, scientists can take a closer look at endangered species by studying AI-generated 3D representations of them. Sifei Liu, a senior research scientist at NVIDIA, has worked with her team to create an algorithm that can reconstruct 3D meshes — graphics models used to display the edges, vertices and overall shape of an object — from 2D inputs like images and videos. Liu spoke with NVIDIA AI Podcast host Noah Kravitz about her team’s project, called Online Adaptation for Consistent Mesh Reconstruction in the Wild. Liu and her team have presented the project at various prominent conferences, including NeurIPS 2020.

Machines have long played games - think of Deep Blue or AlphaGo. Now they're building them. GANTheftAuto creator Harrison Kinsley talks about his creation on the latest episode of the AI Podcast. https://blogs.nvidia.com/blog/2021/09/08/gantheftauto/

At GE Renewable Energy, CTO Danielle Merfeld and technical leader Arvind Rangarajan are among those making advances throughout renewable energy. Merfeld and Rangarajan spoke with NVIDIA AI Podcast host Noah Kravitz about how the company uses AI and a human-in-the-loop process to make renewable energy more widespread. The International Energy Agency has set a goal to reach a net zero energy sector by 2050. To reach this goal, 88 percent of electricity needs to come from renewable sources. Wind energy will account for 40 percent of that, but today only makes up 8 percent of renewable energy. https://blogs.nvidia.com/blog/2021/08/25/ge-ai-energy/

Path-breaking work that translates an amputee’s thoughts into finger motions, and even commands in video games, holds open the possibility of humans controlling just about anything digital with their minds. Using GPUs, a group of researchers trained an AI neural decoder able to run on a compact, power-efficient NVIDIA Jetson Nano system on module (SOM) to translate 46-year-old Shawn Findley’s thoughts into individual finger motions. And if that breakthrough weren’t enough, the team then plugged Findley into a PC running Far Cry 5 and Raiden IV, where he had his game avatar move, jump — even fly a virtual helicopter — using his mind. It’s a demonstration that not only promises to give amputees more natural and responsive control over their prosthetics. It could one day give users almost superhuman capabilities. The effort is detailed in a draft paper, or pre-print, titled “A Portable, Self-Contained Neuroprosthetic Hand with Deep Learning-Based Finger Control.” It details an extraordinary cross-disciplinary collaboration behind a system that, in effect, allows humans to control just about anything digital with thoughts. Jules Anh Tuan Nguyen, the paper’s lead author and now a postdoctoral researcher at the University of Minnesota, spoke with NVIDIA AI Podcast host Noah Kravitz about his efforts to allow amputees to control their prosthetic limb — right down to the finger motions — with their minds. blogs.nvidia.com/blog/2021/08/10/lending-a-helping-hand-jules-anh-tuan-nguyen-on-building-a-neuroprosthetic

Following a long string of victories for computers in other games — chess in 1997, go in 2016 and Texas hold’em poker in 2019 — a GPU-powered AI has beaten some of the world’s most competitive word nerds at the crossword puzzles that are a staple of every Sunday paper. Dr.Fill, the crossword puzzle-playing AI created by Matt Ginsberg — a serial entrepreneur, pioneering AI researcher and former research professor — scored higher than any humans earlier this year at the American Crossword Puzzle Tournament. Ginsberg spoke with NVIDIA AI Podcast host Noah Kravitz about his decade-long journey creating Dr.Fill and where he envisions it going in the future. https://blogs.nvidia.com/blog/2021/07/28/matt-ginsberg-ai-podcast/

Robots are not just limited to the assembly line. At NVIDIA, Liila Torabi works on making the next generation of robotics possible. Torabi is the senior product manager for Isaac Sim, a robotics and AI simulation platform powered by NVIDIA Omniverse. Torabi spoke with NVIDIA AI Podcast host Noah Kravitz about the new era of robotics, one driven by making robots smarter through AI. https://blogs.nvidia.com/blog/2021/07/14/liila-isaac-sim/

We all know about the applications for digital humans for films and video games, but at NVIDIA, Simon Yuen has discovered the vast need and potential for digital humans beyond the entertainment industry. Yuen spoke with NVIDIA AI Podcast host Noah Kravitz about how we’re getting to a point where the simulation of digital humans is possible as opposed to just the visual representation. Yuen leads the Digital Human project at NVIDIA. One of the first products the team is developing is Audio2Face, an AI-based solution that automates high-quality facial animation in real-time, based only on audio as input. https://blogs.nvidia.com/blog/2021/06/28/simon-audio2face/

What do radiology and wastewater have in common? Hopefully, not much. But at startup Opseyes, founder Bryan Arndt and data scientist Robin Schlenga are putting the AI that’s revolutionizing medical imaging to work on analyzing wastewater samples. Arndt and Schlenga spoke with NVIDIA AI Podcast host Noah Kravitz about the inspiration for Opseyes, which began with Arndt’s career at wastewater industry leader Ramboll. Effluent has typically been analyzed by sending tightly sealed samples through the mail to experts. While speaking with his brother, a radiologist using deep learning, Arndt realized that AI could do something similar for wastewater samples. Schlenga then led the creation of Opseyes’ convolutional neural network, which allows customers to upload a photo of a sample taken through a microscope. With Opseyes already in use at several wastewater plants, Arndt and Schlenga anticipate much more bacterial analysis in their future. https://blogs.nvidia.com/blog/2021/06/16/ai-opseyes-wastewater-analysis/

3D deep learning holds the potential to accelerate progress in everything from robotics to medical imaging. But until now, researchers haven’t had the right tools to easily manage and visualize different types of 3D data. NVIDIA Kaolin is a collection of tools within the NVIDIA Omniverse simulation and collaboration platform that allows researchers to visualize and generate datasets, move between 3D tools and retain basic functions for other users. NVIDIA AI Podcast host Noah Kravitz spoke with four NVIDIANs about their work on the platform, including Richard Kerris, industry general manager for Omniverse; Jean-Francois Lafleche, a deep learning engineer; Senior Research Scientist Masha Shugrina; and Research Scientist Clement Fuji Tsang. Kaolin includes both a library, which contains a growing number of GPU-optimized operations, and an app within NVIDIA Omniverse for interactive 3D data visualizations. The long-term goal is to make both facets so robust that users could import a photo that generates a highly developed 3D model without spending time on recreating the scene within a 3D platform. https://blogs.nvidia.com/blog/2021/06/02/kaolin-podcast/

For a particle physicist, the world’s biggest questions — how did the universe originate and what’s beyond it — can only be answered with help from the world’s smallest building blocks. James Kahn, a consultant with German research platform Helmholtz AI and a collaborator on the global Belle II particle physics experiment, uses deep learning to understand the fundamental rules governing particle decay. Kahn spoke with AI Podcast host Noah Kravitz about the specifics of how AI is accelerating particle physics. He also touched on his work at Helmholtz AI. Khan helps researchers in fields spanning medicine to earth sciences apply AI to the problems they’re solving. His wide-ranging career — from particle physicist to computer scientist — shows how AI accelerates every industry. https://blogs.nvidia.com/blog/2021/05/19/ai-particle-physics/