NVIDIA AI Podcast · 2025-07-23

NVIDIA's Mike Pritchard on AI-Driven Climate Simulation

Hosts: Noah Kravitz

Guests: Mike Pritchard

climate simulationweather forecastingAI emulatorsNVIDIA Earth2generative AIsuper-resolutionhybrid physics-AI modelsdigital twinsocean emulationextreme weathertropical cyclonesmachine learning benchmarkscounterfactual ensembles

Why it matters

Resolution in climate models refers to the spatial mesh (e.

Key claims

  • AI has shifted climate modeling from hybrid physics-AI systems (20x-100x speedups) to fully AI atmospheric emulators that now produce the most skillful weather forecasts in the world
  • Resolution in climate models refers to the spatial mesh (e.g., ~25 km grid cells) used to numerically solve physics equations, with finer resolution revealing sub-grid processes like clouds and storms
  • NVIDIA's CorrDiff (also referenced as 'Cordash') performs multivariate super-resolution and synthesizes new channels like radar reflectivity from blurry climate data
  • Climate in a Bottle research enables interactive, queryable climate generation: users pass in low-dimensional inputs (time of year, ocean warmth, cyclone seed map) and receive ~600 MB of state estimates, with cyclone steering trained alongside the generator

Episode summary

Summary

In episode 266 of the NVIDIA AI Podcast, host Noah Kravitz speaks with Mike Pritchard, Director of Climate Simulation Research at NVIDIA, about how AI is transforming climate science and weather forecasting. Pritchard explains the distinction between weather prediction (days, initialized from observations) and climate prediction (decades, statistics of weather) and notes that traditional physics-based climate simulators struggle with resolution and the compute cost of running hundreds of multi-decade scenarios. He frames AI as a way to "short-circuit Moore's law," first through hybrid physics-AI models (20x-100x speedups) and now through fully AI atmospheric emulators that he describes as the most skillful weather forecasting systems available today.

Pritchard details NVIDIA's work under the Earth2 initiative, including a tool called CorrDiff for multivariate super-resolution and new channel synthesis, and a research project called "Climate in a Bottle" that lets users query a generative model for specific weather events (e.g., tropical cyclones) using low-dimensional inputs like ocean temperature. He highlights that AI enables huge ensembles of counterfactual climate scenarios—running thousands of summers' worth of extremes to study rare events—capabilities he says are beyond traditional physical simulators. He also flags the emergence of ocean emulators and coupled atmosphere-ocean AI models as the next frontier, drawing a parallel to the 1980s when coupled physics models first enabled El Niño prediction.

Looking ahead, Pritchard emphasizes sustained Earth observations as critical infrastructure for ML, points listeners to NVIDIA Earth2's open-source recipes, and calls for both policy engagement and ML researcher participation in unsolved climate benchmarks. He expresses optimism that interactive, queryable AI climate models will broaden public understanding of a warming planet whose committed warming from existing CO2 is already locked in for roughly a century.

  • AI has shifted climate modeling from hybrid physics-AI systems (20x-100x speedups) to fully AI atmospheric emulators that now produce the most skillful weather forecasts in the world
  • Resolution in climate models refers to the spatial mesh (e.g., ~25 km grid cells) used to numerically solve physics equations, with finer resolution revealing sub-grid processes like clouds and storms
  • NVIDIA's CorrDiff (also referenced as 'Cordash') performs multivariate super-resolution and synthesizes new channels like radar reflectivity from blurry climate data
  • Climate in a Bottle research enables interactive, queryable climate generation: users pass in low-dimensional inputs (time of year, ocean warmth, cyclone seed map) and receive ~600 MB of state estimates, with cyclone steering trained alongside the generator
  • AI enables massive counterfactual ensembles—e.g., 28,000 simulated summers equivalent to summer 2023—to build sample sizes for studying rare heat extremes
  • Coupled atmosphere-ocean AI emulators are emerging now, paralleling the 1980s development of coupled physics models that first enabled El Niño and seasonal forecasting
  • Pritchard identifies sustained Earth observation systems and unsolved ML benchmarks as key areas needing public and researcher support
  • The committed warming from existing atmospheric CO2 (~100-year residence time) makes climate adaptation a present necessity, not just a future concern

Source material

Transcript

[Music] Hello, and welcome to the NVIDIA AI Podcast.

I'm your host, Noah Kravitz.

Artificial intelligence is powering a new generation of physically accurate models and simulations that are changing the way research and planning are done.

In the past few months, we've explored industrial simulation on the podcast, talking about how companies like Siemens are designing and optimizing factories with the help of AI and technologies including digital twins.

Today, we're exploring one of the most fascinating and arguably important uses of AI for simulation, climate simulation.

Mike Pritchard, Director of Climate Simulation Research at NVIDIA, is here to talk about the role of AI in climate science and how AI-driven climate modeling is helping us to understand, predict, and prepare for extreme weather and climate change.

Mike, welcome, and thank you so much for joining the AI Podcast.

Thanks so much, Noah.

It's great to meet you.

So maybe we can start by having you share a little bit about your own journey and how you got into working on climate science.

Sure, well, it was a little windy road for me.

You know, I came out of high school and I'm not sure if I wanted to study jazz music or chemistry, and I landed in an astrophysics program and learned about the cosmos and had my first summer job doing astrophysics research.

I realized I don't really care about how two galaxies are going to collide in 15 billion years.

I had enough to work on it all summer.

And I took a year off traveling in Africa, my undergrad.

I ended up visiting Bangladesh and met all these amazing people living so close to sea level rise and thought back to this course I'd taken on radiative transfer in planetary atmospheres and realized there's this physics problem that really matters to the world.

And sort of having a look back since, you know, I did a master's try a couple of ice sheet simulator to a climate simulator into San Diego to do a PhD studying the daily cycle of rainfall and how we can simulate rainfall systems and climate models better and eventually realized there's a computer problem here.

We just don't, we know the equations we'd like to solve, the computers aren't up for it.

So any algorithm that could help me get more explicit cloud physics for more realistic storm simulations into computer models became interesting.

And during the 2017 AI became the best and most interesting algorithm to do that.

Right.

Yeah.

All right.

I have to go back and ask before we continue talking about climate science.

Are you a musician?

Do you play?

I play super casually.

My jazz chops have dwindled, but there's a lovely sunset gig I play in San Diego with someone who loves me play not too many chords and improvise.

So yeah, I love music and communicating.

What's your instrument?

That's our keyboards.

Keyboards.

Great.

I'm a drummer.

We'll have to get together sometime.

Oh, right on.

Yeah.

All right.

But climate science, maybe you can give kind of a brief overview of what it means when we talk about climate science.

We're going to get into the details, but maybe you can kind of give that overview and then talk about how the technologies and along with it, your perspective on climate science has evolved over the years.

Okay.

Yeah.

Caught me short if I knew it out too much, but yeah, we're all familiar with weather prediction, right?

Climate prediction is sort of similar, but weather prediction is a little different.

You know, weather is sort of like how the next few days that are unfold while the atmosphere still has memory of its initial conditions, which I've observed and I can initialize the simulator to predict.

Climate simulations are solving very similar equations, but we're talking about not the weather or not how things are going to unfold tomorrow, the next day, but the climate, the average of the weather, the statistics of the weather.

And those are predictable on different time scales for different reasons.

So, you know, here in San Diego, I know that, you know, may is going to be warmer than January because there's more energy coming into the planet.

There's more solar energy, watts per square meter.

So you add energy to a system, it heats up.

Same with, you know, future climate change.

You add a bunch of triatomic molecules to the atmosphere.

They tend to back long wave radiation, like little heat lamps in the sky and more energy, the system heats up.

But the trillion dollar question is how much will heat up?

Because all these hazards scale with the overall warmth of the planet is like a fever.

And that has a lot to do with very complicated processes of can't simulate well, you know, like clouds, things we don't really have questions for.

Will they dissipate like ice sheets do, revealing darker surfaces and amplifying the warming?

Or will they sticking up and brighten the planet, reflecting watts as the planet warms?

And so yeah, the business of simulating the future climate just brings supercomputers to their knees because not only do we have to cover the whole planet with resolution and simulate 100 years, we have to do that dozens of times for different what if scenarios and hundreds of times to sample the different possible chaotic outcomes.

And so I almost feel like it's a bit like learning jazz, actually, it's like a never ending enterprise, you'll never be done.

And there's always a complex system that's unsatisfyingly imperfectly represented in the simulators that deserves your work.

I fix it on clouds, because I think they're, they're mission critical, you know.

So you mentioned I think you said around 2017 is when AI kind of started to become the tool of choice for simulations and working on client signs problems.

Can you get in a little bit to how AI is transforming the way that we simulate the way we understand how climate works on Earth?

Yeah, thanks.

Yeah.

So for one thing, it's a way to short circuit Moore's law and to bring resolution into simulators ahead of computational schedule.

So if you can take really complicated cloud physics that you can simulate for pretty convincingly for a small patch of atmosphere for a few week interval, you just can't scale it up to hundreds of years on the whole planet.

You can focus AI on that and try to learn, learn the physics, outsource of physics, say, you know, dense linear algebra, digital sheets of neurons.

And once trained, those can be blazing fast.

And so that's where my interest began in 20, so I did a still a bit of a niche enterprise back then.

But the idea can we build multi steel simulators that have very extensively simulated regions of high resolution that we can then wrap AI around and learn the multi steel relationships that predict to correct the relationships.

So I had this wonderful experience in 2018, where that worked better than I thought it should.

And it bought me 20x to 100x faster simulations.

And it totally changed my view of how much resolution and complexity we can afford to simulate today.

Fast forward five years, and the whole world is different.

Now, we're not talking about hybrid physics, AI simulations, we're talking about full A's AI simulators of the atmosphere.

And with that comes a whole new set of disruptions that include huge ensembles for counterfactuals of weather that are normally very hard to generate with regular physics calculations, and dimensions of interactivity, I've never dreamed of before, ways to have interactive climate samplers that democratize the business of looking at climate predictions, ways to paint resolution onto low resolution blurry predictions.

And so I feel like AI is now disrupting things across the system modeling stack.

Mike, when you talk about resolution in climate modeling, what does that mean?

Is that the ability to predict in a more precise timeframe?

Is it just getting better predictions of what's going to happen?

What does resolution mean in this context?

Yeah, great question.

Yeah.

So at the end of the day, predicting the climate using physics equations means writing those equations and then dividing the world up into a mesh to actually solve the equations numerically.

And how high resolution that meshes depends on how much computing power we have, and how long we need to simulate the system.

So we need to simulate the system for 100 years, hundreds of times, and therefore the mesh is not as fine as we would like, because the computers are always so powerful.

So a typical government prediction of 50 years from now, the individual variables that are predicted are on scales of like counties and states, 25 kilometers aside.

You go out and look at satellite observations of regions of the atmosphere that are that large, you'll see all this interior complexity from beautiful processes that form clouds and storms.

Those are fundamentally not represented in explicitly in standard simulations of climate.

So that's why resolution matters.

It means that some human has had to come up with some cartoon model based on their notions of how that subgroup complexity works when all we're resolving is the county scale stuff.

You kind of mentioned the advance in compute power and simulations just now, but can you talk about some of the breakthroughs that you've been involved with with different teams you've worked at over the years when it comes to using machine learning, using AI to accelerate these simulations?

Yeah, I'll mention a few threads of work.

So one is where I began as a university professor, this hybrid physics AI simulation.

It's really difficult to impart infrastructions of an AI's fit to a physical simulation.

Once you embed 10,000 copies of that AI emulator inside of a planetary model that's based on physics, all the interactions between the AI subunits and the planetary fluid dynamics solver can lead you out of sample in ways that make the hybrid system difficult to control.

So one research accomplishment I'm really proud of is a benchmarking activity we did at NeurIPS a couple years ago to democratize this problem, steal it to lots of machine learners, work with the NSF Science and Technology Center in Columbia and some NVIDIA people to make really nice code and APIs that people could compete around, and a category competition around that, and eventually figured out some strategies to get this kind of really brittle physics AI simulator to work.

But then I think it's coming to NVIDIA and experience a new type of person that trains very ambitious machine learning models that are so large they can cover the entire planet.

There's no more physics anymore.

There's no physics solver.

It's just AI.

It's like video prediction predicting the next frame instead of three channels of color like red, green, and blue that are mostly correlated, but a dozen channels of atmospheric states, winds near the surface, winds near the upper atmosphere, water vapor species that are very absolute distributions.

But we're trying to take the learner dynamical operator that predicts the next time step and then feed that back into itself and auto aggressively roll out weather forecasts.

That's how full AI weather forecasting work.

I'm not very skeptical of that three years ago.

The world has been convinced that this is the better way to do AI weather forecasts.

They're more skillful.

The most skillful forecasts in the world now come from AI systems that are inscrutable.

We don't understand fully how they're making their predictions, but they're easy to score and convince yourself they're better.

My team at Climate Denyant X-GRAVE said NVIDIA talks to the developers of these AI weather forecasting systems.

Then we started collaborating with generative AI experts who are accustomed to doing amazing things with video and imagery and asking, "Could we do similar things with our data?"

So we went impact selectivity with super resolution.

The world has a lot of blurry predictions of the future, but the world needs a lot more fine scale super resolved versions of those predictions because climate impacts yourself on the scales, kilometers, and infrastructure.

And so we asked, "Could we take some blurry climate data of one form and use generative AI to turn it into very highly resolved versions of the same variables, including all the distribution trips involved, but also to synthesize new variables that you can only observe at high resolution, like radar reflectivity observations of rainfall?"

No, this is just the one I might have worked so much better than I expected.

So now we have this thing called Cordash.

It does multivariate super resolution and new channel synthesis and is being used in lots of different settings to take the pain out of generating high resolution state estimates of the atmosphere.

When you talk about predicting weather, predicting climate, is there a percentage number in terms of accuracy or a way of kind of putting your finger on how, what's our accuracy like right now and how has it maybe changed and I would assume improved since the advent of advanced AI and now generative AI in the process?

Oh, that's a great question.

Yeah.

For weather forecasting, it's very clear that the pace of increasing in steel is outpacing what we've seen with physics models.

So something called the quiet resolution weather forecasting, you can look back on the last two decades and ask how has weather forecasting scale gotten better over time?

And it's gotten better, but slowly and asymptotically and it seems to be not getting better, much, really safe.

And there's a version of this graph that I just saw of one of the leaders at the European Center for Medium-World Weather Forecasting presented at a conference that shows AI just leets rocking all that trajectory.

So the weather community is really, really seeing this.

You can measure this.

For climate prediction, it's difficult.

I mean, the answer is out of sample.

The answer is in 50 years.

We don't know the answer.

So what we're trying to predict are like a range of outcomes and concepts that are irrelevant to weather prediction, like energy conservation, mass conservation are really important to make sure your model obeys.

And so I would say what's going on now is this whole ecosystem effect where lots of developers are working to take what's happened in AI for weather prediction and use it to the benefit of climate prediction.

So one thing you can do is train an emulator, not of weather observations, but of climate projections themselves.

That's working pretty well.

Once you have that climate projections that are normally difficult to pass around the world on the internet, it's very easy to give people because you just give someone a trained AI model and they inference the climate much faster than they would read a dataset.

Yeah.

And there are some people who are trying to build multi-component versions of these pure AI climate simulators that have the same properties we require of climate prediction models.

So coupling between the atmosphere and ocean, correct conservation of mass and energy, correct responses to adding a little more radiative energy to the system like CO2 gases to you.

So the community is hard at work trying to understand if we can build a next generation of fully AI climate models, but it's work in progress.

That's great to hear.

And so that kind of makes me think on the flip side, what do we do with these predictions?

What do we do with this information with the ability, as you put it, to inference what the weather, perhaps what the climate might be like in a given amount of time?

We've had, I mean, this year already wildfires in the West, tornadoes and other extreme storms kind of in the middle and southern part of the US and obviously globally, all kinds of extreme weather events becoming more frequent in recent times.

So how can advances in AI driven climate modeling help us better prepare, help communities better prepare for what's coming and adapt to the change in climate?

So I'll give you two answers.

One is like a fundamentally new ability to study the statistics of these rare extremes themselves.

By definition, these low likelihood eye impact extremes, they're rare and observed record.

We can't study them in observations because the sample sizes are tiny.

We could generate hundreds or thousands of counterfactual low likelihood extremes using physical simulator, so that's too extensive.

So the speed up of AI models, its 1000x increase in intensity that we get has opened up a new science of huge ensemble counterfactual generation.

There's a pair of papers I love led by Berkeley that we collaborate on with NVIDIA.

They've taken our AI model forecast net, they've calibrated it carefully so that it produces the right probability distribution, a trustworthy probability distribution to study heat extremes.

Then they've run like 28,000 years worth of equivalent summer 2023.

And so instead of one forecast every day, we've got 7000 every day.

And so you can find so many different counterfactuals of how 2023 could have turned out.

And this is a new type of data we couldn't generate before where we could start to have satisfying sample sizes of even rare heat waves to begin to understand their climate drivers to inform our understanding of how those statistics have been a change in the future.

So that's a mature technology that exists in terms companies are already starting to use it in terms companies normally just receive private projections that they're starting to generate them internally because it's so easy with AI.

And then the other thing is just improved weather forecasting itself more interactive weather forecasting more steerable forecasting, like teams just put out something I'm really excited about called climate in a bottle.

That's opened my mind to the fact that there's potential to do so much more than physics simulations, which is, you know, those are two stage act generate output, look at output and finding hurricanes you care about is like a needle in a haystack.

But AI lets us say, you know, I'd like a weather for I'd like to find a hurricane, please.

I'd like to find a hurricane in a future climate.

Just give me a sample of that, because that's what I'm interested in.

So this I think that will increase the ability of everyone to interact with climate predictions.

You know, imagine a future where you can be sitting on in Florida looking at a seed of a potential future cyclone way out of Eastern Atlantic and say, give me only weather forecasts that produce a really bad version of that hurricane, though I can plan for the worst.

That's that's normally really hard to do with normal simulation technology.

But but AI, I totally see that's going to be possible.

Yeah.

And so are, you know, governmental organizations, you mentioned insurance companies, of course, but are governmental leaders, governmental organizations, disaster response organizations, are they using or if not, how can they use these interactive climate simulators to inform their responses and inform, you know, the policy decisions for the future?

I think it's going to be a process in their understanding their implications that the whole world is grappling with the interactivity dimension right now.

I know.

So I have a we're fortunate in the Earth 2 initiative and video to have some really inspiring European science advisors, and one of them is named George Stevenson gave a wonderful keynote at the International Supercomputing Congress a couple weeks ago.

And what he sees is a future where there's a source of credible, appropriate data to use for future climate prediction, like for a cutting edge best in class physics model, and then AI on top of it to broaden the people's reach into what the data produces.

And as long as the AI is stable to the training data, then it solves a liability concern where, you know, climate actors need to have data provenance, need to have provenance to credible sources of impacts related decisions.

So I think where we're researching where we're working right now is building that AI on top to understand, you know, what is it going to be a token to ask a trove of simulation output for in the future?

I know, I know I can ask for tropical cyclones right now.

But I don't know if I can ask for other things I'd like to ask for like, hey, show me a counterfactual of two compound hurricanes pummeling into Bermuda one after the other in today's climate and in 2070.

But as these capabilities emerge, I think we'll see what the ecosystem wants to do with them.

Yeah.

Otherwise, I see, you know, climate type startups doing sensible things like taking AI for state estimation to prove their value prop of proprietary data streams, improving state estimates for forecasting applications.

I'm speaking with Mike Pritchard.

Mike is the director of climate simulation research in NVIDIA.

And we've been talking about the way that AI has really, I hate to use this word, but disrupted climate science and simulation weather forecasting as well.

Mike, in the intro, I referenced digital twins, which is something we've talked about on the show, mainly in reference to industrial AI, simulating the way that factories operate for planning purposes and so on.

How did digital twins play into climate science?

Yeah, we already think of our physical simulators of the future of the planet as sort of digital things.

They can be used for scenario planning.

You can ask what if questions, you know, what if humans evolve the land surface this way and emit this much guns in the atmosphere versus what if they all of this mitigation scenario.

So AI as a surrogate for physical climate models on top of physical climate predictions is to continue to sort of reducing the latency associated with our familiar digital twins.

But I think you're after something bigger, which is, you know, what I observe in some of NVIDIA's connections to industrial infrastructure work is this ability to kind of back propagate and differentiate through ultimately optimize the control of very complex systems.

And so there, I think it's really exciting to imagine, you know, a digital twin of an electrical grid that coupled to digital twins of individual power stations eventually coupled to digital twins, maybe there are existing AI forecast models differentiable, like auto regressors of the entire atmosphere, coupled to digital twins of climate.

And you can chain those together and propagate through the whole stack, then maybe we can play games we couldn't have dreamed of before to sort of optimize for resilience in the face of slowly varying low likelihood climate experience.

So let's switch gears for a second.

I want to talk about a talk that you gave a recent Ted Talk, where you were talking about the importance of AI and climate simulation.

Why give a Ted Talk?

What was the message that you're hoping to leave the audience the public with from your talk?

I think just that something very exciting is going on in the business of simulating the atmosphere that nobody would have predicted 10 years ago, this this fundamentally new simulation technology that is properties we don't even understand yet, but very enticing characteristics like data, interactivity, I just wanted to get that message out there.

So people are worried that, you know, that that's a really beneficial use of AI, or a really important problem that affects us all weather prediction and climate prediction.

You know, it's wonderful to see this like cocoon of people working across academia and government labs and industry, very complimentary still sets that are needed to bring that into existence and achieve its full potential.

So that was one of the messages.

But yes, I think the attention some of the remarkable characteristics of AI for simulation here, but not some that I'm recalling, I mentioned this Ted Talk, I think one of the amazing things is the ability to use more data.

So we have so many observations of the earth system, it's actually really hard to incorporate them into physics models.

Because I mentioned humans have to write their assumptions of how unresolved things work like cloud, and that can easily clash with real information about clouds.

And you have to eventually sort of sacrifice observations you wish you could use because they just think they shock your model and you can't use your model for the things you'd like to use it for anymore.

So AI, by having no humans write down anything, the physical questions are gone, they just opens up this huge filter that we didn't used to think we could into how many observations we could actually use to benefit our simulations.

And so there's exciting work going on at the European Center now that is using only observations, satellite observations and station observations as the sources of AI prediction, I think that's the future.

And as we, you know, forecasting is two problems, it's state estimation, how good do you know your initial condition and production, how well can you predict from there, and the unification of AI for improving state estimation and prediction is happening as we speak.

And we don't know the potential, we don't know what the predictability limits of the earth system are going to look like in 10 years.

So it's a very exciting time to be alive.

That's why I wanted to convey intent.

It's an exciting time.

It is listening you talk about that makes me think of episodes we've done involving astronomy, and involving healthcare and medical imaging, and guests talking about how there's so much data in existing images, medical images taken, you know, years ago, the images coming back from, you know, the James Webb telescope, and there's so much data that, you know, kind of to your point, humans making observations and writing things down and doing calculations can only go so far, the AI systems can really, you know, dig into these massive data sets and dig into all the data in a single image.

And in the case of medical imaging, remember, we had a guest talking about finding a new biomedical marker, just by going through pre-existing imagery.

Is there a similar phenomena that happens with weather observations and weather imagery?

Are you able to, you know, find things in kind of the historical observations that, you know, we just didn't know were there before, and then they're able to inform kind of, you know, getting a better future state understanding that that informs your predictions?

It's happening as we see.

You know, there's a pair of influential paper at the University of Washington that's claiming to update the long-held notions of how long the predictability limit of the atmosphere is, and that's causing a lot of controversial chatter in the community.

So yeah, I think the questions you're speaking to are happening right now in our community.

There are some timescales that are very difficult to predict on, like beyond a week or so when the atmosphere loses its memory, but when there's other components of the system, complex components, the ocean surface, the ecosystems that have memory that should give us some predictability on three, four, even five-week time scales.

That's where I really hope we'll have new scientific understanding as AI teachers, how much predictability has been hiding on those time scales all this time.

But you mentioned data, and I have to say, like, we have a unique problem in the Earth System Sciences, which is there's only so many decades of satellite observations.

Right.

And so we don't have the whole internet of images and video to feed off of.

At the end of the, you know, at the end, we have like tens of thousands of days of satellite observations.

And so there are inevitably going to be some phenomena where the sample sizes are just too small.

You know, there's only been so many El Nino events in those 50 years.

There's only been so many positive, let alone future climate change, you know, how the, you know, some things are inherently out of sample of the observations that feed our models, like the slow modes of the ocean dynamics and the ocean becomes the most important controls climate change by 2080.

So in my mind, there's, there's always going to be a combination of physical simulators that can, you know, are set for purpose for those deep time projections alongside observations that I agree with you have not been fully exploited by humans.

And what that combination is going to be is really fascinating to think about.

Yeah.

Does synthetic data play a significant role in climate science?

Absolutely.

Yeah.

We, you know, we can leverage our many simulations of the future or many past forecasts of weather as tree training objects to try to, you know, get the model as ready as it can be, use its memory capacity as efficiently as possible for ultimate fine tuning on the observations of highest quality.

Yeah.

That's an active area of research.

So looking ahead and you kind of talked a little bit about some of these things before, so feel free to kind of recap if you will.

But what are some of the next big things that you, your colleagues, kind of the climate science community are working on and specifically with your work in NVIDIA, are there any big research questions that you're tackling right now or hoping to get to in the days and months to come?

So around the world, I'm really excited by what's going on with, with ocean emulation.

We've seen the atmosphere and the weather community really did great things and the ocean simulation community is starting to do great things as well.

And the unification of these is a really exciting frontier.

You mentioned a minute ago, the ocean, and I don't want to get the words wrong, but the ocean kind of being the primary controller of climate.

Is that how you put it?

Yeah.

You know, the vast majority of the excess heat that we've put into the earth system is absorbed by the ocean.

And the memory of where it goes, where the marine heat waves happen in the future will largely stop our experience of, you know, inter-annual heat extremes and challenging extreme events.

Yeah.

So the ocean is really important to include in any production of climate.

So the advent of full ocean emulators is just happening this year and last year.

Oh, that's amazing.

And they're coupling the full atmosphere emulators is just happening.

It's like in the 1980s when people first coupled physics based atmosphere and ocean models, which used to be separate communities and out came the world's first El Nino predictions and seasonal forecasting capabilities.

Yeah.

This is like climate model development on like on an accelerated timeline, it feels like the last three years of our like decades compressed into a few.

And in video, I'm really excited about this interactivity dimension.

It stuns me.

So we have this thing called climate in a bottle.

It's a paper that our scientists put out a month ago.

And it's not like these other models I've described where you're trying to generate videos and outputs to come inputs.

That feels very weather to me.

What feels simony is saying, Hey, here's the climate boundary conditions.

Here's what should be controlling weather noisily and give me some samples of weather subject to those boundary conditions.

And so this climate in a bottle research paper demonstrates a model like this where the user can pass in just three pieces of information, like time of day, time of year, the controls where the sun is and how warm is the ocean.

I mentioned the ocean largely regulates the atmosphere on quiet times.

That's very low dimensional information, like a text query to a large language model, 200 kilobytes of information.

Oh, the other end of the same comes 600 megabytes across 12 different variables of 13 million pixels of state estimations consistent with those inputs.

And if you look at the climatology of that system, like you generate tens of thousands of samples and say, how's the seasonal cycle?

How's the daily cycle?

How are all the modes of variability I care about as a climatologist?

They look good.

And then now here's the rope kicker.

We've added the ability to sear this generation to events of interest.

So one of our scientists trained a tropical cyclone classifier alongside the generator.

And now we're able to pass in a fourth ingredient, a map of where I would like to see cyclones.

And this is to me, I've never seen anything like this.

I'm used to having to sift through petabytes of output to find a few tropical cyclones I care about.

I just feel to ask for one and to have the result be consistent with the spatial temporal dynamics of the data was trained on.

That's the tip of an iceberg of new interactivity features of queryable time and informatics that I think is going to feel very different than what we're used to in five years.

So yeah, that's where I'm focusing a lot of attention.

Amazing.

If listeners, if you're listening on audio and can't see the video, Mike's face is consistently lighting up as he's talking about some of these things.

It's fantastic to see.

Mike, to leave the listeners with kind of a call to action here, whether there are technologists or just concerned citizens who have been listening to the conversation and they, we speaking for myself, want to know how we can get involved, how we can support the advancement of climate science, how we can support sustainability through AI.

What advice would you have?

What can we do?

I think like any concerned citizen, you know, like contact your politicians if you would like to, you know, exert your preferences about what priorities are.

I feel like a lot of priorities of funding are currently in debate and there's, you know, rational questions of efficiency going on.

But one thing that's very important to us all is our sustained observations of the Earth system.

Machine learning is nothing without the data it's trained on.

And so, yeah, if you value the observing systems that have led and the weather modeling agencies that have led to the data sets that are leading to this amazing revolution in AI production quality, yeah, express that to the people in charge of the resources that allow those observations to exist.

And then, you know, you can tinker.

If you're a technical competition enthusiast, you know, like a climate one.

If you're an ML researcher and you'd like to plug into a benchmark, we've got a few climate ones that I think are still unsolved benchmarks that could use your attention.

Yeah.

And I don't know what else to say to your question, you know, just maybe have conversations about it.

The planet is warming, we're a part of that.

It's going to be a part of our future, our kids' future.

A lot of the warming already happens, you know, the average lifetime of a carbon dioxide molecule in the atmosphere is 100 years.

And so the past 200 years of emissions will definitely be warming our planet in the future.

And we all need to think about what we do with that.

I think that AI will allow us to appreciate by being able to interact more natively with predictions of the future, the complex system that we're embedded in.

I think just that awareness is good to talk with your friends about.

Yeah, that is a powerful mechanism for understanding things closer to firsthand for sure.

Mike, for listeners who would like to know more, would like to follow your work and your team's work, where's a good place to go online, NVIDIA research, or where can we send people to investigate further?

And look up NVIDIA Earth2.

Earth2 is the name of our initiative, and there's all sorts of wonderful software in there.

There's recipes for many of the AI simulation technologies I've mentioned, open source recipes that we're hoping the ecosystem builds upon.

There's training materials.

So yeah, Earth2 is the thing to look at.

Fantastic.

Mike Pritchard, again, thank you so much for taking the time to join the podcast.

It's a fascinating conversation.

And despite kind of the seriousness of climate change and extreme weather and such, you've left me with a lot of optimism about the technologies kind of, as you said, the past few years have just been super jam-packed with advancements.

And the ability to use these to help us understand and adapt to the climate is at the top of the list, in my view, of the importance of this work.

So yeah, what a time to be alive, as you said.

Yeah, thanks.

It's a rough privilege for me to represent a huge team of hardworking, humble, really earnest technologists and engineers and scientists that are working together on these problems.

I'm just a mouthpiece, but yeah, any credit should go to them.

Absolutely.

Well, thank you to your whole team.

Thanks so much.

Thank you.

[Music]