AI Now Outperforms Conventional Weather Forecasts With 90 Percent Accuracy

AI evalutates the hundreds of variables and produces an significantly superior forecast in under one minute. 

This may be indicative of the optimal uses for AI. JL 

Benj Edwards reports in ars technica:

An AI meteorology model from Google DeepMind has significantly outperformed conventional weather forecasting methods in predicting global weather conditions up to 10 days in advance. The achievement suggests that future weather forecasting may become far more accurate. In a comprehensive evaluation, GraphCast outperformed ECMWF's system in 90% of 1,380 metrics, including temperature, pressure, wind speed and direction, and humidity at various atmospheric levels. "It predicts hundreds of weather variables, over 10 days at 0.25° resolution globally, in under one minute."

On Tuesday, the peer-reviewed journal Science published a study that shows how an AI meteorology model from Google DeepMind called GraphCast has significantly outperformed conventional weather forecasting methods in predicting global weather conditions up to 10 days in advance. The achievement suggests that future weather forecasting may become far more accurate, reports The Washington Post and Financial Times.

In the study, GraphCast demonstrated superior performance over the world's leading conventional system, operated by the European Centre for Medium-range Weather Forecasts (ECMWF). In a comprehensive evaluation, GraphCast outperformed ECMWF's system in 90 percent of 1,380 metrics, including temperature, pressure, wind speed and direction, and humidity at various atmospheric levels.

 

And GraphCast does all this quickly: "It predicts hundreds of weather variables, over 10 days at 0.25° resolution globally, in under one minute," write the authors in the paper "Learning skillful medium-range global weather forecasting."

This marks a notable advancement in speed and accuracy for AI in meteorology. Matthew Chantry, machine-learning coordinator at ECMWF, acknowledged the rapid progress in an interview with the Financial Times, saying that an AI system in meteorology had progressed "far sooner and more impressively than we expected even two years ago."

GraphCast utilizes what researchers call a "graph neural network" machine-learning architecture, trained on over four decades of ECMWF's historical weather data. It processes the current and six-hour-old global atmospheric states, generating a 10-day forecast in about a minute on a Google TPU v4 cloud computer. Google's machine learning method contrasts with conventional numerical weather prediction methods that rely on supercomputers to process equations based on atmospheric physics, consuming significantly more time and energy.

 

Chantry highlighted GraphCast's efficiency to the Financial Times, estimating it to be about 1,000 times cheaper in terms of energy consumption compared to traditional methods. An example of its forecasting success was its prediction of Hurricane Lee's landfall in Nova Scotia nine days in advance, three days earlier than traditional approaches.

Despite the advancement, GraphCast has limitations. It did not outperform conventional models in all scenarios, such as the sudden intensification of Hurricane Otis, which hit Acapulco with minimal warning on October 25. Also, due to technological limitations, global AI models can't yet create forecasts as detailed or granular as traditional ones, making them more ideal for examining smaller-scale phenomena, according to The Washington Post. And they have transparency issues since meteorologists can't yet look inside the "black box" of the AI model and see exactly why it makes the forecast it does.

Ultimately, the Google DeepMind researchers see their AI-based approach as a complement to current weather prediction techniques. "Our approach should not be regarded as a replacement for traditional weather forecasting methods," they write, "which have been developed for decades, rigorously tested in many real-world contexts, and offer many features we have not yet explored."

Looking ahead, ECMWF plans to develop its own AI model and explore integrating it with its numerical weather prediction system. The UK Met Office, in partnership with the Alan Turing Institute, is also developing a graph neural network for weather forecasting to be incorporated into its supercomputer infrastructure in the future.