MeteoSignal

Tracking forecast error by month, updated every week

RMSE of each model relative to IFS, at stations and against ERA5, from open data.

Scores grouped by
Calendar month
Refreshed
Every week, on Mondays
Last update
16 November 2026
Station observations to
12 November 2026
ERA5 scores to
9 November 2026
Models scored
8: AIFS and seven others, 6 of them AI

Each value is the error over one calendar month. The weekly update adds the new days, so the current month fills up week by week and appears once it holds 10 days. A finished month can still move a little when a source revises its measurements. Monthly values are point scores without confidence intervals. They show how the error moves with the season and with model versions. Whether a difference holds is decided only on the whole sample, on the scores pages.

01Latest month

RMSE by model and lead time, latest month scored.

Raw model output. The percentage beside each RMSE compares it with IFS over the same days. A month is shown once it holds at least 10 days.

−8% RMSE 8% lower than IFS's: better. +8% RMSE 8% higher than IFS's: worse. These monthly differences are not tested, so violet and yellow-brown show the sign only, not the green or red of a tested result.

Against observations at 30 DWD stations, Germany: operational models

Every day with a forecast from AIFS, IFS and GFS.

2 m temperature, RMSE in °C: Nov 2026, 12 days
ModelDay 1Day 3Day 5Day 7Day 10
AIFSAI1.34−14% (lower than IFS, better)1.45−27% (lower than IFS, better)1.80−16% (lower than IFS, better)2.15−23% (lower than IFS, better)2.67−18% (lower than IFS, better)
IFS1.562.002.162.813.28
GFS2.17+39% (higher than IFS, worse)2.46+23% (higher than IFS, worse)2.61+21% (higher than IFS, worse)3.03+8% (higher than IFS, worse)3.59+9% (higher than IFS, worse)
10 m wind speed, RMSE in m/s: Nov 2026, 12 days
ModelDay 1Day 3Day 5Day 7Day 10
AIFSAI1.05−5% (lower than IFS, better)1.09−11% (lower than IFS, better)1.35−8% (lower than IFS, better)1.52−16% (lower than IFS, better)1.91+2% (higher than IFS, worse)
IFS1.111.221.471.801.87
GFS1.09−1% (lower than IFS, better)1.27+4% (higher than IFS, worse)1.55+6% (higher than IFS, worse)2.07+15% (higher than IFS, worse)2.13+14% (higher than IFS, worse)

Against observations at 107 stations in six countries, Europe: operational models

Every national-service station, Germany included, pooled.

2 m temperature, RMSE in °C: Nov 2026, 12 days
ModelDay 1Day 3Day 5Day 7Day 10
AIFSAI1.37−10% (lower than IFS, better)1.51−19% (lower than IFS, better)1.83−16% (lower than IFS, better)2.23−15% (lower than IFS, better)2.73−15% (lower than IFS, better)
IFS1.521.862.172.623.21
GFS2.08+37% (higher than IFS, worse)2.43+31% (higher than IFS, worse)2.57+19% (higher than IFS, worse)2.99+14% (higher than IFS, worse)3.66+14% (higher than IFS, worse)
10 m wind speed, RMSE in m/s: Nov 2026, 12 days
ModelDay 1Day 3Day 5Day 7Day 10
AIFSAI1.14−4% (lower than IFS, better)1.18−8% (lower than IFS, better)1.44−9% (lower than IFS, better)1.67−14% (lower than IFS, better)1.96−4% (lower than IFS, better)
IFS1.191.271.581.932.04
GFS1.29+9% (higher than IFS, worse)1.42+12% (higher than IFS, worse)1.68+6% (higher than IFS, worse)2.32+20% (higher than IFS, worse)2.43+19% (higher than IFS, worse)

Against observations at 30 DWD stations, Germany: AI models

Only the days on which AIGFS, GraphCast, FourCastNet v2, Pangu and Aurora also have a forecast, so the months hold fewer days than above. AIGFS is NOAA's operational model and starts from the GFS analysis. The other four are NOAA's re-runs, started from IFS analyses.

2 m temperature, RMSE in °C: Oct 2026, 10 days
ModelDay 1Day 3Day 5Day 7Day 10
AIFSAI1.27+1% (higher than IFS, worse)1.47−7% (lower than IFS, better)2.13−8% (lower than IFS, better)3.33+45% (higher than IFS, worse)3.61−6% (lower than IFS, better)
IFS1.261.582.322.293.86
AIGFSAI1.58+26% (higher than IFS, worse)1.78+12% (higher than IFS, worse)2.25−3% (lower than IFS, better)2.76+21% (higher than IFS, worse)2.97−23% (lower than IFS, better)
GraphCastAI1.30+3% (higher than IFS, worse)1.67+6% (higher than IFS, worse)1.96−16% (lower than IFS, better)3.01+32% (higher than IFS, worse)3.27−15% (lower than IFS, better)
FourCastNet v2AI1.58+25% (higher than IFS, worse)1.81+14% (higher than IFS, worse)2.33+1% (higher than IFS, worse)3.00+31% (higher than IFS, worse)4.11+6% (higher than IFS, worse)
PanguAI1.41+12% (higher than IFS, worse)1.96+24% (higher than IFS, worse)2.57+11% (higher than IFS, worse)3.63+59% (higher than IFS, worse)3.42−11% (lower than IFS, better)
AuroraAI1.34+6% (higher than IFS, worse)1.71+8% (higher than IFS, worse)2.07−11% (lower than IFS, better)2.54+11% (higher than IFS, worse)3.22−17% (lower than IFS, better)
10 m wind speed, RMSE in m/s: Oct 2026, 10 days
ModelDay 1Day 3Day 5Day 7Day 10
AIFSAI1.09−2% (lower than IFS, better)1.14−8% (lower than IFS, better)1.36−6% (lower than IFS, better)1.64−6% (lower than IFS, better)2.59+34% (higher than IFS, worse)
IFS1.111.231.451.741.93
AIGFSAI1.12+1% (higher than IFS, worse)1.20−3% (lower than IFS, better)1.47+1% (higher than IFS, worse)1.87+7% (higher than IFS, worse)2.20+14% (higher than IFS, worse)
GraphCastAI1.14+2% (higher than IFS, worse)1.16−6% (lower than IFS, better)1.37−5% (lower than IFS, better)1.75+1% (higher than IFS, worse)1.91−1% (lower than IFS, better)
FourCastNet v2AI1.24+12% (higher than IFS, worse)1.41+15% (higher than IFS, worse)1.69+16% (higher than IFS, worse)1.86+7% (higher than IFS, worse)2.50+30% (higher than IFS, worse)
PanguAI1.15+3% (higher than IFS, worse)1.17−5% (lower than IFS, better)1.48+1% (higher than IFS, worse)1.90+9% (higher than IFS, worse)1.85−4% (lower than IFS, better)
AuroraAI1.08−3% (lower than IFS, better)1.15−7% (lower than IFS, better)1.41−3% (lower than IFS, better)1.86+7% (higher than IFS, worse)2.07+7% (higher than IFS, worse)

Against ERA5 over Europe, 35 to 72°N, 12.5°W to 40°E

Latitude-weighted, on the days every model has a forecast. ERA5 is a model product and AIFS was trained mostly on it, so this is a second view, not an observation.

500 hPa geopotential height, RMSE in gpm: Oct 2026, 31 days
ModelDay 1Day 3Day 5Day 7Day 10
AIFSAI4.7+9% (higher than IFS, worse)15.8−1% (lower than IFS, better)33.1−17% (lower than IFS, better)75.6−1% (lower than IFS, better)130.9−2% (lower than IFS, better)
IFS4.316.040.076.2133.6
GFS7.3+68% (higher than IFS, worse)23.1+44% (higher than IFS, worse)51.1+28% (higher than IFS, worse)86.9+14% (higher than IFS, worse)140.4+5% (higher than IFS, worse)
AIGFSAI7.5+72% (higher than IFS, worse)23.3+45% (higher than IFS, worse)46.0+15% (higher than IFS, worse)75.0−2% (lower than IFS, better)128.8−4% (lower than IFS, better)
GraphCastAI6.2+43% (higher than IFS, worse)18.5+15% (higher than IFS, worse)40.10% (equal to IFS)78.8+3% (higher than IFS, worse)131.2−2% (lower than IFS, better)
FourCastNet v2AI7.5+72% (higher than IFS, worse)25.1+56% (higher than IFS, worse)51.1+28% (higher than IFS, worse)97.1+27% (higher than IFS, worse)142.1+6% (higher than IFS, worse)
PanguAI6.0+38% (higher than IFS, worse)20.8+30% (higher than IFS, worse)43.7+9% (higher than IFS, worse)87.7+15% (higher than IFS, worse)133.00% (equal to IFS)
AuroraAI4.4+2% (higher than IFS, worse)16.9+6% (higher than IFS, worse)38.1−5% (lower than IFS, better)69.7−9% (lower than IFS, better)110.5−17% (lower than IFS, better)
2 m temperature, gridded, RMSE in K: Oct 2026, 31 days
ModelDay 1Day 3Day 5Day 7Day 10
AIFSAI0.76−34% (lower than IFS, better)0.99−27% (lower than IFS, better)1.43−20% (lower than IFS, better)2.08−11% (lower than IFS, better)2.93−5% (lower than IFS, better)
IFS1.141.351.792.323.09
GFS1.32+16% (higher than IFS, worse)1.58+17% (higher than IFS, worse)2.02+13% (higher than IFS, worse)2.43+5% (higher than IFS, worse)3.04−2% (lower than IFS, better)
AIGFSAI1.140% (equal to IFS)1.37+2% (higher than IFS, worse)1.780% (equal to IFS)2.17−6% (lower than IFS, better)2.88−7% (lower than IFS, better)
GraphCastAI1.05−8% (lower than IFS, better)1.30−3% (lower than IFS, better)1.77−1% (lower than IFS, better)2.31−1% (lower than IFS, better)2.91−6% (lower than IFS, better)
FourCastNet v2AI1.27+12% (higher than IFS, worse)1.59+18% (higher than IFS, worse)1.92+7% (higher than IFS, worse)2.46+6% (higher than IFS, worse)3.14+2% (higher than IFS, worse)
PanguAI0.92−19% (lower than IFS, better)1.21−10% (lower than IFS, better)1.74−2% (lower than IFS, better)2.35+1% (higher than IFS, worse)3.15+2% (higher than IFS, worse)
AuroraAI0.97−15% (lower than IFS, better)1.19−12% (lower than IFS, better)1.60−10% (lower than IFS, better)2.00−14% (lower than IFS, better)2.56−17% (lower than IFS, better)
10 m wind speed, gridded, RMSE in m/s: Oct 2026, 31 days
ModelDay 1Day 3Day 5Day 7Day 10
AIFSAI0.76−28% (lower than IFS, better)1.23−16% (lower than IFS, better)1.80−18% (lower than IFS, better)2.78−3% (lower than IFS, better)3.26−3% (lower than IFS, better)
IFS1.061.472.202.883.37
GFS1.41+33% (higher than IFS, worse)1.91+30% (higher than IFS, worse)2.51+14% (higher than IFS, worse)3.16+10% (higher than IFS, worse)3.78+12% (higher than IFS, worse)
AIGFSAI1.16+10% (higher than IFS, worse)1.59+8% (higher than IFS, worse)2.26+3% (higher than IFS, worse)2.880% (equal to IFS)3.40+1% (higher than IFS, worse)
GraphCastAI0.87−18% (lower than IFS, better)1.35−8% (lower than IFS, better)2.04−7% (lower than IFS, better)2.76−4% (lower than IFS, better)3.35−1% (lower than IFS, better)
FourCastNet v2AI1.17+10% (higher than IFS, worse)1.70+16% (higher than IFS, worse)2.31+5% (higher than IFS, worse)2.93+2% (higher than IFS, worse)3.53+5% (higher than IFS, worse)
PanguAI0.92−13% (lower than IFS, better)1.44−2% (lower than IFS, better)2.10−5% (lower than IFS, better)2.86−1% (lower than IFS, better)3.39+1% (higher than IFS, worse)
AuroraAI0.80−24% (lower than IFS, better)1.26−14% (lower than IFS, better)2.13−3% (lower than IFS, better)3.17+10% (higher than IFS, worse)3.88+15% (higher than IFS, worse)
02Month by month

RMSE relative to IFS at day 3.

The zero line is IFS. Below the line, on the violet side, a model had a lower RMSE than IFS in that month over the same days. Above the line its RMSE was higher. These monthly differences are not tested. AIFS 2 replaced the earlier version on 12 May 2026. A month is scored for a version only when that version has at least 10 days in it, so May 2026 shows the earlier version alone. A month with no scores leaves a gap on the axis.

Against observations at 30 DWD stations, Germany: operational models

Every day with a forecast from AIFS, IFS and GFS.

2 m temperature
-2002040▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS

Sep 2025 to Nov 2026. Hover for each month's values: minus is a lower RMSE than IFS's (better), plus a higher one (worse).

10 m wind speed
-1001020▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS

Sep 2025 to Nov 2026. Hover for each month's values: minus is a lower RMSE than IFS's (better), plus a higher one (worse).

Against observations at 107 stations in six countries, Europe: operational models

Every national-service station, Germany included, pooled.

2 m temperature
-20020▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS

Sep 2025 to Nov 2026. Hover for each month's values: minus is a lower RMSE than IFS's (better), plus a higher one (worse).

10 m wind speed
-1001020▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS

Sep 2025 to Nov 2026. Hover for each month's values: minus is a lower RMSE than IFS's (better), plus a higher one (worse).

Against observations at 30 DWD stations, Germany: with ICON, up to 7 November 2026

ICON's archive of past runs ended on 7 November 2026, so this group no longer grows.

2 m temperature
-2002040▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %GFSICONAIFS

Sep 2025 to Oct 2026. Hover for each month's values: minus is a lower RMSE than IFS's (better), plus a higher one (worse).

10 m wind speed
-1001020▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %ICONGFSAIFS

Sep 2025 to Oct 2026. Hover for each month's values: minus is a lower RMSE than IFS's (better), plus a higher one (worse).

Against observations at 30 DWD stations, Germany: AI models

Only the days on which AIGFS, GraphCast, FourCastNet v2, Pangu and Aurora also have a forecast, so the months hold fewer days than above. AIGFS is NOAA's operational model and starts from the GFS analysis. The other four are NOAA's re-runs, started from IFS analyses.

2 m temperature
-1001020▼ violet: lower error than IFSJul 26AugSepOctRMSE against IFS, %

Jul 2026 to Oct 2026. Hover for each month's values: minus is a lower RMSE than IFS's (better), plus a higher one (worse).

10 m wind speed
-5051015▼ violet: lower error than IFSJul 26AugSepOctRMSE against IFS, %

Jul 2026 to Oct 2026. Hover for each month's values: minus is a lower RMSE than IFS's (better), plus a higher one (worse).

Against ERA5 over Europe, 35 to 72°N, 12.5°W to 40°E

Latitude-weighted, on the days every model has a forecast. ERA5 is a model product and AIFS was trained mostly on it, so this is a second view, not an observation.

500 hPa geopotential height
-200204060▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %

Sep 2025 to Oct 2026. Hover for each month's values: minus is a lower RMSE than IFS's (better), plus a higher one (worse).

2 m temperature, gridded
-20020▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %

Sep 2025 to Oct 2026. Hover for each month's values: minus is a lower RMSE than IFS's (better), plus a higher one (worse).

10 m wind speed, gridded
-20020▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %

Sep 2025 to Oct 2026. Hover for each month's values: minus is a lower RMSE than IFS's (better), plus a higher one (worse).

Day 1The same charts for forecasts made 1 day ahead

Against observations at 30 DWD stations, Germany: operational models

2 m temperature
-2002040▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS
10 m wind speed
-50510▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS

Against observations at 107 stations in six countries, Europe: operational models

2 m temperature
-2002040▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS
10 m wind speed
-505101520▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS

Against observations at 30 DWD stations, Germany: with ICON, up to 7 November 2026

2 m temperature
-2002040▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %GFSICONAIFS
10 m wind speed
01020▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %ICONGFSAIFS

Against observations at 30 DWD stations, Germany: AI models

2 m temperature
-100102030▼ violet: lower error than IFSJul 26AugSepOctRMSE against IFS, %
10 m wind speed
-5051015▼ violet: lower error than IFSJul 26AugSepOctRMSE against IFS, %

Against ERA5 over Europe, 35 to 72°N, 12.5°W to 40°E

500 hPa geopotential height
-250255075▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %
2 m temperature, gridded
-40-20020▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %
10 m wind speed, gridded
-2002040▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %
Day 5The same charts for forecasts made 5 days ahead

Against observations at 30 DWD stations, Germany: operational models

2 m temperature
-20-1001020▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS
10 m wind speed
-10-5051015▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS

Against observations at 107 stations in six countries, Europe: operational models

2 m temperature
-20-100102030▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS
10 m wind speed
-10010▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS

Against observations at 30 DWD stations, Germany: with ICON, up to 7 November 2026

2 m temperature
-20-100102030▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %GFSICONAIFS
10 m wind speed
-1001020▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %ICONGFSAIFS

Against observations at 30 DWD stations, Germany: AI models

2 m temperature
-20-10010▼ violet: lower error than IFSJul 26AugSepOctRMSE against IFS, %
10 m wind speed
-10-5051015▼ violet: lower error than IFSJul 26AugSepOctRMSE against IFS, %

Against ERA5 over Europe, 35 to 72°N, 12.5°W to 40°E

500 hPa geopotential height
-2002040▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %
2 m temperature, gridded
-20020▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %
10 m wind speed, gridded
-20-1001020▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %
Day 7The same charts for forecasts made 7 days ahead

Against observations at 30 DWD stations, Germany: operational models

2 m temperature
-20020▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS
10 m wind speed
-1001020▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS

Against observations at 107 stations in six countries, Europe: operational models

2 m temperature
-20-1001020▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS
10 m wind speed
-1001020▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS

Against observations at 30 DWD stations, Germany: with ICON, up to 7 November 2026

2 m temperature
-20020▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %GFSAIFS
10 m wind speed
-1001020▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %GFSAIFS

Against observations at 30 DWD stations, Germany: AI models

2 m temperature
-200204060▼ violet: lower error than IFSJul 26AugSepOctRMSE against IFS, %
10 m wind speed
-50510▼ violet: lower error than IFSJul 26AugSepOctRMSE against IFS, %

Against ERA5 over Europe, 35 to 72°N, 12.5°W to 40°E

500 hPa geopotential height
-20-100102030▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %
2 m temperature, gridded
-20-100102030▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %
10 m wind speed, gridded
-10010▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %
Day 10The same charts for forecasts made 10 days ahead

Against observations at 30 DWD stations, Germany: operational models

2 m temperature
-20-10010▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS
10 m wind speed
-20-1001020▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS

Against observations at 107 stations in six countries, Europe: operational models

2 m temperature
-20-10010▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS
10 m wind speed
-20-1001020▼ violet: lower error than IFSAIFS 2Sep 25NovJan 26MarMayJulSepNovRMSE against IFS, %GFSAIFS

Against observations at 30 DWD stations, Germany: with ICON, up to 7 November 2026

2 m temperature
-20-10010▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %GFSAIFS
10 m wind speed
-20-1001020▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %AIFSGFS

Against observations at 30 DWD stations, Germany: AI models

2 m temperature
-30-20-1001020▼ violet: lower error than IFSJul 26AugSepOctRMSE against IFS, %
10 m wind speed
-100102030▼ violet: lower error than IFSJul 26AugSepOctRMSE against IFS, %

Against ERA5 over Europe, 35 to 72°N, 12.5°W to 40°E

500 hPa geopotential height
-20020▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %
2 m temperature, gridded
-20-1001020▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %
10 m wind speed, gridded
-1001020▼ violet: lower error than IFSAIFS 2OctDecFebAprJunAugOctRMSE against IFS, %
03Models followed

Eight scored, two being collected, three open and waiting.

A model is scored here only if its forecast files are published routinely, free of charge and without an account. File listings were last checked on 10 November 2026.

The models: type, open feed, starting analysis and status
ModelTypeOpen feedStarts fromStatus
AIFS SingleECMWFAIECMWF open data, operational, four runs a dayECMWF's own analysisScoredThe model every comparison on this site is made from. Versions 1.1 and 2 are scored apart and never pooled.
IFSECMWFPhysics-basedECMWF open data, operationalECMWF's own analysisScoredThe reference line on the tracking charts.
GFSNOAA/NCEPPhysics-basedNOAA open data on AWS, operationalGDAS/GFS analysisScored
AIGFSNOAA/NCEPAINOAA open data on AWS, operational, four runs a dayGDAS/GFS analysisScoredArchive on AWS from 16 April 2026, so in the AIFS 2 samples only. No surface height is published: station temperature uses the GFS height.
GraphCastGoogle DeepMind, re-run by NOAAAINOAA AIWP archive on AWS (GRAP_v100)IFS analysisScoredA re-run, not an operational service: scored on fewer days. The version is the one NOAA's archive labels v100.
FourCastNet v2-smallNVIDIA, re-run by NOAAAINOAA AIWP archive on AWS (FOUR_v200)IFS analysisScoredA re-run, not an operational service: scored on fewer days. This is version 2 (small), not the newer FourCastNet 3.
Pangu-WeatherHuawei, re-run by NOAAAINOAA AIWP archive on AWS (PANG_v100)IFS analysisScoredA re-run, not an operational service: scored on fewer days. The version is the one NOAA's archive labels v100.
AuroraMicrosoft, re-run by NOAAAINOAA AIWP archive on AWS (AURO_v100)IFS analysisScoredA re-run, not an operational service: scored on fewer days. The version is the one NOAA's archive labels v100.
ICONDWDPhysics-basedDWD open data, kept for about a dayDWD's own analysisCollecting runs32 runs kept, from 8 November 2026, 18 UTC.Scored up to 7 November 2026 from Open-Meteo's archive, as a set that no longer grows. A new series from DWD's own files is being collected.
AICONDWDAIDWD open data, kept for about a dayDWD's own analysisCollecting runs32 runs kept, from 8 November 2026, 18 UTC.No public archive, so runs are captured as they appear. Scores follow once the sample is long enough.
AIFS ENSECMWFAI ensembleECMWF open data, operationalECMWF's own analysis, perturbedOpen, not yet scoredArchive from 2 July 2025. Needs ensemble scores (CRPS, spread and error), which this site does not compute yet.
AIGEFSNOAA/NCEPAI ensembleNOAA open data on AWS, operational, 31 membersGEFS member analysesOpen, not yet scoredArchive from 1 June 2025. Needs ensemble scores.
GDPS-GEMLECCCAIMSC Datamart, labelled experimental, kept for 30 daysECCC's own analysisOpen, not yet scoredNo long archive, so it would have to be captured as it appears.
FourCastNet 3NVIDIAAI ensembleModel and weights only–No open forecast feedNo routine forecast files were found, and NOAA's AIWP archive holds versions 1 and 2 only (checked 11 November 2026). It could be scored only by running the model here.
WeatherNext 2GoogleAI ensembleGoogle Cloud, with an account and a request form–No open forecast feedNot available without an account, so outside the open-data rule of this site.
FastNetMet OfficeAIModel weights only–No open forecast feedNo routine forecast files were found.
FuXi, FengWuFudan University, Shanghai AI LaboratoryAICode, weights and sample files only–No open forecast feedNo routine forecast files were found.
04Updates

What each update changed.

The scores are recomputed every Monday, and the same run publishes the site when its checks pass. If a source is late, the affected scores keep their earlier end date; if a run fails, the earlier results stay in place. The date under "Last update" says which run you are reading. Each update fetches the new observations, forecasts and ERA5 fields and rescores everything from the raw files. ERA5 arrives about five days late, so the area scores end earlier than the station scores. Verdicts rest on blocks of 10 days or more and change slowly; the monthly values above change with every update.

AIFS against IFS at day 3, AIFS 2, raw forecasts: RMSE difference as a share of IFS's, with the verdict on the whole sample at that update.
UpdateStations toERA5 to10 m wind, stations2 m temperature, stations500 hPa height, ERA52 m temperature, ERA5
16 November 202612 November 2026174 days9 November 2026171 days−3.0%cannot be separated−13.2%AIFS lower error−7.9%AIFS lower error−28.6%no verdict
12 November 20268 November 2026170 days5 November 2026167 days−2.9%cannot be separated−12.3%AIFS lower error−8.2%AIFS lower error−28.7%no verdict
11 November 20267 November 2026169 days3 November 2026165 days−2.9%cannot be separated−12.2%AIFS lower error−8.2%AIFS lower error−28.7%no verdict
10 November 20267 November 2026172 days3 November 2026168 days−6.3%depends on how the station is read−13.4%AIFS lower error−8.1%AIFS lower error−28.7%no verdict

The verdicts are tested again at every update, so a verdict needs a Holm-adjusted p-value below 0.01, and every verdict is interim until a version covers a full year.

The log starts on 10 November 2026. Earlier results are in the scores themselves, which are always rebuilt from the first day of each AIFS version.