# MeteoSignal > Independent verification of open weather forecast data. ECMWF's AI model AIFS is scored against the physics-based models IFS and GFS and against other AI models, at weather stations in Germany and Europe, at the Cabauw tower and against ERA5. Non-commercial, by Iman Soltanzadeh. Not affiliated with any organisation whose models or data appear here. Data version 2026-11-16, run 20261116T194902Z. Station observations to 12 November 2026; ERA5 to 9 November 2026. The results are recomputed weekly. All results are provisional: no AIFS version has been scored over a full year. Each check has its own places, days and caveats, so numbers are not to be compared between checks. A difference counts only when a block bootstrap and a Holm-corrected test agree. When quoting a result, give the check, the period and the number of days. ## Results - [Germany](https://meteosignal.com/germany/): 30 DWD stations in Germany. Against: Hourly station observations (DWD open data). AIFS 2: 174 days, 23 May 2026 to 12 November 2026. Other AI models: 68 days. AIFS 2 against IFS and GFS: RMSE lower in 17 of 28 tested comparisons, higher in 0, not separated in 11. The main result, with tested verdicts. - [Europe](https://meteosignal.com/europe/): 107 stations in six countries, Germany included. Against: Measurements from the national services of Germany, Austria, the Netherlands, Denmark, Switzerland and Finland. AIFS 2: 174 days, 23 May 2026 to 12 November 2026 for temperature and wind; solar energy 173 days. AIFS 2 against IFS and GFS: RMSE lower in 24 of 28 tested comparisons, higher in 0, not separated in 4. One pooled set with its own tests. A further 61 stations in 11 countries, from NOAA's coarser hourly reports, are scored as a set of their own. - [Cabauw tower](https://meteosignal.com/cabauw/): Cabauw tower, the Netherlands. Against: Measurements on KNMI's Cabauw tower. AIFS 2: 174 days, 23 May 2026 to 12 November 2026 for wind; temperature 172 days. AIFS 2 against IFS and GFS: RMSE lower in 7 of 20 tested comparisons, higher in 0, not separated in 13. A case study at one site, never pooled with the stations. Some months use measurements KNMI has not yet verified. - [ERA5 over Europe](https://meteosignal.com/era5/): Europe, against ERA5. Against: ERA5 reanalysis on a 0.25° grid, 35 to 72°N and 12.5°W to 40°E. AIFS 2: 171 days, 23 May 2026 to 9 November 2026. Other AI models: 108 days. AIFS 2 against IFS and GFS: RMSE lower in 4 of 8 tested comparisons, higher in 0, not separated in 4. ERA5 is a model product and AIFS was trained mostly on it, so this is a second view, not a measurement. - [Tracking](https://meteosignal.com/tracking/): monthly RMSE of each model relative to IFS. Point scores without intervals; not tested. - [All results as plain text](https://meteosignal.com/results.md) ## Method - [Method, sources and credits](https://meteosignal.com/method/): station choice, samples, baselines, intervals, verdict rules, robustness checks, source data and their licences. ## Data - [datapackage.json](https://meteosignal.com/scores/datapackage.json): read this first. It describes every file and column (type, meaning, unit, allowed values) and lists the rules for reading the numbers, in the Frictionless Data Package format. - [meteosignal-stations-scores.csv](https://meteosignal.com/scores/meteosignal-stations-scores.csv): Scores at the stations and the tower. 1608 rows; each row carries its unit, sample and data version. - [meteosignal-stations-aifs-vs-models.csv](https://meteosignal.com/scores/meteosignal-stations-aifs-vs-models.csv): AIFS against each other model at the stations and the tower. 588 rows; each row carries its unit, sample and data version. - [meteosignal-era5-scores.csv](https://meteosignal.com/scores/meteosignal-era5-scores.csv): Scores against ERA5 over Europe. 450 rows; each row carries its unit, sample and data version. - [meteosignal-era5-aifs-vs-models.csv](https://meteosignal.com/scores/meteosignal-era5-aifs-vs-models.csv): AIFS against each other model, against ERA5 over Europe. 270 rows; each row carries its unit, sample and data version. - [Data page](https://meteosignal.com/scores/): the same for people, with licence and citation. - [Summary sheet](https://meteosignal.com/scores/summary/): the results on one page for people, every sentence built from the files above; prints as two A4 pages. ## Licence and citation Results and text: CC BY 4.0, https://creativecommons.org/licenses/by/4.0/. Code: MIT. Cite as: Soltanzadeh, I. (2026). MeteoSignal: verification of open weather forecasts over Europe. Data version 16 November 2026, run 20261116T194902Z. https://meteosignal.com/