Someday we'll get there, someday.
e.g. Right now the UK grid is running on just over 80%+ renewable. But when the wind isn't cooperating french nuclear helps.
Broad reliance on renewables just doesn't work without interconnects across large geo regions
The repo linked “seeks to complement the tools currently used in the TYNDP cycles, especially for Scenario Building (SB) and Cost-Benefit Analysis (CBA). This approach is designed to enhance transparency and lower barriers to stakeholder participation in European energy planning. Beyond Europe, the project aspires to demonstrate the viability of open-source (OS) frameworks in energy planning, encouraging broader global adoption.
To build trust in and ensure reproducibility with the new open-source toolchain, the project first focuses on replicating key figures from the 2024 TYNDP cycle, before aligning with the current 2026 TYNDP cycle. This process involves developing new features within the open-source domain to address existing gaps, integrating tools for data interoperability and dynamic visualizations, and publishing best practices to encourage the adoption of open energy models.”
Why this report is shared appears to be an application of PyPSA for others to reference and become inspired by its implementation.
Why it’s open source I think is clear from the above paragraph. Open source standards make it drastically easier to harmonise and collaborate while allowing as much engagement as possible to scrutinise the framework.
The moat on that is non existant.
What's the downside of open-sourcing this?
We should commend bureaucracies on the rare instance that they open-source their software, not ridicule them for it.
I think a good example is the Norwegian Meteorological Institute: https://github.com/metno (EEA, though, not real EU, but still)
It's not like all of it is useful for someone else, but it's the principle of it, and allowing people to see what their tax money (sometimes) goes to.
Also, I moved about 10 repos to a private Forgejo installation with pretty average (non-trivial) GH actions workflows. Zero repos has workflows running oob (java, .net, node). The moat is a bit there.
Let’s zoom in on your reply, the people who are interested and look at it and use it. What will they be able to do with it?
A feature, not a bug. If I go to a website meant to distribute source repos (git, etc), I expect them to be FOSS. Also, the title mentions 'EU Open Sources [...]' so this is irrelevant to the topic at hand.
Either way, perfect is the enemy of good, and this is good. You can find hypocrisy or lack of perfectionism anywhere.
I guess if the github UI becomes critical to their continued development or PR then they expose themselves to a potential rug pull by github/microsoft.
I do not know much about the project so I can not tell if that is concern or if there is some other concern at play here or if those concerns apply to this project or not.
Those are the types of details I wanted to see in the comment.
If I'm working in software development, the last thing I want to do is trust my coding workflow to an alpha-state platform.
Yay, sustainability!
Im personally down to try alpha software usually, i just havent found the need to retrain all my muscle memory to not use GH yet, as much as I hate it's owned by microsoft nowadays.
They also do offer pretty good "free tier" services for CI via Actions that otherwise you'd need to pay yourself
Also, some data create more benefits when being public: https://nworbmot.org/blog/open-grid-data.html (incl. data that increases certain risks)
Citations & Data:
[!WARNING] Open-TYNDP is under active development and is not yet feature-complete. The current development status and the general Limitations are important to understand before using the model.
This repository introduces the open model dataset of the Open-TYNDP research and innovation project, which is a collaboration between Open Energy Transition (OET) and the European Network of Transmission System Operators for Electricity (ENTSO-E). The project’s aim is to explore and consider the adoption of PyPSA in the Ten-Year Network Development Plan (TYNDP) by building a workflow based on PyPSA-Eur. It seeks to complement the tools currently used in the TYNDP cycles, especially for Scenario Building (SB) and Cost-Benefit Analysis (CBA). This approach is designed to enhance transparency and lower barriers to stakeholder participation in European energy planning. Beyond Europe, the project aspires to demonstrate the viability of open-source (OS) frameworks in energy planning, encouraging broader global adoption.
To build trust in and ensure reproducibility with the new open-source toolchain, the project first focuses on replicating key figures from the 2024 TYNDP cycle, before aligning with the current 2026 TYNDP cycle. This process involves developing new features within the open-source domain to address existing gaps, integrating tools for data interoperability and dynamic visualizations, and publishing best practices to encourage the adoption of open energy models. Additionally, the project emphasizes stakeholder consultations and interactive workshops alongside the development of the PyPSA tool, further promoting collaboration and transparency throughout the process.
This repository is a soft-fork of OET/PyPSA-Eur and contains the entire project Open-TYNDP supported by OET, including code and documentation. The philosophy behind this repository is that no intermediary results are included, but all results are computed from raw data and code.
This repository is maintained using OET's soft-fork strategy. OET's primary aim is to contribute as much as possible to the open-source upstream repositories. For long-term changes that cannot be directly merged upstream, the strategy organizes and maintains OET forks, ensuring they remain up-to-date and compatible with upstream on a regular basis, while also supporting future contributions back to the OS repositories.
Warning: Open-TYNDP is under active development and is not yet feature-complete. The current development status and general Limitations are important to understand before using the model. The model includes partial data from the TYNDP 2024 cycle, and its validation is ongoing. The github repository issues collect known topics we are working on (please feel free to help or make suggestions). The fact that this project relies on a soft-fork strategy implies that upstream issues need to be addressed in the PyPSA-Eur repository. The documentation also remains work in progress.
benchmarks: will store snakemake benchmarks (does not exist initially)config: configurations used in the studycutouts: will store raw weather data cutouts from atlite (does not exist initially)data: includes input data that is not produced by any snakemake ruledoc: includes all files necessary to build the readthedocs documentation of PyPSA-Eurenvs: includes backup conda environments if pixi installation does not work.logs: will store log files (does not exist initially)notebooks: includes all the notebooks used for ad-hoc analysisreport: contains all files necessary to build the report; plots and result files are generated automaticallyrules: includes all the snakemakerules loaded in the Snakefileresources: will store intermediate results of the workflow which can be picked up again by subsequent rules (does not exist initially)results: will store the solved PyPSA network data, summary files and plots (does not exist initially)scripts: includes all the Python scripts executed by the snakemake rules to build the modelFor Windows users, download the latest installer (e.g., open-tyndp-0.4.0-pixi-Windows-x86_64.exe) from the releases page and run it. The installer automatically sets up everything you need, including pixi, the repository, and the conda environment. See utils/windows-installer/README.md for details.
Clone the repository:
git clone https://github.com/open-energy-transition/open-tyndp
PyPSA-Eur, and consequently Open-TYNDP, relies on a set of other Python packages to function. We manage these using pixi. Once pixi is installed, you can activate the project environment for your operating system and have access to all the PyPSA-Eur dependencies from the command line:
pixi shell -e open-tyndp
[!NOTE]
pixiwill create a distinct environment in every project directory, even if you have identical copies of a project cloned locally. As there is a common system-level package cache,pixiefficiently conserves disk space in such cases.
[!TIP] If
pixiisn't working, you can install from one of the fallbackcondaenvironment files found inenvs. For more details see the PyPSA-Eur installation guide.
To run all analysis steps of the Scenario Building to reproduce results and build the report, you can execute:
pixi run tyndp-sb
To list all the rules that need to be executed (dry run), run:
pixi run tyndp-sb -n
Similarly, to run all steps of the Cost-Benefit Analysis, you can execute:
pixi run tyndp-cba
and append -n for the corresponding dry run:
pixi run tyndp-cba -n
[!TIP] Dependency graphs can be built by a dedicated pixi task and saved to the
resources/directory. Since this can grow very large for the full list of scenarios, you can restrict it to a single scenario:pixi run create-tyndp-graphs --config 'run={"name":"NT"}'
We strongly welcome anyone interested in contributing to this project. If you have any ideas, suggestions or encounter problems, feel invited to file issues or make pull requests on GitHub.
For any questions about Open-TYNDP or other queries, reach out via the pypsa-open-tyndp channel or tyndp@openenergytransition.org.
Sign Up for the project newsletter for updates!
If you want to cite a specific Open-TYNDP version, since v0.5, each release is archived on Zenodo with a release-specific DOI:
Versions v0.5 and v0.5.1 are archived at 10.5281/zenodo.18494362.
If you use Open-TYNDP in your research, please cite it as shown on Zenodo or using the "Cite this repository" button in the sidebar of Open-TYNDP.
This work builds upon PyPSA-Eur and follows the methodology described in ENTSO-E's and ENTSOG's TYNDP 2024 Scenarios Methodology Report.
Open-TYNDP is a soft-fork of PyPSA-Eur, relying on a similar licensing strategy. As with PyPSA-Eur, the code in Open-TYNDP is released as free software under the
MIT License, see Licenses for attribution and licensing strategy details.
Additionally, different licenses and terms of use may apply to the various
input data, see Data Sources.