-
Notifications
You must be signed in to change notification settings - Fork 38
[fixed] WUS Integration #687
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
ktehranchi
wants to merge
155
commits into
PyPSA:develop
Choose a base branch
from
ktehranchi:kt-mch-wus-fix
base: develop
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sync develop to master
Demand Response by Sector
Sector Demand Response Hotfix
for more information, see https://pre-commit.ci
Add Clustering weighting_strategy feature
Adds downstream ch4 tracking and updates associated configuration documentation.
* update dag (PyPSA#517) Update DAGs for documentation site * added for loop around the solve_network. New myopic and perfect foresight if statements in the solve_network function to pull the foresight type from a config file. Foresight type option still needs to be added to the repo_data/config/ files, as it is just manually added into the workflow/config currently to avoid init_pypsa_usa.sh reuse. With precommit fixes. * fixed errors with pulling the myopic foresight from config file, model running, gives same results as without myopic since we are not pulling from prior timesteps * moved for loop inside of the solve_network, removed the add_myopic constraint * first working version, no bugs, runs fully. needs checks to see if output matches expectations. output does combine first year with the existing infrastructure (need to fix). added in the time dependent components. added a limited part of c in the c.iterate_components, to just include what was in the previous timestep. * fixed the limited c.df to be for build years below the investment horizon, previously was years equal to the investment horizon * made it so that the links are properly removed, since their build year is 0 * first successful version to have results for all decades, needs first level checks but is giving reasonable results for myopic output. Key change was creating a deep copy of the c.pnl and adding all rather than just input time variables back in after removal * fixed the loop to be inclusive for c_lim rather than less than the planning horizon * updated the configtables documentation * Fix clim, other fix for perf foresight. * RPS updates * fixed the retirement issue for one time horizon * updated to m.add to carry over the custom fields * added the storage state_of_charge rollover, but this is leading to infeasible solve, need to fix * changed state of charge to just be the final snapshot, now feasible * updated the config files in repo_data, and the docs to show that myopic is available * n.madd for generators so that the attributes carry over. this is a fix that likely isnt ideal in the long run, but n.add doesn't carry these attributes over * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Co-authored-by: Trevor Barnes <[email protected]> Co-authored-by: ktehranchi <[email protected]> Co-authored-by: Jones <[email protected]> Co-authored-by: Kamran Tehranchi <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Add lifetimes and build rates for sector technologies
* update dag (PyPSA#517) Update DAGs for documentation site * [pre-commit.ci] pre-commit autoupdate updates: - [github.com/pycqa/isort: 5.13.2 → 6.0.0](PyCQA/isort@5.13.2...6.0.0) - [github.com/asottile/pyupgrade: v3.19.0 → v3.19.1](asottile/pyupgrade@v3.19.0...v3.19.1) - [github.com/psf/black-pre-commit-mirror: 24.10.0 → 25.1.0](psf/black-pre-commit-mirror@24.10.0...25.1.0) * new linting * [pre-commit.ci] pre-commit autoupdate updates: - [github.com/astral-sh/ruff-pre-commit: v0.1.4 → v0.9.9](astral-sh/ruff-pre-commit@v0.1.4...v0.9.9) * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * [pre-commit.ci] pre-commit autoupdate updates: - [github.com/astral-sh/ruff-pre-commit: v0.9.9 → v0.9.10](astral-sh/ruff-pre-commit@v0.9.9...v0.9.10) * [pre-commit.ci] pre-commit autoupdate updates: - [github.com/astral-sh/ruff-pre-commit: v0.9.10 → v0.11.0](astral-sh/ruff-pre-commit@v0.9.10...v0.11.0) * [pre-commit.ci] pre-commit autoupdate (PyPSA#579) updates: - [github.com/snakemake/snakefmt: v0.10.2 → v0.11.0](snakemake/snakefmt@v0.10.2...v0.11.0) - [github.com/astral-sh/ruff-pre-commit: v0.11.0 → v0.11.5](astral-sh/ruff-pre-commit@v0.11.0...v0.11.5) Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * correct notebooks for precommit --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Kamran Tehranchi <[email protected]> Co-authored-by: ktehranchi <[email protected]>
* fix filter components for single horizon * store erm duals * write tests and refactor * fix tests, still errors on reserves * fix filter components for single horizon * store erm duals * write tests and refactor * fix tests, still errors on reserves * Functionalize brownfield for myopic * Fix ERM and test for ERM * remove defunct AI writen tests * ERM link support, all timesteps, rm duplicate function * Address comments * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * docs to run test --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Adds REM Unit Test * Adds RPS unit tests * Adds TCT unit test
* fix missing SD zone, and pudl path bug * rm unnec conditional
* Refactor RPS to enable REC sharing * Move build_powerplants out of run dependency
* Trim Network with external imports * Fix plotting issues with split * Fixes Policy Opts for Myopic foresight
* add sorting for diff * split data query functions, and sort outputs for diffs * Adds Planned and Retired Generators to BPP, change filtering logic in add_ele * Bump Pudl version to v2025.5.0 * Fix plants filtering dates
* globalconstraint hotfix * change co2 constraint --------- Co-authored-by: tmb8 <[email protected]>
Co-authored-by: tmb8 <[email protected]>
* `v0.6.0` Release Candidate (PyPSA#594) * fix plot bug * Update mem reqs, fix TCT bug * update scenario comparison * update get_region_buses to include reeds zone id * dr by carrier components * dr constraint update * correct conditional * docs update * fix docs * dr sector hotfix * Adds population weighting strategy for simplify and cluster * update default config * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Remove virtual buses * update tct logic * tct note in docs * update comment * add assertion * typo * dr implementation * plotting runs * carrier added * dr constraint templated * power sector runs * plotting updates * config updates * update dr docs * update TCT constraint name * cluster config updates * typo * update dependencies * fix scenario comparison * Update pre-commit config to use Ruff for formatting and linting * update linting options * Update pre-commit config to use Ruff for formatting and linting * ruff re-formating * new linting * rm isort conf * rm old docs page * reorganize repo_data/geospatial * clean repo_data * Add UV install support! PyPSA#483 * update uv env * add uv pyproj * add lock file * update docs for UV * fix bug from refactor * bug fix from refactor * minor corrections * remove unused config, and set dynamic memory resource request by input file size * cop fixed * natural gas done * sector costs * stock data * constants updated * corrects eulp * more fixes * dynamically set memory allocation by file size * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * eia fix * update solve elec rule mem * demand updated * valiadation plots linted * fix type hints * add uv and ruff badges * sector plots update * env updates * update dev dependency * minor fixes * dev dependency update * fix sankey file extension * sector costs hotfix * fix nan in efficiency2 * typo * handle no-data scenarios * Modify battery efficiencies to align with NREL ATB * Reference PUDL s3 Parquests, Add PUDL versioning * refactor PRM * remove SAFE, change SAFER name to PRM * co2 constraints updated * update constraint name * tct update * correct pudl path * PRM fixes * docs * docs * refactor OSW implementation (PyPSA#577) * conditional for multi-period (PyPSA#581) * Sector Marginal Cost Updates (PyPSA#557) * eia fuel cost extraction updated * trn production plots update * furnace efficiency update * central marginal cost stores * dynamic cost scaling * methane tracking always on * correct marginal cost conversions * update lpg vehicle efficiency * ev policy implemented for endogenous investment * plotting color fix * conditional for multi-period (PyPSA#582) * minor plotting updates (PyPSA#586) * sector RPS (PyPSA#575) * Correct Linepack Calculation and CECS Build Years (PyPSA#589) * correct linepack calc * correct commercial water heaters * Downstream Methane Leaks (PyPSA#590) Adds downstream ch4 tracking and updates associated configuration documentation. * Issue 518 - Myopic Implementation (PyPSA#554) * update dag (PyPSA#517) Update DAGs for documentation site * added for loop around the solve_network. New myopic and perfect foresight if statements in the solve_network function to pull the foresight type from a config file. Foresight type option still needs to be added to the repo_data/config/ files, as it is just manually added into the workflow/config currently to avoid init_pypsa_usa.sh reuse. With precommit fixes. * fixed errors with pulling the myopic foresight from config file, model running, gives same results as without myopic since we are not pulling from prior timesteps * moved for loop inside of the solve_network, removed the add_myopic constraint * first working version, no bugs, runs fully. needs checks to see if output matches expectations. output does combine first year with the existing infrastructure (need to fix). added in the time dependent components. added a limited part of c in the c.iterate_components, to just include what was in the previous timestep. * fixed the limited c.df to be for build years below the investment horizon, previously was years equal to the investment horizon * made it so that the links are properly removed, since their build year is 0 * first successful version to have results for all decades, needs first level checks but is giving reasonable results for myopic output. Key change was creating a deep copy of the c.pnl and adding all rather than just input time variables back in after removal * fixed the loop to be inclusive for c_lim rather than less than the planning horizon * updated the configtables documentation * Fix clim, other fix for perf foresight. * RPS updates * fixed the retirement issue for one time horizon * updated to m.add to carry over the custom fields * added the storage state_of_charge rollover, but this is leading to infeasible solve, need to fix * changed state of charge to just be the final snapshot, now feasible * updated the config files in repo_data, and the docs to show that myopic is available * n.madd for generators so that the attributes carry over. this is a fix that likely isnt ideal in the long run, but n.add doesn't carry these attributes over * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Co-authored-by: Trevor Barnes <[email protected]> Co-authored-by: ktehranchi <[email protected]> Co-authored-by: Jones <[email protected]> Co-authored-by: Kamran Tehranchi <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> * Add lifetimes and build rates for sector studies (PyPSA#593) Add lifetimes and build rates for sector technologies * Corrects `v0.6.0` merge conflicts (PyPSA#595) * update dag (PyPSA#517) Update DAGs for documentation site * [pre-commit.ci] pre-commit autoupdate updates: - [github.com/pycqa/isort: 5.13.2 → 6.0.0](PyCQA/isort@5.13.2...6.0.0) - [github.com/asottile/pyupgrade: v3.19.0 → v3.19.1](asottile/pyupgrade@v3.19.0...v3.19.1) - [github.com/psf/black-pre-commit-mirror: 24.10.0 → 25.1.0](psf/black-pre-commit-mirror@24.10.0...25.1.0) * new linting * [pre-commit.ci] pre-commit autoupdate updates: - [github.com/astral-sh/ruff-pre-commit: v0.1.4 → v0.9.9](astral-sh/ruff-pre-commit@v0.1.4...v0.9.9) * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * [pre-commit.ci] pre-commit autoupdate updates: - [github.com/astral-sh/ruff-pre-commit: v0.9.9 → v0.9.10](astral-sh/ruff-pre-commit@v0.9.9...v0.9.10) * [pre-commit.ci] pre-commit autoupdate updates: - [github.com/astral-sh/ruff-pre-commit: v0.9.10 → v0.11.0](astral-sh/ruff-pre-commit@v0.9.10...v0.11.0) * [pre-commit.ci] pre-commit autoupdate (PyPSA#579) updates: - [github.com/snakemake/snakefmt: v0.10.2 → v0.11.0](snakemake/snakefmt@v0.10.2...v0.11.0) - [github.com/astral-sh/ruff-pre-commit: v0.11.0 → v0.11.5](astral-sh/ruff-pre-commit@v0.11.0...v0.11.5) Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * correct notebooks for precommit --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Kamran Tehranchi <[email protected]> Co-authored-by: ktehranchi <[email protected]> --------- Co-authored-by: ktehranchi <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Kamran Tehranchi <[email protected]> Co-authored-by: Wei Ai <[email protected]> Co-authored-by: Lyssa Freese <[email protected]> Co-authored-by: Jones <[email protected]> # Conflicts: # uv.lock # workflow/envs/dev.yaml # workflow/repo_data/config/config.common.yaml # workflow/rules/build_electricity.smk # workflow/run_slurm.sh # workflow/scripts/add_electricity.py # workflow/scripts/add_extra_components.py # workflow/scripts/build_fuel_prices.py # workflow/scripts/build_powerplants.py # workflow/scripts/simplify_network.py # workflow/scripts/solve_network.py # workflow/snakemake_profiles/slurm/config.yaml * [pre-commit.ci] pre-commit autoupdate (PyPSA#597) updates: - [github.com/astral-sh/ruff-pre-commit: v0.11.5 → v0.11.8](astral-sh/ruff-pre-commit@v0.11.5...v0.11.8) Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> * [pre-commit.ci] pre-commit autoupdate (PyPSA#600) updates: - [github.com/astral-sh/ruff-pre-commit: v0.11.8 → v0.11.10](astral-sh/ruff-pre-commit@v0.11.8...v0.11.10) Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> * Enable state-level power sector modeling. State level transmission data generated from reeds_ba level data aggregation (see issue 609). --------- Co-authored-by: Trevor Barnes <[email protected]> Co-authored-by: ktehranchi <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Kamran Tehranchi <[email protected]> Co-authored-by: Lyssa Freese <[email protected]> Co-authored-by: Jones <[email protected]>
Co-authored-by: tmb8 <[email protected]>
Collaborator
Author
|
Outstanding issues with this:
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Resolves conflicts from #631 :