Data Handler Refactor, bias and exo algorithm update, other misc changes

What’s Changed

• Gb/bias nc (#181) @grantbuster
• bug fix with negative test for dual DH operating on data handlers tha… (#179) @grantbuster
• Bnb/ddh norm (#180) @bnb32
• Significant refactor on handling of feature names in DataHandler and model (#178) @grantbuster
• stdev and mean hot fix (#177) @bnb32
• fix get_clearsky_ghi function to use correct time slice (#176) @spodgorny9
• Bnb/dev (#173) @bnb32
• Bnb/nc collector (#175) @bnb32
• Add ability to specify duplicate command names in Pipeline (#174) @ppinchuk
• Bnb/train only features hot fix (#171) @bnb32

Exogenous data refactor with breaking changes. Dual data handling. GAPS integration.

Refactored exogenous data handling in the forward pass and training. This enabled deletion of some specialized models, which creates breaking changes.

Dual data handler added for using different datasets for low res and high res data for training. For example, low_res = ERA5 data and high_res = WTK.

GAPS integration for command line interface and job handling. Allowed removal of reV dependency.

What's Changed

• Bnb/dev by @bnb32 in #148
• WindGanDC model by @bnb32 in #150
• Bnb/bc smoothing by @bnb32 in #151
• Bnb/dev by @bnb32 in #152
• Bug fix for conditional moment with topography by @malihass in #149
• Use multi gpu for conditional moment estimation by @malihass in #157
• Bnb/log interp by @bnb32 in #155
• Gb/skill by @grantbuster in #163
• Bnb/h5 with era training by @bnb32 in #162
• Bnb/dual dh patch by @bnb32 in #164
• Bnb/ws power law by @bnb32 in #165
• bug fix on bias calc object initialization named args and cli parsing by @grantbuster in #166
• Bnb/exo refactor by @bnb32 in #167
• GAPs integration by @ppinchuk in #168
• Bnb/exo refactor plus by @bnb32 in #169
• Update version.py by @bnb32 in #170

New Contributors

• @ppinchuk made their first contribution in #168

Full Changelog: v0.1.0...v0.1.1

python 3.7 deprecation. ERA5 data handling. exogenous data caching. sup3rcc examples. various conditional moment enhancements.

What’s Changed

• Various enhancements and fix for conditional moment (#144) @malihass
• Gb/sup3rcc example (#147) @grantbuster
• Bnb/era edits (#146) @bnb32
• Gb/exo cache (#145) @grantbuster

Bug Fixes

• edge case fix for collection - get_slices (#143) @bnb32

Temporal extremes loss for Temp+Humidity for Sup3rCC

What’s Changed

• Gb/trh loss (#142) @grantbuster

Initial Sup3rCC data version and misc features

What’s Changed

• Bnb/dev (#141) @bnb32
• added temporal then spatial model with test (#140) @grantbuster
• Gb/multi gpu (#138) @grantbuster
• Bnb/dev (#137) @bnb32
• Gb/solar spatial (#139) @grantbuster
• fixed multi step meta, list(dict) does not preserve the dict (#136) @grantbuster
• Gb/qa min max (#135) @grantbuster
• Bnb/dev (#134) @bnb32

Minor refactors and improved fwp parallelization

What’s Changed

• Bnb/visual qa (#130) @bnb32
• Gb/more run attrs (#133) @grantbuster
• Parallel optimization (#132) @grantbuster
• fixed weird logic and put sketchy info message in if statement (#131) @grantbuster

Statistical moment estimation and other minor features

What’s Changed

• Gb/sup3rcc configs (#129) @grantbuster
• Bnb/dev (#128) @bnb32
• Gb/bc cs ratio (#127) @grantbuster
• Conditional moment calculation (#126) @malihass
• Option to train second moment separately from first moment (#125) @malihass
• Gb/nc chunks (#124) @grantbuster
• added unstagger check for height calc (#121) @bnb32
• changed fwp to use cropped time index from data handler to compute high … (#119) @bnb32
• Bnb/dev (#117) @bnb32
• Fix Sup3rGan interface (#118) @malihass
• separate Sup3rGen and Sup3rGan (#116) @malihass
• renamed get_handler_stdev (#115) @bnb32

New features for performance and production runs

What’s Changed

• moved meta collection out of a for loop - doesnt need to happen for e… (#114) @grantbuster
• Enable creating models from "model_params.json" (#111) @malihass
• drop gid column from final meta csv - this column is often included i… (#112) @grantbuster
• Bnb/async fwp (#110) @bnb32
• Avoid unnecessary retracing (#109) @malihass
• Bnb/dev (#108) @bnb32
• Bnb/dev (#107) @bnb32
• Bnb/dev (#106) @bnb32

New wind model, linear interp model, and temperature min max features

What’s Changed

• Gb/linear model (#105) @grantbuster
• Gb/surf min max (#103) @grantbuster
• Bnb/dev (#102) @bnb32
• Gb/hr exo (#100) @grantbuster
• Bnb/dev (#101) @bnb32
• Gb/wind topo (#99) @grantbuster

New features for solar and wind CC, input bias correction, and output stats

What’s Changed

• Bnb/dev (#98) @bnb32
• Gb/wind cc (#97) @grantbuster
• Gb/bc (#96) @grantbuster
• Bnb/dev (#95) @bnb32
• Bnb/stats (#94) @bnb32
• added simple feature to allow for incremental progress if fwp chunks … (#93) @grantbuster
• Gb/solar module (#92) @grantbuster