data.datasets.final_validations.FinalValidations.__init__() - Code Metrics - Inspection of "feature/validation_integration" - openego/eGon-data - Measure and Improve Code Quality continuously with Scrutinizer

Passed
Pull Request — dev (#1375)

unknown
created 2026-01-19 10:52 UTC
FinalValidations.init() B

↳ Parent: data.datasets.final_validations
Complexity

Conditions
Size

Total Lines	1684
Code Lines	1267
Duplication

Lines	0
Ratio	0 %
Importance

Changes
Metric	Value
eloc	1267
dl	0
loc	1684
rs	7
c	0
b	0
f	0
cc	1
nop	2
How to fix Long Method

"""
Dataset for cross-cutting validations that run at the end of the pipeline.

This module provides the FinalValidations dataset which contains validation rules
that check data consistency across multiple datasets. These validations should run
after all data generation is complete, but before the final validation report.
"""

from egon.data.datasets import Dataset
from egon.data.validation.rules.custom.sanity import (
    CH4StoresCapacity,
    H2SaltcavernStoresCapacity,
    GasBusesIsolated,
    GasBusesCount,
    GasOnePortConnections,
    CH4GridCapacity,
    GasLinksConnections,
    GasLoadsCapacity,
    GasGeneratorsCapacity,
    ElectricityCapacityComparison,
    HeatDemandValidation,
    ElectricalLoadSectorBreakdown,
)
from egon_validation import (
    ArrayCardinalityValidation,
    ElectricalLoadAggregationValidation,
    RowCountValidation,
    DataTypeValidation,
    NotNullAndNotNaNValidation,
    WholeTableNotNullAndNotNaNValidation,
    ValueSetValidation,
    SRIDUniqueNonZero
)


def notasks():
    """
    Placeholder task function.

    This dataset has no data generation tasks - it only runs validation rules
    defined in the validation dict. The validation framework automatically creates
    validation tasks from the rules.

    Returns
    -------
    None
    """
    return None


class FinalValidations(Dataset):
    """
    Cross-cutting validations that run at the end of the pipeline.

    This dataset contains validation rules that check data consistency across
    multiple datasets and should run after all data generation is complete.

    The validations are organized by category and run automatically as part of
    the dataset's validation tasks. Results are collected by ValidationReport.

    *Dependencies*
      Should depend on all datasets whose data is validated by the rules
      defined here. At minimum:
      * CH4Storages - for CH4 store capacity validation
      * HydrogenStoreEtrago - for H2 saltcavern store validation
      * Add more as you add validation rules

    *Validation Results*
      Results are written to validation_runs/{run_id}/tasks/FinalValidations.validate.*/
      and collected by the ValidationReport dataset

    *Adding New Validations*
      To add new cross-cutting validations:
      1. Create the validation rule class in validation/rules/custom/sanity/
      2. Import it at the top of this file
      3. Add instances to the appropriate category in the validation dict below
      4. Update dependencies to include datasets that provide the data being validated

    Example
    -------
    To add a new gas grid validation:

    ```python
    from egon.data.validation.rules.custom.sanity import CH4GridCapacity

    # In the validation dict:
    "gas_stores": [
        # ... existing rules ...
        CH4GridCapacity(
            table="grid.egon_etrago_link",
            rule_id="SANITY_CH4_GRID_CAPACITY",
            scenario="eGon2035"
        ),
    ]
    ```
    """

    #:
    name: str = "FinalValidations"
    #:
    version: str = "0.0.1.dev"

    def __init__(self, dependencies):
        super().__init__(
            name=self.name,
            version=self.version,
            dependencies=dependencies,
            tasks=(notasks,),  # No data tasks - only validation tasks
            validation={
                # Gas store capacity validations
                # These check that CH4 and H2 store capacities match expected values
                "gas_stores": [
                    # CH4 stores - eGon2035
                    CH4StoresCapacity(
                        table="grid.egon_etrago_store",
                        rule_id="SANITY_CH4_STORES_CAPACITY_EGON2035",
                        scenario="eGon2035",
                        rtol=0.02
                    ),
                    # CH4 stores - eGon100RE
                    CH4StoresCapacity(
                        table="grid.egon_etrago_store",
                        rule_id="SANITY_CH4_STORES_CAPACITY_EGON100RE",
                        scenario="eGon100RE",
                        rtol=0.02
                    ),
                    # H2 saltcavern stores - eGon2035
                    H2SaltcavernStoresCapacity(
                        table="grid.egon_etrago_store",
                        rule_id="SANITY_H2_SALTCAVERN_STORES_CAPACITY_EGON2035",
                        scenario="eGon2035",
                        rtol=0.02
                    ),
                    # H2 saltcavern stores - eGon100RE
                    H2SaltcavernStoresCapacity(
                        table="grid.egon_etrago_store",
                        rule_id="SANITY_H2_SALTCAVERN_STORES_CAPACITY_EGON100RE",
                        scenario="eGon100RE",
                        rtol=0.02
                    ),
                ],

                # Gas grid bus validations
                # These check that gas buses are properly connected and counts match expectations
                "gas_grid": [
                    # Check for isolated CH4 buses - eGon2035
                    GasBusesIsolated(
                        table="grid.egon_etrago_bus",
                        rule_id="SANITY_GAS_BUSES_ISOLATED_CH4_EGON2035",
                        scenario="eGon2035",
                        carrier="CH4"
                    ),
                    # Check for isolated H2_grid buses - eGon2035
                    GasBusesIsolated(
                        table="grid.egon_etrago_bus",
                        rule_id="SANITY_GAS_BUSES_ISOLATED_H2_GRID_EGON2035",
                        scenario="eGon2035",
                        carrier="H2_grid"
                    ),
                    # Check for isolated H2_saltcavern buses - eGon2035
                    GasBusesIsolated(
                        table="grid.egon_etrago_bus",
                        rule_id="SANITY_GAS_BUSES_ISOLATED_H2_SALTCAVERN_EGON2035",
                        scenario="eGon2035",
                        carrier="H2_saltcavern"
                    ),
                    # NOTE: eGon100RE gas bus isolated checks are commented out
                    # because they are also commented out in the original sanity_checks.py
                    # (lines 1435-1439). Uncomment when eGon100RE gas bus data is ready.
                    # # Check for isolated CH4 buses - eGon100RE
                    # GasBusesIsolated(
                    #     table="grid.egon_etrago_bus",
                    #     rule_id="SANITY_GAS_BUSES_ISOLATED_CH4_EGON100RE",
                    #     scenario="eGon100RE",
                    #     carrier="CH4"
                    # ),
                    # # Check for isolated H2_grid buses - eGon100RE
                    # GasBusesIsolated(
                    #     table="grid.egon_etrago_bus",
                    #     rule_id="SANITY_GAS_BUSES_ISOLATED_H2_GRID_EGON100RE",
                    #     scenario="eGon100RE",
                    #     carrier="H2_grid"
                    # ),
                    # # Check for isolated H2_saltcavern buses - eGon100RE
                    # GasBusesIsolated(
                    #     table="grid.egon_etrago_bus",
                    #     rule_id="SANITY_GAS_BUSES_ISOLATED_H2_SALTCAVERN_EGON100RE",
                    #     scenario="eGon100RE",
                    #     carrier="H2_saltcavern"
                    # ),
                    # Check CH4 bus count - eGon2035
                    GasBusesCount(
                        table="grid.egon_etrago_bus",
                        rule_id="SANITY_GAS_BUSES_COUNT_CH4_EGON2035",
                        scenario="eGon2035",
                        carrier="CH4",
                        rtol=0.10
                    ),
                    # Check H2_grid bus count - eGon2035
                    GasBusesCount(
                        table="grid.egon_etrago_bus",
                        rule_id="SANITY_GAS_BUSES_COUNT_H2_GRID_EGON2035",
                        scenario="eGon2035",
                        carrier="H2_grid",
                        rtol=0.10
                    ),
                    # NOTE: eGon100RE gas bus count checks are commented out
                    # because sanity_check_gas_buses() is only called for eGon2035 (line 1943)
                    # # Check CH4 bus count - eGon100RE
                    # GasBusesCount(
                    #     table="grid.egon_etrago_bus",
                    #     rule_id="SANITY_GAS_BUSES_COUNT_CH4_EGON100RE",
                    #     scenario="eGon100RE",
                    #     carrier="CH4",
                    #     rtol=0.10
                    # ),
                    # # Check H2_grid bus count - eGon100RE
                    # GasBusesCount(
                    #     table="grid.egon_etrago_bus",
                    #     rule_id="SANITY_GAS_BUSES_COUNT_H2_GRID_EGON100RE",
                    #     scenario="eGon100RE",
                    #     carrier="H2_grid",
                    #     rtol=0.10
                    # ),
                    # Check CH4 grid capacity - eGon2035
                    CH4GridCapacity(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_CH4_GRID_CAPACITY_EGON2035",
                        scenario="eGon2035",
                        rtol=0.10
                    ),
                    # Check CH4 grid capacity - eGon100RE
                    CH4GridCapacity(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_CH4_GRID_CAPACITY_EGON100RE",
                        scenario="eGon100RE",
                        rtol=0.10
                    ),
                ],

                # Gas one-port component connection validations
                # These check that loads, generators, and stores are connected to valid buses
                "gas_one_port": [
                    # LOADS - eGon2035
                    # CH4_for_industry loads in Germany must connect to CH4 buses
                    GasOnePortConnections(
                        table="grid.egon_etrago_load",
                        rule_id="SANITY_GAS_ONE_PORT_LOAD_CH4_FOR_INDUSTRY_DE_EGON2035",
                        scenario="eGon2035",
                        component_type="load",
                        component_carrier="CH4_for_industry",
                        bus_conditions=[("CH4", "= 'DE'")]
                    ),
                    # CH4 loads abroad must connect to CH4 buses outside Germany
                    GasOnePortConnections(
                        table="grid.egon_etrago_load",
                        rule_id="SANITY_GAS_ONE_PORT_LOAD_CH4_ABROAD_EGON2035",
                        scenario="eGon2035",
                        component_type="load",
                        component_carrier="CH4",
                        bus_conditions=[("CH4", "!= 'DE'")]
                    ),
                    # H2_for_industry loads must connect to H2_grid in DE or AC abroad
                    GasOnePortConnections(
                        table="grid.egon_etrago_load",
                        rule_id="SANITY_GAS_ONE_PORT_LOAD_H2_FOR_INDUSTRY_EGON2035",
                        scenario="eGon2035",
                        component_type="load",
                        component_carrier="H2_for_industry",
                        bus_conditions=[("H2_grid", "= 'DE'"), ("AC", "!= 'DE'")]
                    ),

                    # GENERATORS - eGon2035
                    # CH4 generators must connect to CH4 buses (any country)
                    GasOnePortConnections(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_GAS_ONE_PORT_GENERATOR_CH4_EGON2035",
                        scenario="eGon2035",
                        component_type="generator",
                        component_carrier="CH4",
                        bus_conditions=[("CH4", "")]  # Any CH4 bus, no country filter
                    ),

                    # STORES - eGon2035
                    # CH4 stores must connect to CH4 buses (any country)
                    GasOnePortConnections(
                        table="grid.egon_etrago_store",
                        rule_id="SANITY_GAS_ONE_PORT_STORE_CH4_EGON2035",
                        scenario="eGon2035",
                        component_type="store",
                        component_carrier="CH4",
                        bus_conditions=[("CH4", "")]  # Any CH4 bus, no country filter
                    ),
                    # H2_underground stores must connect to H2_saltcavern buses (any country)
                    GasOnePortConnections(
                        table="grid.egon_etrago_store",
                        rule_id="SANITY_GAS_ONE_PORT_STORE_H2_UNDERGROUND_EGON2035",
                        scenario="eGon2035",
                        component_type="store",
                        component_carrier="H2_underground",
                        bus_conditions=[("H2_saltcavern", "")]  # Any H2_saltcavern bus, no country filter
                    ),
                    # H2_overground stores must connect to H2_saltcavern or H2_grid in DE
                    GasOnePortConnections(
                        table="grid.egon_etrago_store",
                        rule_id="SANITY_GAS_ONE_PORT_STORE_H2_OVERGROUND_EGON2035",
                        scenario="eGon2035",
                        component_type="store",
                        component_carrier="H2_overground",
                        bus_conditions=[("H2_saltcavern", "= 'DE'"), ("H2_grid", "= 'DE'")]
                    ),
                ],

                # Gas link connection validations
                # These check that gas links have both bus0 and bus1 connected to existing buses
                "gas_links": [
                    # CH4 links - eGon2035
                    GasLinksConnections(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_GAS_LINKS_CH4_EGON2035",
                        scenario="eGon2035",
                        carrier="CH4"
                    ),
                    # H2_feedin links - eGon2035
                    GasLinksConnections(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_GAS_LINKS_H2_FEEDIN_EGON2035",
                        scenario="eGon2035",
                        carrier="H2_feedin"
                    ),
                    # H2_to_CH4 links - eGon2035
                    GasLinksConnections(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_GAS_LINKS_H2_TO_CH4_EGON2035",
                        scenario="eGon2035",
                        carrier="H2_to_CH4"
                    ),
                    # CH4_to_H2 links - eGon2035
                    GasLinksConnections(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_GAS_LINKS_CH4_TO_H2_EGON2035",
                        scenario="eGon2035",
                        carrier="CH4_to_H2"
                    ),
                    # H2_to_power links - eGon2035
                    GasLinksConnections(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_GAS_LINKS_H2_TO_POWER_EGON2035",
                        scenario="eGon2035",
                        carrier="H2_to_power"
                    ),
                    # power_to_H2 links - eGon2035
                    GasLinksConnections(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_GAS_LINKS_POWER_TO_H2_EGON2035",
                        scenario="eGon2035",
                        carrier="power_to_H2"
                    ),
                    # OCGT links - eGon2035
                    GasLinksConnections(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_GAS_LINKS_OCGT_EGON2035",
                        scenario="eGon2035",
                        carrier="OCGT"
                    ),
                    # central_gas_boiler links - eGon2035
                    GasLinksConnections(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_GAS_LINKS_CENTRAL_GAS_BOILER_EGON2035",
                        scenario="eGon2035",
                        carrier="central_gas_boiler"
                    ),
                    # central_gas_CHP links - eGon2035
                    GasLinksConnections(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_GAS_LINKS_CENTRAL_GAS_CHP_EGON2035",
                        scenario="eGon2035",
                        carrier="central_gas_CHP"
                    ),
                    # central_gas_CHP_heat links - eGon2035
                    GasLinksConnections(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_GAS_LINKS_CENTRAL_GAS_CHP_HEAT_EGON2035",
                        scenario="eGon2035",
                        carrier="central_gas_CHP_heat"
                    ),
                    # industrial_gas_CHP links - eGon2035
                    GasLinksConnections(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_GAS_LINKS_INDUSTRIAL_GAS_CHP_EGON2035",
                        scenario="eGon2035",
                        carrier="industrial_gas_CHP"
                    ),
                ],

                # Gas loads and generators capacity validations
                # These check that gas demand and generation capacity match reference data
                "gas_loads_generators": [
                    # CH4_for_industry loads - eGon2035
                    GasLoadsCapacity(
                        table="grid.egon_etrago_load",
                        rule_id="SANITY_GAS_LOADS_CH4_FOR_INDUSTRY_EGON2035",
                        scenario="eGon2035",
                        carrier="CH4_for_industry",
                        rtol=0.10
                    ),
                    # H2_for_industry loads - eGon2035
                    GasLoadsCapacity(
                        table="grid.egon_etrago_load",
                        rule_id="SANITY_GAS_LOADS_H2_FOR_INDUSTRY_EGON2035",
                        scenario="eGon2035",
                        carrier="H2_for_industry",
                        rtol=0.10
                    ),
                    # CH4 generators - eGon2035
                    GasGeneratorsCapacity(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_GAS_GENERATORS_CH4_EGON2035",
                        scenario="eGon2035",
                        carrier="CH4",
                        rtol=0.10
                    ),
                ],

                # Electricity capacity validations
                # These check that distributed generator and storage capacities match input capacities
                "electricity_capacity": [
                    # GENERATORS - eGon2035
                    # Wind onshore
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_WIND_ONSHORE_EGON2035",
                        scenario="eGon2035",
                        carrier="wind_onshore",
                        component_type="generator",
                        rtol=0.10
                    ),
                    # Wind offshore
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_WIND_OFFSHORE_EGON2035",
                        scenario="eGon2035",
                        carrier="wind_offshore",
                        component_type="generator",
                        rtol=0.10
                    ),
                    # Solar
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_SOLAR_EGON2035",
                        scenario="eGon2035",
                        carrier="solar",
                        component_type="generator",
                        rtol=0.10
                    ),
                    # Solar rooftop
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_SOLAR_ROOFTOP_EGON2035",
                        scenario="eGon2035",
                        carrier="solar_rooftop",
                        component_type="generator",
                        rtol=0.10
                    ),
                    # Biomass (maps to multiple output carriers: biomass, industrial_biomass_CHP, central_biomass_CHP)
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_BIOMASS_EGON2035",
                        scenario="eGon2035",
                        carrier="biomass",
                        component_type="generator",
                        output_carriers=["biomass", "industrial_biomass_CHP", "central_biomass_CHP"],
                        rtol=0.10
                    ),
                    # Run of river
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_RUN_OF_RIVER_EGON2035",
                        scenario="eGon2035",
                        carrier="run_of_river",
                        component_type="generator",
                        rtol=0.10
                    ),
                    # Reservoir
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_RESERVOIR_EGON2035",
                        scenario="eGon2035",
                        carrier="reservoir",
                        component_type="generator",
                        rtol=0.10
                    ),
                    # Oil
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_OIL_EGON2035",
                        scenario="eGon2035",
                        carrier="oil",
                        component_type="generator",
                        rtol=0.10
                    ),
                    # Others
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_OTHERS_EGON2035",
                        scenario="eGon2035",
                        carrier="others",
                        component_type="generator",
                        rtol=0.10
                    ),

                    # STORAGE - eGon2035
                    # Pumped hydro
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_storage",
                        rule_id="SANITY_ELECTRICITY_STORAGE_PUMPED_HYDRO_EGON2035",
                        scenario="eGon2035",
                        carrier="pumped_hydro",
                        component_type="storage",
                        rtol=0.10
                    ),

                    # GENERATORS - eGon100RE
                    # Wind onshore
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_WIND_ONSHORE_EGON100RE",
                        scenario="eGon100RE",
                        carrier="wind_onshore",
                        component_type="generator",
                        rtol=0.10
                    ),
                    # Wind offshore
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_WIND_OFFSHORE_EGON100RE",
                        scenario="eGon100RE",
                        carrier="wind_offshore",
                        component_type="generator",
                        rtol=0.10
                    ),
                    # Solar
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_SOLAR_EGON100RE",
                        scenario="eGon100RE",
                        carrier="solar",
                        component_type="generator",
                        rtol=0.10
                    ),
                    # Solar rooftop
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_SOLAR_ROOFTOP_EGON100RE",
                        scenario="eGon100RE",
                        carrier="solar_rooftop",
                        component_type="generator",
                        rtol=0.10
                    ),
                    # Run of river
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_RUN_OF_RIVER_EGON100RE",
                        scenario="eGon100RE",
                        carrier="run_of_river",
                        component_type="generator",
                        rtol=0.10
                    ),
                    # Oil
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_OIL_EGON100RE",
                        scenario="eGon100RE",
                        carrier="oil",
                        component_type="generator",
                        rtol=0.10
                    ),
                    # Lignite
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_LIGNITE_EGON100RE",
                        scenario="eGon100RE",
                        carrier="lignite",
                        component_type="generator",
                        rtol=0.10
                    ),
                    # Coal
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_COAL_EGON100RE",
                        scenario="eGon100RE",
                        carrier="coal",
                        component_type="generator",
                        rtol=0.10
                    ),
                    # Solar thermal collector
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_SOLAR_THERMAL_EGON100RE",
                        scenario="eGon100RE",
                        carrier="urban_central_solar_thermal_collector",
                        component_type="generator",
                        output_carriers=["solar_thermal_collector"],
                        rtol=0.10
                    ),
                    # Geothermal
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_GEO_THERMAL_EGON100RE",
                        scenario="eGon100RE",
                        carrier="urban_central_geo_thermal",
                        component_type="generator",
                        output_carriers=["geo_thermal"],
                        rtol=0.10
                    ),
                    # Rural solar thermal
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_RURAL_SOLAR_THERMAL_EGON100RE",
                        scenario="eGon100RE",
                        carrier="rural_solar_thermal",
                        component_type="generator",
                        rtol=0.10
                    ),
                    # Urban central gas CHP
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_URBAN_GAS_CHP_EGON100RE",
                        scenario="eGon100RE",
                        carrier="urban_central_gas_CHP",
                        component_type="generator",
                        rtol=0.10
                    ),
                    # Urban central solid biomass CHP
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_ELECTRICITY_GENERATOR_BIOMASS_CHP_EGON100RE",
                        scenario="eGon100RE",
                        carrier="urban_central_solid_biomass_CHP",
                        component_type="generator",
                        rtol=0.10
                    ),

                    # LINKS - eGon100RE
                    # Central gas boiler
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_ELECTRICITY_LINK_CENTRAL_GAS_BOILER_EGON100RE",
                        scenario="eGon100RE",
                        carrier="urban_central_gas_boiler",
                        component_type="link",
                        output_carriers=["central_gas_boiler"],
                        rtol=0.10
                    ),
                    # Central heat pump
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_ELECTRICITY_LINK_CENTRAL_HEAT_PUMP_EGON100RE",
                        scenario="eGon100RE",
                        carrier="urban_central_heat_pump",
                        component_type="link",
                        output_carriers=["central_heat_pump"],
                        rtol=0.10
                    ),
                    # Central resistive heater
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_ELECTRICITY_LINK_CENTRAL_RESISTIVE_HEATER_EGON100RE",
                        scenario="eGon100RE",
                        carrier="urban_central_resistive_heater",
                        component_type="link",
                        output_carriers=["central_resistive_heater"],
                        rtol=0.10
                    ),
                    # OCGT (gas)
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_ELECTRICITY_LINK_OCGT_EGON100RE",
                        scenario="eGon100RE",
                        carrier="gas",
                        component_type="link",
                        output_carriers=["OCGT"],
                        rtol=0.10
                    ),
                    # Rural biomass boiler
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_ELECTRICITY_LINK_RURAL_BIOMASS_BOILER_EGON100RE",
                        scenario="eGon100RE",
                        carrier="rural_biomass_boiler",
                        component_type="link",
                        rtol=0.10
                    ),
                    # Rural gas boiler
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_ELECTRICITY_LINK_RURAL_GAS_BOILER_EGON100RE",
                        scenario="eGon100RE",
                        carrier="rural_gas_boiler",
                        component_type="link",
                        rtol=0.10
                    ),
                    # Rural heat pump
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_ELECTRICITY_LINK_RURAL_HEAT_PUMP_EGON100RE",
                        scenario="eGon100RE",
                        carrier="rural_heat_pump",
                        component_type="link",
                        rtol=0.10
                    ),
                    # Rural oil boiler
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_ELECTRICITY_LINK_RURAL_OIL_BOILER_EGON100RE",
                        scenario="eGon100RE",
                        carrier="rural_oil_boiler",
                        component_type="link",
                        rtol=0.10
                    ),
                    # Rural resistive heater
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_ELECTRICITY_LINK_RURAL_RESISTIVE_HEATER_EGON100RE",
                        scenario="eGon100RE",
                        carrier="rural_resistive_heater",
                        component_type="link",
                        rtol=0.10
                    ),

                    # STORAGE - eGon100RE
                    # Pumped hydro
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_storage",
                        rule_id="SANITY_ELECTRICITY_STORAGE_PUMPED_HYDRO_EGON100RE",
                        scenario="eGon100RE",
                        carrier="pumped_hydro",
                        component_type="storage",
                        rtol=0.10
                    ),
                ],

                # Heat capacity validations
                # These check that distributed heat supply capacities match input capacities
                "heat_capacity": [
                    # LINKS - eGon2035
                    # Central heat pump
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_HEAT_LINK_CENTRAL_HEAT_PUMP_EGON2035",
                        scenario="eGon2035",
                        carrier="urban_central_heat_pump",
                        component_type="link",
                        output_carriers=["central_heat_pump"],
                        rtol=0.10
                    ),
                    # Rural heat pump
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_HEAT_LINK_RURAL_HEAT_PUMP_EGON2035",
                        scenario="eGon2035",
                        carrier="residential_rural_heat_pump",
                        component_type="link",
                        output_carriers=["rural_heat_pump"],
                        rtol=0.10
                    ),
                    # Central resistive heater
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_link",
                        rule_id="SANITY_HEAT_LINK_CENTRAL_RESISTIVE_HEATER_EGON2035",
                        scenario="eGon2035",
                        carrier="urban_central_resistive_heater",
                        component_type="link",
                        output_carriers=["central_resistive_heater"],
                        rtol=0.10
                    ),

                    # GENERATORS - eGon2035
                    # Solar thermal collector
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_HEAT_GENERATOR_SOLAR_THERMAL_EGON2035",
                        scenario="eGon2035",
                        carrier="urban_central_solar_thermal_collector",
                        component_type="generator",
                        output_carriers=["solar_thermal_collector"],
                        rtol=0.10
                    ),
                    # Geothermal
                    ElectricityCapacityComparison(
                        table="grid.egon_etrago_generator",
                        rule_id="SANITY_HEAT_GENERATOR_GEO_THERMAL_EGON2035",
                        scenario="eGon2035",
                        carrier="urban_central_geo_thermal",
                        component_type="generator",
                        output_carriers=["geo_thermal"],
                        rtol=0.10
                    ),
                ],

                # Timeseries length validations
                # These check that all timeseries arrays have the expected length (8760 hours)
                # NOTE: All array columns are validated to match original sanity_checks.py
                # which dynamically discovers all array columns (lines 2465-2494)
                "timeseries_length": [
                    # Generator timeseries - all array columns
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_GENERATOR_P_SET",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_generator_timeseries",
                        array_column="p_set",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_GENERATOR_Q_SET",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_generator_timeseries",
                        array_column="q_set",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_GENERATOR_P_MIN_PU",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_generator_timeseries",
                        array_column="p_min_pu",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_GENERATOR_P_MAX_PU",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_generator_timeseries",
                        array_column="p_max_pu",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_GENERATOR_MARGINAL_COST",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_generator_timeseries",
                        array_column="marginal_cost",
                        expected_length=8760
                    ),

                    # Load timeseries - all array columns
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_LOAD_P_SET",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_load_timeseries",
                        array_column="p_set",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_LOAD_Q_SET",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_load_timeseries",
                        array_column="q_set",
                        expected_length=8760
                    ),

                    # Link timeseries - all array columns
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_LINK_P_SET",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_link_timeseries",
                        array_column="p_set",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_LINK_P_MIN_PU",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_link_timeseries",
                        array_column="p_min_pu",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_LINK_P_MAX_PU",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_link_timeseries",
                        array_column="p_max_pu",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_LINK_EFFICIENCY",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_link_timeseries",
                        array_column="efficiency",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_LINK_MARGINAL_COST",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_link_timeseries",
                        array_column="marginal_cost",
                        expected_length=8760
                    ),

                    # Storage timeseries - all array columns
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_STORAGE_P_SET",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_storage_timeseries",
                        array_column="p_set",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_STORAGE_Q_SET",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_storage_timeseries",
                        array_column="q_set",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_STORAGE_P_MIN_PU",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_storage_timeseries",
                        array_column="p_min_pu",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_STORAGE_P_MAX_PU",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_storage_timeseries",
                        array_column="p_max_pu",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_STORAGE_STATE_OF_CHARGE_SET",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_storage_timeseries",
                        array_column="state_of_charge_set",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_STORAGE_INFLOW",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_storage_timeseries",
                        array_column="inflow",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_STORAGE_MARGINAL_COST",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_storage_timeseries",
                        array_column="marginal_cost",
                        expected_length=8760
                    ),

                    # Store timeseries - all array columns
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_STORE_P_SET",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_store_timeseries",
                        array_column="p_set",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_STORE_Q_SET",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_store_timeseries",
                        array_column="q_set",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_STORE_E_MIN_PU",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_store_timeseries",
                        array_column="e_min_pu",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_STORE_E_MAX_PU",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_store_timeseries",
                        array_column="e_max_pu",
                        expected_length=8760
                    ),
                    ArrayCardinalityValidation(
                        rule_id="SANITY_TIMESERIES_STORE_MARGINAL_COST",
                        task="FinalValidations.timeseries_length",
                        table="grid.egon_etrago_store_timeseries",
                        array_column="marginal_cost",
                        expected_length=8760
                    ),
                ],

                # Electrical load demand validations
                # Validates annual electrical load sums against expected values
                "electrical_load": [
                    # Total AC load aggregation for all scenarios (eGon2035, eGon100RE, etc.)
                    ElectricalLoadAggregationValidation(
                        rule_id="SANITY_ELECTRICAL_LOAD_AGGREGATION",
                        task="FinalValidations.electrical_load",
                        table="grid.egon_etrago_load",
                        tolerance=0.05  # 5% tolerance
                    ),
                    # Sector breakdown validation for eGon100RE
                    # Validates residential (90.4 TWh), commercial (146.7 TWh),
                    # industrial (382.9 TWh), and total (620.0 TWh) loads
                    ElectricalLoadSectorBreakdown(
                        rule_id="SANITY_ELECTRICAL_LOAD_SECTOR_BREAKDOWN_EGON100RE",
                        task="FinalValidations.electrical_load",
                        table="grid.egon_etrago_load",
                        scenario="eGon100RE",
                        rtol=0.01  # 1% tolerance as in original
                    ),
                ],

                # Heat demand validations
                # Validates annual heat demand against peta_heat reference values
                "heat_demand": [
                    # Heat demand - eGon2035
                    HeatDemandValidation(
                        table="grid.egon_etrago_load",
                        rule_id="SANITY_HEAT_DEMAND_EGON2035",
                        scenario="eGon2035",
                        rtol=0.02  # 2% tolerance
                    ),
                ],
                "data-quality": [
                    #grid validation
                    RowCountValidation(
                        table="grid.egon_etrago_bus",
                        rule_id="TEST_ROW_COUNT.egon_etrago_bus",
                        expected_count={"Schleswig-Holstein": 2729, "Everything": 85710}
                    ),
                    DataTypeValidation(
                        table="grid.egon_etrago_bus",
                        rule_id="TEST_DATA_MULTIPLE_TYPES.egon_etrago_bus",
                        column_types={
                            "scen_name": "character varying", "bus_id": "bigint", "v_nom": "double precision",
                            "type": "text", "carrier": "text", "v_mag_pu_set": "double precision",
                            "v_mag_pu_min": "double precision", "v_mag_pu_max": "double precision",
                            "x": "double precision", "y": "double precision", "geometry": "geometry", "country": "text"
                        },
                    ),
                    NotNullAndNotNaNValidation(
                        table="grid.egon_etrago_bus",
                        rule_id="TEST_NOT_NAN.egon_etrago_bus",
                        columns=[
                            "scn_name", "bus_id", "v_nom", "carrier", "v_mag_pu_min", "v_mag_pu_max", "x", "y", "geom"
                        ]
                    ),
                    WholeTableNotNullAndNotNaNValidation(
                        table="grid.egon_etrago_bus",
                        rule_id="TEST_WHOLE_TABLE_NOT_NAN.egon_etrago_bus"
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_bus",
                        rule_id="TEST_VALUE_SET_SCENARIO.egon_etrago_bus",
                        column="scn_name",
                        expected_values=["eGon2035", "eGon2035_lowflex", "eGon100RE"]
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_bus",
                        rule_id="TEST_VALUE_SET_CARRIER.egon_etrago_bus",
                        column="carrier",
                        expected_values=[
                            "rural_heat", "urban_central_water_tanks", "low_voltage", "CH4", "H2_saltcavern",
                            "services_rural_heat", "services_rural_water_tanks", "central_heat_store", "AC", "Li_ion",
                            "H2_grid", "dsm", "urban_central_heat", "residential_rural_heat", "central_heat",
                            "rural_heat_store", "residential_rural_water_tanks"
                        ]
                    ),
                    SRIDUniqueNonZero(
                        table="grid.egon_etrago_bus",
                        rule_id="SRIDUniqueNonZero.egon_etrago_bus",
                        column="geometry"
                    ),
                    RowCountValidation(
                        table="grid.egon_etrago_generator",
                        rule_id="TEST_ROW_COUNT.egon_etrago_generator",
                        expected_count={"Schleswig-Holstein": 2863, "Everything": 40577}
                    ),
                    DataTypeValidation(
                        table="grid.egon_etrago_generator",
                        rule_id="TEST_DATA_MULTIPLE_TYPES.egon_etrago_generator",
                        column_types={
                            "scen_name": "character varying", "generator_id": "bigint", "control": "text",
                            "type": "text", "carrier": "text", "p_nom": "double precision", "p_nom_extendable": "boolean",
                            "p_nom_min": "double precision", "p_nom_max": "double precision", "p_min_pu": "double precision",
                            "p_max_pu": "double precision", "p_set": "double precision", "q_set": "double precision",
                            "sign": "double precision", "marginal_cost": "double precision", "build_year": "bigint",
                            "lifetime": "double precision", "capital_cost": "double precision", "efficiency": "double precision",
                            "commitable": "boolean", "start_up_cost": "double precision", "shut_down_cost": "double precision",
                            "min_up_time": "bigint", "min_down_time": "bigint", "up_time_before": "bigint", "down_time_before": "bigint",
                            "ramp_limit_up": "double precision", "ramp_limit_down": "double precision",
                            "ramp_limit_start_up": "double precision", "ramp_limit_shut_down": "double precision",
                            "e_nom_max": "double precision"
                        },
                    ),
                    NotNullAndNotNaNValidation(
                        table="grid.egon_etrago_generator",
                        rule_id="TEST_NOT_NAN.egon_etrago_generator",
                        columns=[
                            "scn_name", "generator_id", "bus", "control", "type", "carrier", "p_nom", "p_nom_extendable",
                            "p_nom_min", "p_nom_max", "p_min_pu", "p_max_pu", "sign", "marginal_cost", "build_year",
                            "lifetime", "capital_cost", "efficiency", "committable", "start_up_cost", "shut_down_cost",
                            "min_up_time", "min_down_time", "up_time_before", "down_time_before", "ramp_limit_start_up",
                            "ramp_limit_shut_down", "e_nom_max"
                        ]
                    ),
                    WholeTableNotNullAndNotNaNValidation(
                        table="grid.egon_etrago_generator",
                        rule_id="TEST_WHOLE_TABLE_NOT_NAN.egon_etrago_generator"
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_generator",
                        rule_id="TEST_VALUE_SET_SCENARIO.egon_etrago_generator",
                        column="scn_name",
                        expected_values=["eGon2035", "eGon2035_lowflex", "eGon100RE"]
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_generator",
                        rule_id="TEST_VALUE_SET_CARRIER.egon_etrago_generator",
                        column="carrier",
                        expected_values=[
                            "CH4", "others", "central_biomass_CHP", "wind_onshore", "lignite", "geo_thermal", "solar",
                            "reservoir", "services_rural_solar_thermal_collector", "residential_rural_solar_thermal_collector",
                            "industrial_biomass_CHP", "biomass", "urban_central_solar_thermal_collector", "run_of_river",
                            "oil", "central_biomass_CHP_heat", "nuclear", "coal", "solar_thermal_collector", "solar_rooftop",
                            "wind_offshore"
                        ]
                    ),
                    RowCountValidation(
                        table="grid.egon_etrago_generator_timeseries",
                        rule_id="TEST_ROW_COUNT.egon_etrago_generator_timeseries",
                        expected_count={"Schleswig-Holstein": 1929, "Everything": 28651}
                    ),
                    DataTypeValidation(
                        table="grid.egon_etrago_generator_timeseries",
                        rule_id="TEST_DATA_MULTIPLE_TYPES.egon_etrago_generator_timeseries",
                        column_types={
                            "scn_name":	"character varying", "generator_id": "integer", "temp_id": "integer",
                            "p_set": "double precision[]", "q_set":	"double precision[]", "p_min_pu": "double precision[]",
                            "p_max_pu":	"double precision[]", "marginal_cost":	"double precision[]"
                        },
                    ),
                    NotNullAndNotNaNValidation(
                        table="grid.egon_etrago_generator_timeseries",
                        rule_id="TEST_NOT_NAN.egon_etrago_generator_timeseries",
                        columns=[
                            "scn_name", "generator_id", "temp_id", "p_max_pu"
                        ]
                    ),
                    WholeTableNotNullAndNotNaNValidation(
                        table="grid.egon_etrago_generator_timeseries",
                        rule_id="TEST_WHOLE_TABLE_NOT_NAN.egon_etrago_generator_timeseries"
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_generator_timeseries",
                        rule_id="TEST_VALUE_SET_SCENARIO.egon_etrago_generator_timeseries",
                        column="scn_name",
                        expected_values=["eGon2035", "eGon2035_lowflex", "eGon100RE"]
                    ),
                    RowCountValidation(
                        table="grid.egon_etrago_line",
                        rule_id="TEST_ROW_COUNT.egon_etrago_line",
                        expected_count={"Schleswig-Holstein": 1197, "Everything": 69901}
                    ),
                    DataTypeValidation(
                        table="grid.egon_etrago_line",
                        rule_id="TEST_DATA_MULTIPLE_TYPES.egon_etrago_line",
                        column_types={
                            "scn_name":	"character varying", "line_id":	"bigint", "bus0": "bigint", "bus1":	"bigint",
                            "type":	"text", "carrier": "text", "x": "numeric", "r": "numeric", "g":	"numeric", "b":	"numeric",
                            "s_nom": "numeric", "s_nom_extendable":	"boolean", "s_nom_min":	"double precision",
                            "s_nom_max": "double precision", "s_max_pu": "double precision", "build_year": "bigint",
                            "lifetime":	"double precision", "capital_cost":	"double precision", "length": "double precision",
                            "cables": "integer", "terrain_factor": "double precision", "num_parallel": "double precision",
                            "v_ang_min": "double precision", "v_ang_max": "double precision", "v_nom": "double precision",
                            "geom":	"geometry", "topo":	"geometry"
                        },
                    ),
                    NotNullAndNotNaNValidation(
                        table="grid.egon_etrago_line",
                        rule_id="TEST_NOT_NAN.egon_etrago_line",
                        columns=[
                            "scn_name", "line_id", "bus0", "bus1", "carrier", "x", "r", "g", "b", "s_nom",
                            "s_nom_extendable", "s_nom_min", "s_nom_max", "s_max_pu", "build_year", "lifetime",
                            "capital_cost", "length", "cables", "terrain_factor", "num_parallel", "v_ang_min",
                            "v_ang_max", "v_nom", "geom", "topo",
                        ]
                    ),
                    WholeTableNotNullAndNotNaNValidation(
                        table="grid.egon_etrago_line",
                        rule_id="TEST_WHOLE_TABLE_NOT_NAN.egon_etrago_line"
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_line",
                        rule_id="TEST_VALUE_SET_SCENARIO.egon_etrago_line",
                        column="scn_name",
                        expected_values=["eGon2035", "eGon2035_lowflex", "eGon100RE"]
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_line",
                        rule_id="TEST_VALUE_SET_CARRIER.egon_etrago_line",
                        column="carrier",
                        expected_values=["AC"]
                    ),
                    SRIDUniqueNonZero(
                        table="grid.egon_etrago_line",
                        rule_id="SRIDUniqueNonZero.egon_etrago_line.geom",
                        column="geom"
                    ),
                    SRIDUniqueNonZero(
                        table="grid.egon_etrago_line",
                        rule_id="SRIDUniqueNonZero.egon_etrago_line.topo",
                        column="topo"
                    ),
                    #Row Count does't equal egon_etrago_line, because buses are located outside Germany
                    RowCountValidation(
                        table="grid.egon_etrago_line_timeseries",
                        rule_id="TEST_ROW_COUNT.egon_etrago_line_timeseries",
                        expected_count={"Schleswig-Holstein": 1197, "Everything": 69714}
                    ),
                    DataTypeValidation(
                        table="grid.egon_etrago_line_timeseries",
                        rule_id="TEST_DATA_MULTIPLE_TYPES.egon_etrago_line_timeseries",
                        column_types={
                            "scn_name": "character varying", "line_id": "bigint", "bus0": "bigint", "bus1": "bigint",
                            "type": "text", "carrier": "text", "x": "numeric", "r": "numeric", "g": "numeric",
                            "b": "numeric",
                            "s_nom": "numeric", "s_nom_extendable": "boolean", "s_nom_min": "double precision",
                            "s_nom_max": "double precision", "s_max_pu": "double precision", "build_year": "bigint",
                            "lifetime": "double precision", "capital_cost": "double precision",
                            "length": "double precision",
                            "cables": "integer", "terrain_factor": "double precision",
                            "num_parallel": "double precision",
                            "v_ang_min": "double precision", "v_ang_max": "double precision",
                            "v_nom": "double precision",
                            "geom": "geometry", "topo": "geometry"
                        },
                    ),
                    NotNullAndNotNaNValidation(
                        table="grid.egon_etrago_line_timeseries",
                        rule_id="TEST_NOT_NAN.egon_etrago_line_timeseries",
                        columns=[
                            "scn_name", "line_id", "bus0", "bus1", "carrier", "x", "r", "g", "b", "s_nom",
                            "s_nom_extendable", "s_nom_min", "s_nom_max", "s_max_pu", "build_year", "lifetime",
                            "capital_cost", "length", "cables", "terrain_factor", "num_parallel", "v_ang_min",
                            "v_ang_max", "v_nom", "geom", "topo",
                        ]
                    ),
                    WholeTableNotNullAndNotNaNValidation(
                        table="grid.egon_etrago_line_timeseries",
                        rule_id="TEST_WHOLE_TABLE_NOT_NAN.egon_etrago_line_timeseries"
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_line_timeseries",
                        rule_id="TEST_VALUE_SET_SCENARIO.egon_etrago_line_timeseries",
                        column="scn_name",
                        expected_values=["eGon2035", "eGon2035_lowflex", "eGon100RE"]
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_line_timeseries",
                        rule_id="TEST_VALUE_SET_CARRIER.egon_etrago_line_timeseries",
                        column="carrier",
                        expected_values=["AC"]
                    ),
                    SRIDUniqueNonZero(
                        table="grid.egon_etrago_line_timeseries",
                        rule_id="SRIDUniqueNonZero.egon_etrago_line_timeseries.geom",
                        column="geom"
                    ),
                    SRIDUniqueNonZero(
                        table="grid.egon_etrago_line_timeseries",
                        rule_id="SRIDUniqueNonZero.egon_etrago_line_timeseries.topo",
                        column="topo"
                    ),
                    RowCountValidation(
                        table="grid.egon_etrago_link",
                        rule_id="TEST_ROW_COUNT.egon_etrago_link",
                        expected_count={"Schleswig-Holstein": 15496, "Everything": 83980}
                    ),
                    DataTypeValidation(
                        table="grid.egon_etrago_link",
                        rule_id="TEST_DATA_MULTIPLE_TYPES.egon_etrago_link",
                        column_types={
                            "scn_name":	"character varying", "link_id":	"bigint", "bus0": "bigint", "bus1":	"bigint",
                            "type":	"text", "carrier": "text", "efficiency": "double precision", "build_year": "bigint",
                            "lifetime":	"double precision", "p_nom": "numeric", "p_nom_extendable":	"boolean",
                            "p_nom_min": "double precision", "p_nom_max": "double precision", "p_min_pu": "double precision",
                            "p_max_pu":	"double precision", "p_set": "double precision", "capital_cost": "double precision",
                            "marginal_cost": "double precision", "length": "double precision",
                            "terrain_factor": "double precision", "geom": "geometry", "topo": "geometry",
                        },
                    ),
                    NotNullAndNotNaNValidation(
                        table="grid.egon_etrago_link",
                        rule_id="TEST_NOT_NAN.egon_etrago_link",
                        columns=[
                            "scn_name", "link_id", "bus0", "bus1", "carrier", "efficiency", "build_year", "p_nom",
                            "p_nom_extendable", "p_nom_min", "p_nom_max", "p_min_pu", "p_max_pu", "p_set",
                            "capital_cost", "marginal_cost", "length", "terrain_factor", "geom", "topo"
                        ]
                    ),
                    WholeTableNotNullAndNotNaNValidation(
                        table="grid.egon_etrago_link",
                        rule_id="TEST_WHOLE_TABLE_NOT_NAN.egon_etrago_link"
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_link",
                        rule_id="TEST_VALUE_SET_SCENARIO.egon_etrago_link",
                        column="scn_name",
                        expected_values=["eGon2035", "eGon2035_lowflex", "eGon100RE"]
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_link",
                        rule_id="TEST_VALUE_SET_CARRIER.egon_etrago_link",
                        column="carrier",
                        expected_values=[
                            "industrial_gas_CHP", "residential_rural_water_tanks_discharger", "BEV_charger", "CH4",
                            "power_to_H2", "urban_central_gas_CHP", "rural_heat_store_discharger", "H2_gridextension",
                            "urban_central_gas_CHP_CC", "dsm", "services_rural_water_tanks_charger", "H2_to_CH4",
                            "rural_heat_store_charger", "DC", "central_gas_boiler", "H2_feedin", "H2_retrofit", "OCGT",
                            "central_gas_CHP_heat", "residential_rural_water_tanks_charger", "central_heat_pump",
                            "services_rural_ground_heat_pump", "rural_heat_pump", "CH4_to_H2", "central_resistive_heater",
                            "urban_central_air_heat_pump", "urban_central_water_tanks_discharger",
                            "urban_central_water_tanks_charger", "services_rural_water_tanks_discharger",
                            "electricity_distribution_grid", "central_heat_store_discharger", "H2_to_power",
                            "central_heat_store_charger", "central_gas_CHP", "residential_rural_ground_heat_pump"]
                    ),
                    SRIDUniqueNonZero(
                        table="grid.egon_etrago_link",
                        rule_id="SRIDUniqueNonZero.egon_etrago_link.geom",
                        column="geom"
                    ),
                    SRIDUniqueNonZero(
                        table="grid.egon_etrago_link",
                        rule_id="SRIDUniqueNonZero.egon_etrago_link.topo",
                        column="topo"
                    ),
                    RowCountValidation(
                        table="grid.egon_etrago_link_timeseries",
                        rule_id="TEST_ROW_COUNT.egon_etrago_link_timeseries",
                        expected_count={"Schleswig-Holstein": 947, "Everything": 25729}
                    ),
                    DataTypeValidation(
                        table="grid.egon_etrago_link_timeseries",
                        rule_id="TEST_DATA_MULTIPLE_TYPES.egon_etrago_link_timeseries",
                        column_types={
                            "scn_name": "character varying",
                            "link_id": "bigint",
                            "temp_id": "integer",
                            "p_set": "double precision[]",
                            "p_min_pu": "double precision[]",
                            "p_max_pu": "double precision[]",
                            "efficiency": "double precision[]",
                            "marginal_cost": "double precision[]"
                        },
                    ),
                    NotNullAndNotNaNValidation(
                        table="grid.egon_etrago_link_timeseries",
                        rule_id="TEST_NOT_NAN.egon_etrago_link_timeseries",
                        columns=[
                            "scn_name", "link_id", "temp_id", "p_set", "p_min_pu", "p_max_pu", "efficiency",
                            "marginal_cost"
                        ]
                    ),
                    WholeTableNotNullAndNotNaNValidation(
                        table="grid.egon_etrago_link_timeseries",
                        rule_id="TEST_WHOLE_TABLE_NOT_NAN.egon_etrago_link_timeseries"
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_link_timeseries",
                        rule_id="TEST_VALUE_SET_SCENARIO.egon_etrago_link_timeseries",
                        column="scn_name",
                        expected_values=["eGon2035", "eGon2035_lowflex", "eGon100RE"]
                    ),
                    RowCountValidation(
                        table="grid.egon_etrago_load",
                        rule_id="TEST_ROW_COUNT.egon_etrago_load",
                        expected_count={"Schleswig-Holstein": 3202, "Everything": 44019}
                    ),
                    DataTypeValidation(
                        table="grid.egon_etrago_load",
                        rule_id="TEST_DATA_MULTIPLE_TYPES.egon_etrago_load",
                        column_types={
                            "scn_name": "character varying",
                            "load_id": "bigint",
                            "bus": "bigint",
                            "type": "text",
                            "carrier": "text",
                            "p_set": "double precision",
                            "q_set": "double precision",
                            "sign": "double precision"
                        },
                    ),
                    NotNullAndNotNaNValidation(
                        table="grid.egon_etrago_load",
                        rule_id="TEST_NOT_NAN.egon_etrago_load",
                        columns=[
                            "scn_name", "load_id", "bus", "type", "carrier", "p_set", "q_set", "sign"
                        ]
                    ),
                    WholeTableNotNullAndNotNaNValidation(
                        table="grid.egon_etrago_load",
                        rule_id="TEST_WHOLE_TABLE_NOT_NAN.egon_etrago_load"
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_load",
                        rule_id="TEST_VALUE_SET_SCENARIO.egon_etrago_load",
                        column="scn_name",
                        expected_values=["eGon2035", "eGon2035_lowflex", "eGon100RE"]
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_load",
                        rule_id="TEST_VALUE_SET_CARRIER.egon_etrago_load",
                        column="carrier",
                        expected_values=[
                            "CH4", "H2_for_industry", "services_rural_heat", "H2_system_boundary", "AC",
                            "urban_central_heat", "residential_rural_heat", "low-temperature_heat_for_industry",
                            "CH4_for_industry", "central_heat", "CH4_system_boundary", "land_transport_EV",
                            "H2_hgv_load", "rural_gas_boiler", "rural_heat"
                        ]
                    ),
                    RowCountValidation(
                        table="grid.egon_etrago_load_timeseries",
                        rule_id="TEST_ROW_COUNT.egon_etrago_load_timeseries",
                        expected_count={"Schleswig-Holstein": 3176, "Everything": 44013}
                    ),
                    DataTypeValidation(
                        table="grid.egon_etrago_load_timeseries",
                        rule_id="TEST_DATA_MULTIPLE_TYPES.egon_etrago_load_timeseries",
                        column_types={
                            "scn_name": "character varying",
                            "load_id": "bigint",
                            "temp_id": "integer",
                            "p_set": "double precision[]",
                            "q_set": "double precision[]"
                        },
                    ),
                    NotNullAndNotNaNValidation(
                        table="grid.egon_etrago_load_timeseries",
                        rule_id="TEST_NOT_NAN.egon_etrago_load_timeseries",
                        columns=[
                            "scn_name", "load_id", "temp_id", "p_set", "q_set"
                        ]
                    ),
                    WholeTableNotNullAndNotNaNValidation(
                        table="grid.egon_etrago_load_timeseries",
                        rule_id="TEST_WHOLE_TABLE_NOT_NAN.egon_etrago_load_timeseries"
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_load_timeseries",
                        rule_id="TEST_VALUE_SET_SCENARIO.egon_etrago_load_timeseries",
                        column="scn_name",
                        expected_values=["eGon2035", "eGon2035_lowflex", "eGon100RE"]
                    ),
                    RowCountValidation(
                        table="grid.egon_etrago_storage",
                        rule_id="TEST_ROW_COUNT.egon_etrago_storage",
                        expected_count={"Schleswig-Holstein": 418, "Everything": 13044}
                    ),
                    DataTypeValidation(
                        table="grid.egon_etrago_storage",
                        rule_id="TEST_DATA_MULTIPLE_TYPES.egon_etrago_storage",
                        column_types={
                            "scn_name": "character varying",
                            "storage_id": "bigint",
                            "bus": "bigint",
                            "control": "text",
                            "type": "text",
                            "carrier": "text",
                            "p_nom": "double precision",
                            "p_nom_extendable": "boolean",
                            "p_nom_min": "double precision",
                            "p_nom_max": "double precision",
                            "p_min_pu": "double precision",
                            "p_max_pu": "double precision",
                            "p_set": "double precision",
                            "q_set": "double precision",
                            "sign": "double precision",
                            "marginal_cost": "double precision",
                            "capital_cost": "double precision",
                            "build_year": "bigint",
                            "lifetime": "double precision",
                            "state_of_charge_initial": "double precision",
                            "cyclic_state_of_charge": "boolean",
                            "state_of_charge_set": "double precision",
                            "max_hours": "double precision",
                            "efficiency_store": "double precision",
                            "efficiency_dispatch": "double precision",
                            "standing_loss": "double precision",
                            "inflow": "double precision"
                        },
                    ),
                    NotNullAndNotNaNValidation(
                        table="grid.egon_etrago_storage",
                        rule_id="TEST_NOT_NAN.egon_etrago_storage",
                        columns=[
                            "scn_name", "storage_id", "bus", "control", "type", "carrier", "p_nom",
                            "p_nom_extendable", "p_nom_min", "p_nom_max", "p_min_pu", "p_max_pu", "p_set",
                            "q_set", "sign", "marginal_cost", "capital_cost", "build_year", "lifetime",
                            "state_of_charge_initial", "cyclic_state_of_charge", "state_of_charge_set",
                            "max_hours", "efficiency_store", "efficiency_dispatch", "standing_loss", "inflow"
                        ]
                    ),
                    WholeTableNotNullAndNotNaNValidation(
                        table="grid.egon_etrago_storage",
                        rule_id="TEST_WHOLE_TABLE_NOT_NAN.egon_etrago_storage"
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_storage",
                        rule_id="TEST_VALUE_SET_SCENARIO.egon_etrago_storage",
                        column="scn_name",
                        expected_values=["eGon2035", "eGon2035_lowflex", "eGon100RE"]
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_storage",
                        rule_id="TEST_VALUE_SET_CARRIER.egon_etrago_storage",
                        column="carrier",
                        expected_values=["battery", "home_battery", "pumped_hydro", "reservoir"]
                    ),
                    RowCountValidation(
                        table="grid.egon_etrago_storage_timeseries",
                        rule_id="TEST_ROW_COUNT.egon_etrago_storage_timeseries",
                        expected_count={"Schleswig-Holstein": 0, "Everything": 9}
                    ),
                    DataTypeValidation(
                        table="grid.egon_etrago_storage_timeseries",
                        rule_id="TEST_DATA_MULTIPLE_TYPES.egon_etrago_storage_timeseries",
                        column_types={
                            "scn_name": "character varying",
                            "storage_id": "bigint",
                            "temp_id": "integer",
                            "p_set": "double precision[]",
                            "q_set": "double precision[]",
                            "p_min_pu": "double precision[]",
                            "p_max_pu": "double precision[]",
                            "state_of_charge_set": "double precision[]",
                            "inflow": "double precision[]",
                            "marginal_cost": "double precision[]"
                        },
                    ),
                    NotNullAndNotNaNValidation(
                        table="grid.egon_etrago_storage_timeseries",
                        rule_id="TEST_NOT_NAN.egon_etrago_storage_timeseries",
                        columns=[
                            "scn_name", "storage_id", "temp_id", "inflow", "marginal_cost"
                        ]
                    ),
                    WholeTableNotNullAndNotNaNValidation(
                        table="grid.egon_etrago_storage_timeseries",
                        rule_id="TEST_WHOLE_TABLE_NOT_NAN.egon_etrago_storage_timeseries"
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_storage_timeseries",
                        rule_id="TEST_VALUE_SET_SCENARIO.egon_etrago_storage_timeseries",
                        column="scn_name",
                        expected_values=["eGon100RE"]
                    ),
                    RowCountValidation(
                        table="grid.egon_etrago_store",
                        rule_id="TEST_ROW_COUNT.egon_etrago_store",
                        expected_count={"Schleswig-Holstein": 2913, "Everything": 26520}
                    ),
                    DataTypeValidation(
                        table="grid.egon_etrago_store",
                        rule_id="TEST_DATA_MULTIPLE_TYPES.egon_etrago_store",
                        column_types={
                            "scn_name": "character varying",
                            "store_id": "bigint",
                            "bus": "bigint",
                            "type": "text",
                            "carrier": "text",
                            "e_nom": "double precision",
                            "e_nom_extendable": "boolean",
                            "e_nom_min": "double precision",
                            "e_nom_max": "double precision",
                            "e_min_pu": "double precision",
                            "e_max_pu": "double precision",
                            "p_set": "double precision",
                            "q_set": "double precision",
                            "e_initial": "double precision",
                            "e_cyclic": "boolean",
                            "sign": "double precision",
                            "marginal_cost": "double precision",
                            "capital_cost": "double precision",
                            "standing_loss": "double precision",
                            "build_year": "bigint",
                            "lifetime": "double precision"
                        },
                    ),
                    NotNullAndNotNaNValidation(
                        table="grid.egon_etrago_store",
                        rule_id="TEST_NOT_NAN.egon_etrago_store",
                        columns=[
                            "scn_name", "store_id", "bus", "type", "carrier", "e_nom", "e_nom_extendable",
                            "e_nom_min", "e_nom_max", "e_min_pu", "e_max_pu", "p_set", "q_set", "e_initial",
                            "e_cyclic", "sign", "marginal_cost", "capital_cost", "standing_loss", "build_year",
                            "lifetime"
                        ]
                    ),
                    WholeTableNotNullAndNotNaNValidation(
                        table="grid.egon_etrago_store",
                        rule_id="TEST_WHOLE_TABLE_NOT_NAN.egon_etrago_store"
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_store",
                        rule_id="TEST_VALUE_SET_SCENARIO.egon_etrago_store",
                        column="scn_name",
                        expected_values=["eGon2035", "eGon2035_lowflex", "eGon100RE"]
                    ),
                    RowCountValidation(
                        table="grid.egon_etrago_store_timeseries",
                        rule_id="TEST_ROW_COUNT.egon_etrago_store_timeseries",
                        expected_count={"Schleswig-Holstein": 392, "Everything": 15281}
                    ),
                    DataTypeValidation(
                        table="grid.egon_etrago_store_timeseries",
                        rule_id="TEST_DATA_MULTIPLE_TYPES.egon_etrago_store_timeseries",
                        column_types={
                            "scn_name": "character varying",
                            "store_id": "bigint",
                            "temp_id": "integer",
                            "p_set": "double precision[]",
                            "q_set": "double precision[]",
                            "e_min_pu": "double precision[]",
                            "e_max_pu": "double precision[]",
                            "marginal_cost": "double precision[]"
                        },
                    ),
                    NotNullAndNotNaNValidation(
                        table="grid.egon_etrago_store_timeseries",
                        rule_id="TEST_NOT_NAN.egon_etrago_store_timeseries",
                        columns=[
                            "scn_name", "store_id", "temp_id", "p_set", "q_set", "e_min_pu", "e_max_pu",
                            "marginal_cost"
                        ]
                    ),
                    WholeTableNotNullAndNotNaNValidation(
                        table="grid.egon_etrago_store_timeseries",
                        rule_id="TEST_WHOLE_TABLE_NOT_NAN.egon_etrago_store_timeseries"
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_store_timeseries",
                        rule_id="TEST_VALUE_SET_SCENARIO.egon_etrago_store_timeseries",
                        column="scn_name",
                        expected_values=["eGon2035", "eGon2035_lowflex", "eGon100RE"]
                    ),
                    RowCountValidation(
                        table="grid.egon_etrago_temp_resolution",
                        rule_id="TEST_ROW_COUNT.egon_etrago_temp_resolution",
                        expected_count=1
                    ),
                    DataTypeValidation(
                        table="grid.egon_etrago_temp_resolution",
                        rule_id="TEST_DATA_MULTIPLE_TYPES.egon_etrago_temp_resolution",
                        column_types={
                            "temp_id": "bigint",
                            "timesteps": "bigint",
                            "resolution": "text",
                            "start_time": "timestamp without time zone"
                        },
                    ),
                    WholeTableNotNullAndNotNaNValidation(
                        table="grid.egon_etrago_temp_resolution",
                        rule_id="TEST_WHOLE_TABLE_NOT_NAN.egon_etrago_temp_resolution"
                    ),
                    RowCountValidation(
                        table="grid.egon_etrago_transformer",
                        rule_id="TEST_ROW_COUNT.egon_etrago_transformer",
                        expected_count={"Schleswig-Holstein": 31, "Everything": 1545}
                    ),
                    DataTypeValidation(
                        table="grid.egon_etrago_transformer",
                        rule_id="TEST_DATA_MULTIPLE_TYPES.egon_etrago_transformer",
                        column_types={
                            "scn_name": "character varying",
                            "store_id": "bigint",
                            "bus": "bigint",
                            "type": "text",
                            "carrier": "text",
                            "e_nom": "double precision",
                            "e_nom_extendable": "boolean",
                            "e_nom_min": "double precision",
                            "e_nom_max": "double precision",
                            "e_min_pu": "double precision",
                            "e_max_pu": "double precision",
                            "p_set": "double precision",
                            "q_set": "double precision",
                            "e_initial": "double precision",
                            "e_cyclic": "boolean",
                            "sign": "double precision",
                            "marginal_cost": "double precision",
                            "capital_cost": "double precision",
                            "standing_loss": "double precision",
                            "build_year": "bigint",
                            "lifetime": "double precision"
                        },
                    ),
                    NotNullAndNotNaNValidation(
                        table="grid.egon_etrago_transformer",
                        rule_id="TEST_NOT_NAN.egon_etrago_transformer",
                        columns=[
                            "scn_name", "store_id", "bus", "type", "carrier", "e_nom", "e_nom_extendable",
                            "e_nom_min", "e_nom_max", "e_min_pu", "e_max_pu", "p_set", "q_set", "e_initial",
                            "e_cyclic", "sign", "marginal_cost", "capital_cost", "standing_loss", "build_year",
                            "lifetime"
                        ]
                    ),
                    WholeTableNotNullAndNotNaNValidation(
                        table="grid.egon_etrago_transformer",
                        rule_id="TEST_WHOLE_TABLE_NOT_NAN.egon_etrago_transformer"
                    ),
                    ValueSetValidation(
                        table="grid.egon_etrago_transformer",
                        rule_id="TEST_VALUE_SET_SCENARIO.egon_etrago_transformer",
                        column="scn_name",
                        expected_values=["eGon2035", "eGon2035_lowflex", "eGon100RE"]
                    ),
                    RowCountValidation(
                        table="grid.egon_hvmv_substation",
                        rule_id="TEST_ROW_COUNT.hvmv_substation",
                        expected_count={"Schleswig-Holstein": 200, "Everything": 3854}
                    ),
                    DataTypeValidation(
                        table="grid.egon_hvmv_substation",
                        rule_id="TEST_DATA_MULTIPLE_TYPES.egon_hvmv_substation",
                        column_types={
                            "bus_id": "integer",
                            "lon": "double precision",
                            "lat": "double precision",
                            "point": "geometry",
                            "polygon": "geometry",
                            "voltage": "text",
                            "power_type": "text",
                            "substation": "text",
                            "osm_id": "text",
                            "osm_www": "text",
                            "frequency": "text",
                            "subst_name": "text",
                            "ref": "text",
                            "operator": "text",
                            "dbahn": "text",
                            "status": "integer"
                        },
                    ),
                    NotNullAndNotNaNValidation(
                        table="grid.egon_hvmv_substation",
                        rule_id="TEST_NOT_NAN.egon_hvmv_substation",
                        columns=[
                            "bus_id", "lon", "lat", "point", "polygon", "voltage", "power_type", "substation",
                            "osm_id", "osm_www", "frequency", "subst_name", "ref", "operator", "dbahn", "status"
                        ]
                    ),
                    WholeTableNotNullAndNotNaNValidation(
                        table="grid.egon_hvmv_substation",
                        rule_id="TEST_WHOLE_TABLE_NOT_NAN.egon_hvmv_substation"
                    ),
                    SRIDUniqueNonZero(
                        table="grid.egon_hvmv_substation",
                        rule_id="SRIDUniqueNonZero.egon_hvmv_substation.point",
                        column="point"
                    ),
                    SRIDUniqueNonZero(
                        table="grid.egon_hvmv_substation",
                        rule_id="SRIDUniqueNonZero.egon_hvmv_substation.polygon",
                        column="polygon"
                    ),
                    RowCountValidation(
                        table="grid.egon_mv_grid_district",
                        rule_id="TEST_ROW_COUNT.egon_mv_grid_district",
                        expected_count={"Schleswig-Holstein": 200, "Everything": 3854}
                    ),
                    DataTypeValidation(
                        table="grid.egon_mv_grid_district",
                        rule_id="TEST_DATA_MULTIPLE_TYPES.egon_mv_grid_district",
                        column_types={
                            "bus_id": "integer",
                            "geom": "geometry",
                            "area": "double precision"
                        },
                    ),
                    WholeTableNotNullAndNotNaNValidation(
                        table="grid.egon_mv_grid_district",
                        rule_id="TEST_WHOLE_TABLE_NOT_NAN.egon_mv_grid_district"
                    ),
                    SRIDUniqueNonZero(
                        table="grid.egon_mv_grid_district",
                        rule_id="SRIDUniqueNonZero.egon_mv_grid_district.geom",
                        column="geom"
                    ),
                ]
            },
            on_validation_failure="continue"  # Continue pipeline even if validations fail
        )

openego / eGon-data

Pull Request — dev (#1375)

FinalValidations.__init__() B

Complexity

Size

Duplication

Importance

How to fix Long Method

Long Method

Duplication Side-by-Side

Filter issues like

FinalValidations.init() B
