MTPASA_CASESOLUTION
MTPASA_CASESOLUTION is obsolete from 2017 End of Year DM4.27 Release. MTPASA_CASESOLUTION holds one record for each entire solution. Change Notice 379 announced the replacement of the MT PASA data model so all MTPASAxxx tables become obsolete, replaced by MTPASA_xxx tables.
Deprecation Warning
This table is in the HISTORICAL TABLES package, so is likely deprecated.
MTPASA_CASESOLUTION is public data.
Source
MTPASA_CASESOLUTION is updated each MTPASA run (i.e. weekly).
Volume
Rows per week: 1
Rows per month: 5
Monthly space increment is based on storing all the MT PASA solutions. To store only the latest solution, divide these figures by 5 (number of weeks per month rounded up).
Column Schema
RUN_DATETIME
Date processing of the run begins. Generated from the solution file caseid
SQL Type: DATE
Polars Type: pl.Datetime()
This column is mandatory, and a primary key.
Example: 2024/07/01 02:00:00
RUN_NO
Unique run id. Generated from the solution file caseid
SQL Type: NUMBER(3,0)
Polars Type: pl.Int16
This column is mandatory, and a primary key.
Examples:
857, 869
CAPACITYOBJFUNCTION
Objective Function from the Capacity Adequacy run
SQL Type: NUMBER(12,3)
Polars Type: pl.Float64
This column is not mandatory.
CAPACITYOPTION
Not populated as of 2005 End of Year Release; was the demand forecast used for capacity adequacy assessment: 0 = no assessment, 1 = 10%, 2 = 50%, 3 = 90%
SQL Type: NUMBER(12,3)
Polars Type: pl.Float64
This column is not mandatory.
INTERCONNECTORFLOWPENALTY
The penalty for non-zero interconnector flow
SQL Type: NUMBER(12,3)
Polars Type: pl.Float64
This column is not mandatory.
LASTCHANGED
Date and time the record was created or modified
For more information, see the dedicated documentation page.
SQL Type: DATE
Polars Type: pl.Datetime()
This column is not mandatory.
Example: 2024/07/02 12:03:44
LORCAPACITYOPTION
Generation Availability to be used in LOR run (either PASA or MARKET)
SQL Type: VARCHAR2(10)
Polars Type: str
This column is not mandatory.
LORCONDITION
Lack of Reserve Condition (LOR) flag for the case indicates the most severe condition in the case (3 = LOR3, 2 = LOR2, 1 = LOR1, 0 = No LOR)
SQL Type: NUMBER(1,0)
Polars Type: pl.Boolean
This column is not mandatory.
LORDEMANDOPTION
Specifies the Probability of Exceedence (POE) demand forecast for LOR assessment (0 if no assessment, 10 for 10%, 50 for 50%, 90 for 90%)
SQL Type: NUMBER(12,3)
Polars Type: pl.Float64
This column is not mandatory.
LORUIGFOPTION
UIGF POE forecast availability used for this option
SQL Type: NUMBER(3,0)
Polars Type: pl.Int16
This column is not mandatory.
MAXSPARECAPACITYOPTION
Not populated as of 2005 End of Year Release; was the demand forecast used for assessment of Maximum Spare Capacity: 0 = no assessment, 1 = 10%, 2 = 50%, 3 = 90%
SQL Type: NUMBER(12,3)
Polars Type: pl.Float64
This column is not mandatory.
MAXSURPLUSRESERVEOPTION
Not populated as of 2005 End of Year Release; was the demand forecast used for assessment of Maximum surplus Reserve: 0 = no assessment, 1 = 10%, 2 = 50%, 3 = 90%
SQL Type: NUMBER(12,3)
Polars Type: pl.Float64
This column is not mandatory.
OUTAGELRCCAPACITYOPTION
Generation Availability to be used in Outage LRC run (either PASA or MARKET)
SQL Type: VARCHAR2(10)
Polars Type: str
This column is not mandatory.
OUTAGELRCDEMANDOPTION
Specifies the Probability of Exceedence (POE) demand forecast for outage LRC assessment (0 if no assessment, 10 for 10%, 50 for 50%, 90 for 90%)
SQL Type: NUMBER(12,3)
Polars Type: pl.Float64
This column is not mandatory.
OUTAGELRCUIGFOPTION
UIGF POE forecast availability used for this option
SQL Type: NUMBER(3,0)
Polars Type: pl.Int16
This column is not mandatory.
PASAVERSION
Version of the PASA solver used to solve this case
SQL Type: VARCHAR2(10)
Polars Type: str
This column is not mandatory.
RELIABILITYLRCCAPACITYOPTION
Generation Availability to be used in Reliability LRC run (either PASA or MARKET)
SQL Type: VARCHAR2(10)
Polars Type: str
This column is not mandatory.
RELIABILITYLRCDEMANDOPTION
Specifies the Probability of Exceedence (POE) demand forecast for Reliability LRC assessment (0 if no assessment, 10 for 10%, 50 for 50%, 90 for 90%)
SQL Type: NUMBER(12,3)
Polars Type: pl.Float64
This column is not mandatory.
RELIABILITYLRCUIGFOPTION
UIGF POE forecast availability used for this option
SQL Type: NUMBER(3,0)
Polars Type: pl.Int16
This column is not mandatory.
RESERVECONDITION
Low Reserve Condition (LRC) flag for the case (1 - LRC in the case, 0 - No LRCs in the case) for capacity run
SQL Type: NUMBER(1,0)
Polars Type: pl.Boolean
This column is not mandatory.
RUNTYPE
Discontinued in Dec 2005; was description of the constraints included in this run, being either System Normal and Planned Outage Constraints or System Normal Constraints Only
SQL Type: VARCHAR2(50)
Polars Type: pl.Categorical
This column is not mandatory.
New Data Timing
On MTPASA solution published to the market (usually once per week)
Code Examples
Polars
Casting is enums, categoricals etc is not essential, but may speed up parsing.
Swapping int for pl.UInt16, pl.Int32 would also speed up parsing. However some of the datatypes are inferred, so they may be wrong.
This code deduplicates for you. Deduplication is normally only required across multiple months.
This code assumes that all columns are present, which may not be true for older files.
import polars as pl
import polars.selectors as cs
# e.g. "2029/03/15 00:05:00"
dt_s_fmt = "%Y/%m/%d %H:%M:%S"
csv_paths = ["SOMEFILE.CSV", "OTHERFILE.CSV"]
lf = (
pl.concat(
[
pl.scan_csv(
csv_path, # must be unzipped beforehand
skip_rows=1, # skip the header
infer_schema=False, # much faster
)
.filter(cs.by_index(0) == "D") # drop the footer
.select(~cs.by_index(range(4))) # drop metadata columns
for csv_path in csv_paths
],
how="diagonal_relaxed",
)
.with_columns(
pl.col("RUN_DATETIME", "LASTCHANGED").str.strptime(pl.Datetime, dt_s_fmt),
)
# Polars can't cast string straight to bool. Need to go via something else.
.cast({"LORCONDITION": pl.UInt8, "RESERVECONDITION": pl.UInt8})
.cast(
{
"RUN_NO": int, # or pl.Int16
"CAPACITYOBJFUNCTION": pl.Float64,
"CAPACITYOPTION": pl.Float64,
"INTERCONNECTORFLOWPENALTY": pl.Float64,
"LORCAPACITYOPTION": str,
"LORCONDITION": pl.Boolean,
"LORDEMANDOPTION": pl.Float64,
"LORUIGFOPTION": int, # or pl.Int16
"MAXSPARECAPACITYOPTION": pl.Float64,
"MAXSURPLUSRESERVEOPTION": pl.Float64,
"OUTAGELRCCAPACITYOPTION": str,
"OUTAGELRCDEMANDOPTION": pl.Float64,
"OUTAGELRCUIGFOPTION": int, # or pl.Int16
"PASAVERSION": str,
"RELIABILITYLRCCAPACITYOPTION": str,
"RELIABILITYLRCDEMANDOPTION": pl.Float64,
"RELIABILITYLRCUIGFOPTION": int, # or pl.Int16
"RESERVECONDITION": pl.Boolean,
"RUNTYPE": pl.Categorical,
}
)
# Deduplicate
# We want one row per ['RUN_DATETIME', 'RUN_NO']
# Tie-breaker: greatest value of ['LASTCHANGED']
.sort(["LASTCHANGED"], descending=False)
.unique(subset=["RUN_DATETIME", "RUN_NO"], keep="last")
)
Nemosis
This table is not yet available in Nemosis.
Example File
From PUBLIC_DVD_MTPASA_CASESOLUTION_202407010000.zip
| RUN_DATETIME | RUN_NO | PASAVERSION | RESERVECONDITION | LORCONDITION | CAPACITYOBJFUNCTION | CAPACITYOPTION | MAXSURPLUSRESERVEOPTION | MAXSPARECAPACITYOPTION | INTERCONNECTORFLOWPENALTY | LASTCHANGED | RUNTYPE | RELIABILITYLRCDEMANDOPTION | OUTAGELRCDEMANDOPTION | LORDEMANDOPTION | RELIABILITYLRCCAPACITYOPTION | OUTAGELRCCAPACITYOPTION | LORCAPACITYOPTION | LORUIGFOPTION | RELIABILITYLRCUIGFOPTION | OUTAGELRCUIGFOPTION |
| 2024/07/12 02:00:00 | 861 | 2024/07/16 13:22:41 | ||||||||||||||||||
| 2024/07/22 02:00:00 | 866 | 2024/07/23 08:02:22 | ||||||||||||||||||
| 2024/07/08 02:00:00 | 860 | 2024/07/09 09:27:34 | ||||||||||||||||||
| 2024/07/01 02:00:00 | 857 | 2024/07/02 12:03:44 | ||||||||||||||||||
| 2024/07/29 02:00:00 | 869 | 2024/07/30 15:02:27 |
| C | SETP.WORLD | DVD_MTPASA_CASESOLUTION | AEMO | PUBLIC | 2024/08/06 | 16:25:03 | 0000000428653962 | MTPASA | 0000000428653863 | |||||||||||||||
| I | MTPASA | CASESOLUTION | 4 | RUN_DATETIME | RUN_NO | PASAVERSION | RESERVECONDITION | LORCONDITION | CAPACITYOBJFUNCTION | CAPACITYOPTION | MAXSURPLUSRESERVEOPTION | MAXSPARECAPACITYOPTION | INTERCONNECTORFLOWPENALTY | LASTCHANGED | RUNTYPE | RELIABILITYLRCDEMANDOPTION | OUTAGELRCDEMANDOPTION | LORDEMANDOPTION | RELIABILITYLRCCAPACITYOPTION | OUTAGELRCCAPACITYOPTION | LORCAPACITYOPTION | LORUIGFOPTION | RELIABILITYLRCUIGFOPTION | OUTAGELRCUIGFOPTION |
| D | MTPASA | CASESOLUTION | 4 | 2024/07/12 02:00:00 | 861 | 2024/07/16 13:22:41 | ||||||||||||||||||
| D | MTPASA | CASESOLUTION | 4 | 2024/07/22 02:00:00 | 866 | 2024/07/23 08:02:22 | ||||||||||||||||||
| D | MTPASA | CASESOLUTION | 4 | 2024/07/08 02:00:00 | 860 | 2024/07/09 09:27:34 | ||||||||||||||||||
| D | MTPASA | CASESOLUTION | 4 | 2024/07/01 02:00:00 | 857 | 2024/07/02 12:03:44 | ||||||||||||||||||
| D | MTPASA | CASESOLUTION | 4 | 2024/07/29 02:00:00 | 869 | 2024/07/30 15:02:27 | ||||||||||||||||||
| C | END OF REPORT | 8 |
RUN_DATETIME,RUN_NO,PASAVERSION,RESERVECONDITION,LORCONDITION,CAPACITYOBJFUNCTION,CAPACITYOPTION,MAXSURPLUSRESERVEOPTION,MAXSPARECAPACITYOPTION,INTERCONNECTORFLOWPENALTY,LASTCHANGED,RUNTYPE,RELIABILITYLRCDEMANDOPTION,OUTAGELRCDEMANDOPTION,LORDEMANDOPTION,RELIABILITYLRCCAPACITYOPTION,OUTAGELRCCAPACITYOPTION,LORCAPACITYOPTION,LORUIGFOPTION,RELIABILITYLRCUIGFOPTION,OUTAGELRCUIGFOPTION
"2024/07/12 02:00:00",861,,,,,,,,,"2024/07/16 13:22:41",,,,,,,,,,
"2024/07/22 02:00:00",866,,,,,,,,,"2024/07/23 08:02:22",,,,,,,,,,
"2024/07/08 02:00:00",860,,,,,,,,,"2024/07/09 09:27:34",,,,,,,,,,
"2024/07/01 02:00:00",857,,,,,,,,,"2024/07/02 12:03:44",,,,,,,,,,
"2024/07/29 02:00:00",869,,,,,,,,,"2024/07/30 15:02:27",,,,,,,,,,
C,SETP.WORLD,DVD_MTPASA_CASESOLUTION,AEMO,PUBLIC,2024/08/06,16:25:03,0000000428653962,MTPASA,0000000428653863
I,MTPASA,CASESOLUTION,4,RUN_DATETIME,RUN_NO,PASAVERSION,RESERVECONDITION,LORCONDITION,CAPACITYOBJFUNCTION,CAPACITYOPTION,MAXSURPLUSRESERVEOPTION,MAXSPARECAPACITYOPTION,INTERCONNECTORFLOWPENALTY,LASTCHANGED,RUNTYPE,RELIABILITYLRCDEMANDOPTION,OUTAGELRCDEMANDOPTION,LORDEMANDOPTION,RELIABILITYLRCCAPACITYOPTION,OUTAGELRCCAPACITYOPTION,LORCAPACITYOPTION,LORUIGFOPTION,RELIABILITYLRCUIGFOPTION,OUTAGELRCUIGFOPTION
D,MTPASA,CASESOLUTION,4,"2024/07/12 02:00:00",861,,,,,,,,,"2024/07/16 13:22:41",,,,,,,,,,
D,MTPASA,CASESOLUTION,4,"2024/07/22 02:00:00",866,,,,,,,,,"2024/07/23 08:02:22",,,,,,,,,,
D,MTPASA,CASESOLUTION,4,"2024/07/08 02:00:00",860,,,,,,,,,"2024/07/09 09:27:34",,,,,,,,,,
D,MTPASA,CASESOLUTION,4,"2024/07/01 02:00:00",857,,,,,,,,,"2024/07/02 12:03:44",,,,,,,,,,
D,MTPASA,CASESOLUTION,4,"2024/07/29 02:00:00",869,,,,,,,,,"2024/07/30 15:02:27",,,,,,,,,,
C,"END OF REPORT",8
Availability
Visibility: Public
This table is in the public monthly MMSDM archive.
I have collated the list of all those files into one place, in this CSV metadata file. (Columns year, month, url, compressed_size in bytes).
The earliest available data is month 1 of 2015. The most recent available data is month 7 of 2024.
Every month in between has a file. (No gaps.)
Data Size
Each year of data is approximately 7 KB when zipped, 70 KB as unzipped CSV.
Deduplication and PDR Loader Configuration
The primary keys are:
| Report Name | Report Subtype | Version | Undisclosed |
|---|---|---|---|
| MTPASA | CASESOLUTION | 4 | ⚠️ |
Warning
Some of these file mappings are not in the published PDR Loader configuration file, even though files for this table exist with those metadata values. Mappings marked with ⚠️ have been added by me after manually inspecting those files.
This means that the CSV files start with metadata columns:
Indexes
Links
This page as JSON (schema documented here, but may change)
Download a JSON Schema specification for this table.
Official AEMO schema documentation
Other Information
Package: HISTORICAL TABLES