Skip to content

MTPASA_INTERCONNECTORSOLUTION

MTPASA_INTERCONNECTORSOLUTION is obsolete from 2017 End of Year DM4.27 Release. The MTPASA_INTERCONNECTORSOLUTION table shows the results of the capacity evaluation for Interconnectors, including the calculated limits for the ldcblock within the day. Change Notice 379 announced the replacement of the MT PASA data model so all MTPASAxxx tables become obsolete, replaced by MTPASA_xxx tables (see Change Notices 400, 400a and 400b).

Deprecation Warning

This table is in the HISTORICAL TABLES package, so is likely deprecated.

MTPASA_INTERCONNECTORSOLUTION is public so is available to all participants.

Source

MTPASA_INTERCONNECTORSOLUTION is updated each MTPASA run (i.e. weekly).

Volume

Rows per week: 35280

To store only the latest solution, divide these figures by 5 (number of weeks per month rounded up).

Column Schema

DAY

Day this solution is for. Generated from the solution file periodid

SQL Type: DATE Polars Type: pl.Datetime()

This column is mandatory, and a primary key.

Example: 2018/05/06 00:00:00

ENERGYBLOCK

Sunday at start of the week for this solutions energy block. Generated from the solution file energy block

SQL Type: DATE Polars Type: pl.Datetime()

This column is mandatory, and a primary key.

Example: 2018/05/06 00:00:00

INTERCONNECTORID

The unique identifier for the interconnector

SQL Type: VARCHAR2(10) Polars Type: pl.Categorical

This column is mandatory, and a primary key.

Examples:

  • N-Q-MNSP1
  • NSW1-QLD1
  • T-V-MNSP1
  • V-S-MNSP1
  • V-SA
  • VIC1-NSW1

LDCBLOCK

LDC block this solution is for. Generated from the solution file periodid

SQL Type: NUMBER(3,0) Polars Type: pl.Int16

This column is mandatory, and a primary key.

Example: 1

RUN_DATETIME

Date processing of the run begins

SQL Type: DATE Polars Type: pl.Datetime()

This column is mandatory, and a primary key.

Example: 2018/05/01 12:00:00

RUN_NO

Unique run id. Generated from the solution file caseid

SQL Type: NUMBER(3,0) Polars Type: pl.Int16

This column is mandatory, and a primary key.

Example: 20

RUNTYPE

Type of run. Values are RELIABILITY_LRC and OUTAGE_LRC

SQL Type: VARCHAR2(20) Polars Type: pl.Categorical

This column is mandatory, and a primary key.

Example: OUTAGE_LIMITS

CALCULATEDEXPORTLIMIT

Calculated Interconnector limit of exporting energy on the basis of invoked constraints and static interconnector export limit

SQL Type: NUMBER(12,2) Polars Type: pl.Float64

This column is not mandatory.

Examples: -0.05, 0.21, 0, 650

CALCULATEDIMPORTLIMIT

Calculated Interconnector limit of importing energy on the basis of invoked constraints and static interconnector import limit. Note unlike the input interconnector import limit this is a directional quantity and should be defined with respect to the interconnector flow

SQL Type: NUMBER(12,2) Polars Type: pl.Float64

This column is not mandatory.

Examples: -2.19, 32.7, 0, 220

CAPACITYMARGINALVALUE

Capacity adequacy assessment marginal value; 0 if not binding

SQL Type: NUMBER(12,2) Polars Type: pl.Float64

This column is not mandatory.

Examples: 226.28, 0, 14294.27

CAPACITYMWFLOW

Interconnector loading level (MW) that can be reached in case of capacity scarcity in neighbouring regions subject to network and energy constraints

SQL Type: NUMBER(12,2) Polars Type: pl.Float64

This column is not mandatory.

CAPACITYVIOLATIONDEGREE

Capacity adequacy assessment violation degree, 0 if not violating; where CapacityMWFLow <= export + violation Degree (Deficit)CapacityMWFLow >= import + CapacityViolationDegree (Deficit)

SQL Type: NUMBER(12,2) Polars Type: pl.Float64

This column is not mandatory.

Example: 0

EXPORTLIMITCONSTRAINTID

ID of the constraint that sets the Interconnector Export Limit

SQL Type: VARCHAR2(20) Polars Type: str

This column is not mandatory.

Examples:

  • MT_Q^^NIL_TR
  • N>>N-NIL__E_15M
  • N>>N-NIL__H_15M
  • N>N-NIL_LSDU
  • N^^Q_NIL_B4
  • N^^Q_WIV_N-2
  • V:SS_BLKRG_790
  • V:SV_820_MT
  • V:SV_870_MT
  • V:S_BLKRG_570

IMPORTLIMITCONSTRAINTID

ID of the constraint that sets the Interconnector Import Limit

SQL Type: VARCHAR2(20) Polars Type: str

This column is not mandatory.

Examples:

  • MT_F_Q-N_ARTW
  • MT_Q^^NIL_CS
  • N::V_DDSM_MSDD
  • N>N-NIL_DC
  • N^^V_NIL_1
  • N_MBTE1_B
  • N_NIL_TE_B
  • N_V_HV1075
  • Q:N_1078
  • Q:N_NIL_OSC

LASTCHANGED

Date the solution was loaded

For more information, see the dedicated documentation page.

SQL Type: DATE Polars Type: pl.Datetime()

This column is not mandatory.

Example: 2018/05/01 12:31:15

New Data Timing

On MTPASA solution published to the market (usually once per week)

Code Examples

Polars

Casting is enums, categoricals etc is not essential, but may speed up parsing. Swapping int for pl.UInt16, pl.Int32 would also speed up parsing. However some of the datatypes are inferred, so they may be wrong.

This code deduplicates for you. Deduplication is normally only required across multiple months.

This code assumes that all columns are present, which may not be true for older files.

import polars as pl
import polars.selectors as cs

# e.g. "2029/03/15 00:05:00"
dt_s_fmt = "%Y/%m/%d %H:%M:%S"

csv_paths = ["SOMEFILE.CSV", "OTHERFILE.CSV"]

lf = (
    pl.concat(
        [
            pl.scan_csv(
                csv_path,  # must be unzipped beforehand
                skip_rows=1,  # skip the header
                infer_schema=False,  # much faster
            )
            .filter(cs.by_index(0) == "D")  # drop the footer
            .select(~cs.by_index(range(4)))  # drop metadata columns
            for csv_path in csv_paths
        ],
        how="diagonal_relaxed",
    )
    .with_columns(
        pl.col("DAY", "ENERGYBLOCK", "RUN_DATETIME", "LASTCHANGED").str.strptime(
            pl.Datetime, dt_s_fmt
        ),
    )
    .cast(
        {
            "INTERCONNECTORID": pl.Categorical,
            "LDCBLOCK": int,  # or pl.Int16
            "RUN_NO": int,  # or pl.Int16
            "RUNTYPE": pl.Categorical,
            "CALCULATEDEXPORTLIMIT": pl.Float64,
            "CALCULATEDIMPORTLIMIT": pl.Float64,
            "CAPACITYMARGINALVALUE": pl.Float64,
            "CAPACITYMWFLOW": pl.Float64,
            "CAPACITYVIOLATIONDEGREE": pl.Float64,
            "EXPORTLIMITCONSTRAINTID": str,
            "IMPORTLIMITCONSTRAINTID": str,
        }
    )
    # Deduplicate
    # We want one row per ['DAY', 'ENERGYBLOCK', 'INTERCONNECTORID', 'LDCBLOCK', 'RUN_DATETIME', 'RUN_NO', 'RUNTYPE']
    # Tie-breaker: greatest value of ['LASTCHANGED']
    .sort(["LASTCHANGED"], descending=False)
    .unique(
        subset=[
            "DAY",
            "ENERGYBLOCK",
            "INTERCONNECTORID",
            "LDCBLOCK",
            "RUN_DATETIME",
            "RUN_NO",
            "RUNTYPE",
        ],
        keep="last",
    )
)

Nemosis

This table is not yet available in Nemosis.

Example File

From PUBLIC_DVD_MTPASA_INTERCONNECTORSOLUTION_201805010000.zip

RUN_DATETIMERUN_NOENERGYBLOCKDAYLDCBLOCKINTERCONNECTORIDCAPACITYMWFLOWCAPACITYMARGINALVALUECAPACITYVIOLATIONDEGREECALCULATEDEXPORTLIMITCALCULATEDIMPORTLIMITLASTCHANGEDRUNTYPEEXPORTLIMITCONSTRAINTIDIMPORTLIMITCONSTRAINTID
2018/05/01 12:00:00202018/05/06 00:00:002018/05/06 00:00:001N-Q-MNSP1001.74-1202018/05/01 12:31:15OUTAGE_LIMITSN>N-NIL_LSDUN_MBTE1_B
2018/05/01 12:00:00202018/05/06 00:00:002018/05/06 00:00:001NSW1-QLD100-447.3-12002018/05/01 12:31:15OUTAGE_LIMITSMT_Q^^NIL_TRQ:N_NIL_OSC
2018/05/01 12:00:00202018/05/06 00:00:002018/05/06 00:00:001T-V-MNSP114288.980002018/05/01 12:31:15OUTAGE_LIMITS
2018/05/01 12:00:00202018/05/06 00:00:002018/05/06 00:00:001V-S-MNSP100201.2201.22018/05/01 12:31:15OUTAGE_LIMITSV>SMLARHO2V>>V_NIL_1A
2018/05/01 12:00:00202018/05/06 00:00:002018/05/06 00:00:001V-SA00600-5002018/05/01 12:31:15OUTAGE_LIMITSV>S_600_MTS>V_500_MT
2018/05/01 12:00:00202018/05/06 00:00:002018/05/06 00:00:001VIC1-NSW100343.05-410.712018/05/01 12:31:15OUTAGE_LIMITSN>>N-NIL__H_15MV>>V_NIL_1A
2018/05/01 12:00:00202018/05/06 00:00:002018/05/07 00:00:001N-Q-MNSP100-3.55-1202018/05/01 12:31:15OUTAGE_LIMITSN>N-NIL_LSDUN_MBTE1_B
2018/05/01 12:00:00202018/05/06 00:00:002018/05/07 00:00:001NSW1-QLD100-447.3-12002018/05/01 12:31:15OUTAGE_LIMITSMT_Q^^NIL_TRQ:N_NIL_OSC
2018/05/01 12:00:00202018/05/06 00:00:002018/05/07 00:00:001T-V-MNSP114286.270002018/05/01 12:31:15OUTAGE_LIMITS
2018/05/01 12:00:00202018/05/06 00:00:002018/05/07 00:00:001V-S-MNSP100220-189.692018/05/01 12:31:15OUTAGE_LIMITSVSML_220S>V_NIL_NIL_RBNW
2018/05/01 12:00:00202018/05/06 00:00:002018/05/07 00:00:001V-SA00600-5002018/05/01 12:31:15OUTAGE_LIMITSV:SV_820_MTS>V_500_MT
...

CSETP.WORLDDVD_MTPASA_INTERCONNECTORSOLUTIONAEMOPUBLIC2018/06/0700:35:0300000002955534190000000295553313
IMTPASAINTERCONNECTORSOLUTION1RUN_DATETIMERUN_NOENERGYBLOCKDAYLDCBLOCKINTERCONNECTORIDCAPACITYMWFLOWCAPACITYMARGINALVALUECAPACITYVIOLATIONDEGREECALCULATEDEXPORTLIMITCALCULATEDIMPORTLIMITLASTCHANGEDRUNTYPEEXPORTLIMITCONSTRAINTIDIMPORTLIMITCONSTRAINTID
DMTPASAINTERCONNECTORSOLUTION12018/05/01 12:00:00202018/05/06 00:00:002018/05/06 00:00:001N-Q-MNSP1001.74-1202018/05/01 12:31:15OUTAGE_LIMITSN>N-NIL_LSDUN_MBTE1_B
DMTPASAINTERCONNECTORSOLUTION12018/05/01 12:00:00202018/05/06 00:00:002018/05/06 00:00:001NSW1-QLD100-447.3-12002018/05/01 12:31:15OUTAGE_LIMITSMT_Q^^NIL_TRQ:N_NIL_OSC
DMTPASAINTERCONNECTORSOLUTION12018/05/01 12:00:00202018/05/06 00:00:002018/05/06 00:00:001T-V-MNSP114288.980002018/05/01 12:31:15OUTAGE_LIMITS
DMTPASAINTERCONNECTORSOLUTION12018/05/01 12:00:00202018/05/06 00:00:002018/05/06 00:00:001V-S-MNSP100201.2201.22018/05/01 12:31:15OUTAGE_LIMITSV>SMLARHO2V>>V_NIL_1A
DMTPASAINTERCONNECTORSOLUTION12018/05/01 12:00:00202018/05/06 00:00:002018/05/06 00:00:001V-SA00600-5002018/05/01 12:31:15OUTAGE_LIMITSV>S_600_MTS>V_500_MT
DMTPASAINTERCONNECTORSOLUTION12018/05/01 12:00:00202018/05/06 00:00:002018/05/06 00:00:001VIC1-NSW100343.05-410.712018/05/01 12:31:15OUTAGE_LIMITSN>>N-NIL__H_15MV>>V_NIL_1A
DMTPASAINTERCONNECTORSOLUTION12018/05/01 12:00:00202018/05/06 00:00:002018/05/07 00:00:001N-Q-MNSP100-3.55-1202018/05/01 12:31:15OUTAGE_LIMITSN>N-NIL_LSDUN_MBTE1_B
DMTPASAINTERCONNECTORSOLUTION12018/05/01 12:00:00202018/05/06 00:00:002018/05/07 00:00:001NSW1-QLD100-447.3-12002018/05/01 12:31:15OUTAGE_LIMITSMT_Q^^NIL_TRQ:N_NIL_OSC
DMTPASAINTERCONNECTORSOLUTION12018/05/01 12:00:00202018/05/06 00:00:002018/05/07 00:00:001T-V-MNSP114286.270002018/05/01 12:31:15OUTAGE_LIMITS
DMTPASAINTERCONNECTORSOLUTION12018/05/01 12:00:00202018/05/06 00:00:002018/05/07 00:00:001V-S-MNSP100220-189.692018/05/01 12:31:15OUTAGE_LIMITSVSML_220S>V_NIL_NIL_RBNW
DMTPASAINTERCONNECTORSOLUTION12018/05/01 12:00:00202018/05/06 00:00:002018/05/07 00:00:001V-SA00600-5002018/05/01 12:31:15OUTAGE_LIMITSV:SV_820_MTS>V_500_MT
...
CEND OF REPORT1003

RUN_DATETIME,RUN_NO,ENERGYBLOCK,DAY,LDCBLOCK,INTERCONNECTORID,CAPACITYMWFLOW,CAPACITYMARGINALVALUE,CAPACITYVIOLATIONDEGREE,CALCULATEDEXPORTLIMIT,CALCULATEDIMPORTLIMIT,LASTCHANGED,RUNTYPE,EXPORTLIMITCONSTRAINTID,IMPORTLIMITCONSTRAINTID
"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/06 00:00:00",1,N-Q-MNSP1,,0,0,1.74,-120,"2018/05/01 12:31:15",OUTAGE_LIMITS,N>N-NIL_LSDU,N_MBTE1_B
"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/06 00:00:00",1,NSW1-QLD1,,0,0,-447.3,-1200,"2018/05/01 12:31:15",OUTAGE_LIMITS,MT_Q^^NIL_TR,Q:N_NIL_OSC
"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/06 00:00:00",1,T-V-MNSP1,,14288.98,0,0,0,"2018/05/01 12:31:15",OUTAGE_LIMITS,,
"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/06 00:00:00",1,V-S-MNSP1,,0,0,201.2,201.2,"2018/05/01 12:31:15",OUTAGE_LIMITS,V>SMLARHO2,V>>V_NIL_1A
"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/06 00:00:00",1,V-SA,,0,0,600,-500,"2018/05/01 12:31:15",OUTAGE_LIMITS,V>S_600_MT,S>V_500_MT
"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/06 00:00:00",1,VIC1-NSW1,,0,0,343.05,-410.71,"2018/05/01 12:31:15",OUTAGE_LIMITS,N>>N-NIL__H_15M,V>>V_NIL_1A
"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/07 00:00:00",1,N-Q-MNSP1,,0,0,-3.55,-120,"2018/05/01 12:31:15",OUTAGE_LIMITS,N>N-NIL_LSDU,N_MBTE1_B
"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/07 00:00:00",1,NSW1-QLD1,,0,0,-447.3,-1200,"2018/05/01 12:31:15",OUTAGE_LIMITS,MT_Q^^NIL_TR,Q:N_NIL_OSC
"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/07 00:00:00",1,T-V-MNSP1,,14286.27,0,0,0,"2018/05/01 12:31:15",OUTAGE_LIMITS,,
"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/07 00:00:00",1,V-S-MNSP1,,0,0,220,-189.69,"2018/05/01 12:31:15",OUTAGE_LIMITS,VSML_220,S>V_NIL_NIL_RBNW
"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/07 00:00:00",1,V-SA,,0,0,600,-500,"2018/05/01 12:31:15",OUTAGE_LIMITS,V:SV_820_MT,S>V_500_MT
...

C,SETP.WORLD,DVD_MTPASA_INTERCONNECTORSOLUTION,AEMO,PUBLIC,2018/06/07,00:35:03,0000000295553419,,0000000295553313
I,MTPASA,INTERCONNECTORSOLUTION,1,RUN_DATETIME,RUN_NO,ENERGYBLOCK,DAY,LDCBLOCK,INTERCONNECTORID,CAPACITYMWFLOW,CAPACITYMARGINALVALUE,CAPACITYVIOLATIONDEGREE,CALCULATEDEXPORTLIMIT,CALCULATEDIMPORTLIMIT,LASTCHANGED,RUNTYPE,EXPORTLIMITCONSTRAINTID,IMPORTLIMITCONSTRAINTID
D,MTPASA,INTERCONNECTORSOLUTION,1,"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/06 00:00:00",1,N-Q-MNSP1,,0,0,1.74,-120,"2018/05/01 12:31:15",OUTAGE_LIMITS,N>N-NIL_LSDU,N_MBTE1_B
D,MTPASA,INTERCONNECTORSOLUTION,1,"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/06 00:00:00",1,NSW1-QLD1,,0,0,-447.3,-1200,"2018/05/01 12:31:15",OUTAGE_LIMITS,MT_Q^^NIL_TR,Q:N_NIL_OSC
D,MTPASA,INTERCONNECTORSOLUTION,1,"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/06 00:00:00",1,T-V-MNSP1,,14288.98,0,0,0,"2018/05/01 12:31:15",OUTAGE_LIMITS,,
D,MTPASA,INTERCONNECTORSOLUTION,1,"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/06 00:00:00",1,V-S-MNSP1,,0,0,201.2,201.2,"2018/05/01 12:31:15",OUTAGE_LIMITS,V>SMLARHO2,V>>V_NIL_1A
D,MTPASA,INTERCONNECTORSOLUTION,1,"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/06 00:00:00",1,V-SA,,0,0,600,-500,"2018/05/01 12:31:15",OUTAGE_LIMITS,V>S_600_MT,S>V_500_MT
D,MTPASA,INTERCONNECTORSOLUTION,1,"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/06 00:00:00",1,VIC1-NSW1,,0,0,343.05,-410.71,"2018/05/01 12:31:15",OUTAGE_LIMITS,N>>N-NIL__H_15M,V>>V_NIL_1A
D,MTPASA,INTERCONNECTORSOLUTION,1,"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/07 00:00:00",1,N-Q-MNSP1,,0,0,-3.55,-120,"2018/05/01 12:31:15",OUTAGE_LIMITS,N>N-NIL_LSDU,N_MBTE1_B
D,MTPASA,INTERCONNECTORSOLUTION,1,"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/07 00:00:00",1,NSW1-QLD1,,0,0,-447.3,-1200,"2018/05/01 12:31:15",OUTAGE_LIMITS,MT_Q^^NIL_TR,Q:N_NIL_OSC
D,MTPASA,INTERCONNECTORSOLUTION,1,"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/07 00:00:00",1,T-V-MNSP1,,14286.27,0,0,0,"2018/05/01 12:31:15",OUTAGE_LIMITS,,
D,MTPASA,INTERCONNECTORSOLUTION,1,"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/07 00:00:00",1,V-S-MNSP1,,0,0,220,-189.69,"2018/05/01 12:31:15",OUTAGE_LIMITS,VSML_220,S>V_NIL_NIL_RBNW
D,MTPASA,INTERCONNECTORSOLUTION,1,"2018/05/01 12:00:00",20,"2018/05/06 00:00:00","2018/05/07 00:00:00",1,V-SA,,0,0,600,-500,"2018/05/01 12:31:15",OUTAGE_LIMITS,V:SV_820_MT,S>V_500_MT
...
C,"END OF REPORT",1003

Availability

Visibility: Public

This table is in the public monthly MMSDM archive.

I have collated the list of all those files into one place, in this CSV metadata file. (Columns year, month, url, compressed_size in bytes).

The earliest available data is month 1 of 2015. The most recent available data is month 5 of 2018.

Every month in between has a file. (No gaps.)

Data Size

Each year of data is approximately 3 MB when zipped, 35 MB as unzipped CSV.

Deduplication and PDR Loader Configuration

The primary keys are:

PDR Loader configuration is:

Report Name Report Subtype Version Undisclosed
MTPASA INTERCONNECTORSOLUTION 1 ⚠️

Warning

Some of these file mappings are not in the published PDR Loader configuration file, even though files for this table exist with those metadata values. Mappings marked with ⚠️ have been added by me after manually inspecting those files.

This means that the CSV files start with metadata columns:

I,MTPASA,INTERCONNECTORSOLUTION,1,...
D,MTPASA,INTERCONNECTORSOLUTION,1,...

Indexes

This page as JSON (schema documented here, but may change)

Download a JSON Schema specification for this table.

Official AEMO schema documentation

Other Information

Package: HISTORICAL TABLES