FPP_RESIDUAL_CF

This report delivers the calculated residual contribution factor value for each 5 minute trading interval for each constraint

Column Schema

CONSTRAINTID

Constraint ID (binding constraint ID from FCAS data used in FPP calculations)

SQL Type: VARCHAR2(20) Polars Type: pl.Categorical

This column is mandatory, and a primary key.

Examples:

F_I+GFT_TG_R5
F_I+LREG_0210
F_I+NIL_APD_TL_L5
F_I+NIL_MG_R5
F_I+RREG_0220
F_MAIN++APD_TL_L5
F_MAIN++LREG_0210
F_MAIN++RREG_0220
F_MAIN+LREG_0210
F_MAIN+RREG_0220

INTERVAL_DATETIME

Date and time of the trading interval (DD/MM/YYYY HH24:MI:SS) fixed to the UTC+10 time zone (NEM time)

SQL Type: DATE Polars Type: pl.Datetime()

This column is mandatory, and a primary key.

Example: 2026/09/01 00:05:00

VERSIONNO

Version (FPP run number from the FPP database)

SQL Type: NUMBER(5) Polars Type: pl.UInt32

This column is mandatory, and a primary key.

Example: 1

BIDTYPE

Bid type (the bid type saved in relation to constraint ID from FCAS data used in FPP calculations)

The SQL type is VARCHAR2(10). This is actually a factor/enum, with values:

ENERGY
LOWERREG
LOWER60SEC
RAISE5MIN
LOWER5MIN
LOWER6SEC
RAISE60SEC
RAISE6SEC
RAISEREG
RAISE1SEC
LOWER1SEC

This column is not mandatory.

CF_ABS_NEGATIVE_PERF_TOTAL

The sum of absolute negative performance in MWHz for the combination of constraint / bid type (raise or lower). This is used as the denominator in normalising contribution factors (CF) where a units performance is negative. For further details please see the FPP procedure document. >0 = Performance was calculated for the units NULL = Performance for the units was unavailable

SQL Type: NUMBER(18,8) Polars Type: pl.Float64

This column is not mandatory.

Examples: 0.10022, 0, 3618.21287

CF_ABS_POSITIVE_PERF_TOTAL

The sum of absolute positive performance in MWHz for the combination of constraint / bid type (raise or lower). This is used as the denominator in normalising contribution factors (CF) where a units performance is positive. For further details please see the FPP procedure document. >0 = Performance was calculated for the units NULL = Performance for the units was unavailable

SQL Type: NUMBER(18,8) Polars Type: pl.Float64

This column is not mandatory.

Examples: 0.06446, 0, 3586.56892

LASTCHANGED

Last date and time record changed

For more information, see the dedicated documentation page.

SQL Type: DATE Polars Type: pl.Datetime()

This column is not mandatory.

Example: 2026/09/01 00:10:20

NCF_ABS_NEGATIVE_PERF_TOTAL

The sum of absolute negative performance in MWHz for the combination of constraint / bid type (raise or lower). This is used as the denominator in normalising negative contribution factors (NCF). For further details please see the FPP procedure document. >0 = Performance was calculated for the units NULL = Performance for the units was unavailable 0 = When NCF is zero (i.e. CF is positive), then this total will be represented as zero

SQL Type: NUMBER(18,8) Polars Type: pl.Float64

This column is not mandatory.

Examples: 0.10022, 0, 3618.21992

NEGATIVE_RESIDUAL_CF

Negative Residual Contribution Factor (the calculated negative residual contribution factor for the constraint ID for that trading interval) - for further details please see the FPP procedure document

SQL Type: NUMBER(18,8) Polars Type: pl.Float64

This column is not mandatory.

Examples: -0.00002002, 0, -0.9919338

RESIDUAL_CF

Residual Contribution Factor (the calculated residual contribution factor for the constraint ID for that trading interval) - for further details please see the FPP procedure document

SQL Type: NUMBER(18,8) Polars Type: pl.Float64

This column is not mandatory.

Examples: -0.00002002, 0.0007425, 0, 0.90012985

RESIDUAL_CF_REASON_FLAG

The reason flag showing the decision matrix for the residual contribution factor (CF) Supported values are: 0 = CF is calculated based on good input data 8 = CF is 0 because FM is unreliable. 16 = CF is 0 because more than 50 percent input is bad or not available.

SQL Type: NUMBER(5) Polars Type: pl.Int32

This column is not mandatory.

Examples: 0, 8, 16

RESIDUAL_DCF

The Residual Default Contribution Factor (the calculated residual default contribution factor based on historical performance for the constraint ID for that trading interval) that is effective for this trading interval, which joins back to FPP_FORECAST_RESIDUAL_DCF - for further details please see the FPP procedure document

SQL Type: NUMBER(18,8) Polars Type: pl.Float64

This column is not mandatory.

Examples: -0.08762999, -0.63949506

New Data Timing

The public report will be delivered at the completion of an FPP calculation run for a closed trading interval (i.e. every 5 minutes)

Code Examples

Polars

Casting is enums, categoricals etc is not essential, but may speed up parsing. Swapping int for pl.UInt16, pl.Int32 would also speed up parsing. However some of the datatypes are inferred, so they may be wrong.

This code deduplicates for you. Deduplication is normally only required across multiple months.

This code assumes that all columns are present, which may not be true for older files.

import polars as pl
import polars.selectors as cs

# e.g. "2029/03/15 00:05:00"
dt_s_fmt = "%Y/%m/%d %H:%M:%S"

csv_paths = ["SOMEFILE.CSV", "OTHERFILE.CSV"]

lf = (
    pl.concat(
        [
            pl.scan_csv(
                csv_path,  # must be unzipped beforehand
                skip_rows=1,  # skip the header
                infer_schema=False,  # much faster
            )
            .filter(cs.by_index(0) == "D")  # drop the footer
            .select(~cs.by_index(range(4)))  # drop metadata columns
            for csv_path in csv_paths
        ],
        how="diagonal_relaxed",
    )
    .rename(
        {
            # These columns have names that conflict with metadata columns
            "RESIDUAL_CF_duplicated_0": "RESIDUAL_CF"
        }
    )
    .with_columns(
        pl.col("INTERVAL_DATETIME", "LASTCHANGED").str.strptime(pl.Datetime, dt_s_fmt),
    )
    .cast(
        {
            "CONSTRAINTID": pl.Categorical,
            "VERSIONNO": int,  # or pl.UInt32
            "BIDTYPE": pl.Enum(
                [
                    "ENERGY",
                    "LOWERREG",
                    "LOWER60SEC",
                    "RAISE5MIN",
                    "LOWER5MIN",
                    "LOWER6SEC",
                    "RAISE60SEC",
                    "RAISE6SEC",
                    "RAISEREG",
                    "RAISE1SEC",
                    "LOWER1SEC",
                ]
            ),
            "CF_ABS_NEGATIVE_PERF_TOTAL": pl.Float64,
            "CF_ABS_POSITIVE_PERF_TOTAL": pl.Float64,
            "NCF_ABS_NEGATIVE_PERF_TOTAL": pl.Float64,
            "NEGATIVE_RESIDUAL_CF": pl.Float64,
            "RESIDUAL_CF": pl.Float64,
            "RESIDUAL_CF_REASON_FLAG": int,  # or pl.Int32
            "RESIDUAL_DCF": pl.Float64,
        }
    )
    # Deduplicate
    # We want one row per ['CONSTRAINTID', 'INTERVAL_DATETIME', 'VERSIONNO']
    # Tie-breaker: greatest value of LASTCHANGED
    .sort(LASTCHANGED, descending=False)
    .unique(subset=["CONSTRAINTID", "INTERVAL_DATETIME", "VERSIONNO"], keep="last")
)

Nemosis

This table is not yet available in Nemosis.

Example File

From PUBLIC_ARCHIVE_FPP_RESIDUAL_CF_FILE01_202609010000.zip

Table without MetadataTable with MetadataRaw Text without Metadata

INTERVAL_DATETIME	CONSTRAINTID	VERSIONNO	BIDTYPE	RESIDUAL_CF	NEGATIVE_RESIDUAL_CF	RESIDUAL_DCF	RESIDUAL_CF_REASON_FLAG	CF_ABS_POSITIVE_PERF_TOTAL	CF_ABS_NEGATIVE_PERF_TOTAL	NCF_ABS_NEGATIVE_PERF_TOTAL	LASTCHANGED
2026/09/01 00:05:00	F_T+LREG_0050	1	LOWERREG	0	0	-0.63949506	8	0	0	0	2026/09/01 00:10:20
2026/09/01 00:05:00	F_T+RREG_0050	1	RAISEREG	0.38006912	0	-0.08762999	0	24.54985	18.00002	18.00002	2026/09/01 00:10:20
2026/09/01 00:05:00	F_TASCAP_LREG_0210	1	LOWERREG	0	0	-0.26588458	8	0	0	0	2026/09/01 00:10:20
2026/09/01 00:05:00	F_TASCAP_RREG_0220	1	RAISEREG	-0.73385796	-0.73384929	-0.28792949	0	590.56978	597.15514	597.16219	2026/09/01 00:10:20
2026/09/01 00:10:00	F_T+LREG_0050	1	LOWERREG	-0.43962775	-0.43962775	-0.63949506	0	1.41659	2.76377	2.76377	2026/09/01 00:14:20
2026/09/01 00:10:00	F_T+RREG_0050	1	RAISEREG	0.51570765	0	-0.08762999	0	5.43907	3.23356	3.23356	2026/09/01 00:14:20
2026/09/01 00:10:00	F_TASCAP_LREG_0210	1	LOWERREG	0	0	-0.26588458	8	0	0	0	2026/09/01 00:14:20
2026/09/01 00:10:00	F_TASCAP_RREG_0220	1	RAISEREG	-0.65567469	-0.6556243	-0.28792949	0	91.72612	91.72326	91.73031	2026/09/01 00:14:20
2026/09/01 00:15:00	F_T+LREG_0050	1	LOWERREG	-0.76644615	-0.76644615	-0.63949506	0	1.38183	2.07845	2.07845	2026/09/01 00:20:20
2026/09/01 00:15:00	F_T+RREG_0050	1	RAISEREG	0.72487449	0	-0.08762999	0	4.45593	2.32214	2.32214	2026/09/01 00:20:20
2026/09/01 00:15:00	F_TASCAP_LREG_0210	1	LOWERREG	0.43709729	0	-0.26588458	0	31.37194	31.1546	31.15503	2026/09/01 00:20:20
...

C	SETP.WORLD	DVD_FPP_RESIDUAL_CF	AEMO	PUBLIC	2026/10/09	17:49:58	001791532198061	MONTHLY_ARCHIVE	001791532198061
I	FPP	RESIDUAL_CF	1	INTERVAL_DATETIME	CONSTRAINTID	VERSIONNO	BIDTYPE	RESIDUAL_CF	NEGATIVE_RESIDUAL_CF	RESIDUAL_DCF	RESIDUAL_CF_REASON_FLAG	CF_ABS_POSITIVE_PERF_TOTAL	CF_ABS_NEGATIVE_PERF_TOTAL	NCF_ABS_NEGATIVE_PERF_TOTAL	LASTCHANGED
D	FPP	RESIDUAL_CF	1	2026/09/01 00:05:00	F_T+LREG_0050	1	LOWERREG	0	0	-0.63949506	8	0	0	0	2026/09/01 00:10:20
D	FPP	RESIDUAL_CF	1	2026/09/01 00:05:00	F_T+RREG_0050	1	RAISEREG	0.38006912	0	-0.08762999	0	24.54985	18.00002	18.00002	2026/09/01 00:10:20
D	FPP	RESIDUAL_CF	1	2026/09/01 00:05:00	F_TASCAP_LREG_0210	1	LOWERREG	0	0	-0.26588458	8	0	0	0	2026/09/01 00:10:20
D	FPP	RESIDUAL_CF	1	2026/09/01 00:05:00	F_TASCAP_RREG_0220	1	RAISEREG	-0.73385796	-0.73384929	-0.28792949	0	590.56978	597.15514	597.16219	2026/09/01 00:10:20
D	FPP	RESIDUAL_CF	1	2026/09/01 00:10:00	F_T+LREG_0050	1	LOWERREG	-0.43962775	-0.43962775	-0.63949506	0	1.41659	2.76377	2.76377	2026/09/01 00:14:20
D	FPP	RESIDUAL_CF	1	2026/09/01 00:10:00	F_T+RREG_0050	1	RAISEREG	0.51570765	0	-0.08762999	0	5.43907	3.23356	3.23356	2026/09/01 00:14:20
D	FPP	RESIDUAL_CF	1	2026/09/01 00:10:00	F_TASCAP_LREG_0210	1	LOWERREG	0	0	-0.26588458	8	0	0	0	2026/09/01 00:14:20
D	FPP	RESIDUAL_CF	1	2026/09/01 00:10:00	F_TASCAP_RREG_0220	1	RAISEREG	-0.65567469	-0.6556243	-0.28792949	0	91.72612	91.72326	91.73031	2026/09/01 00:14:20
D	FPP	RESIDUAL_CF	1	2026/09/01 00:15:00	F_T+LREG_0050	1	LOWERREG	-0.76644615	-0.76644615	-0.63949506	0	1.38183	2.07845	2.07845	2026/09/01 00:20:20
D	FPP	RESIDUAL_CF	1	2026/09/01 00:15:00	F_T+RREG_0050	1	RAISEREG	0.72487449	0	-0.08762999	0	4.45593	2.32214	2.32214	2026/09/01 00:20:20
D	FPP	RESIDUAL_CF	1	2026/09/01 00:15:00	F_TASCAP_LREG_0210	1	LOWERREG	0.43709729	0	-0.26588458	0	31.37194	31.1546	31.15503	2026/09/01 00:20:20
...
C	END OF REPORT	1003

INTERVAL_DATETIME,CONSTRAINTID,VERSIONNO,BIDTYPE,RESIDUAL_CF,NEGATIVE_RESIDUAL_CF,RESIDUAL_DCF,RESIDUAL_CF_REASON_FLAG,CF_ABS_POSITIVE_PERF_TOTAL,CF_ABS_NEGATIVE_PERF_TOTAL,NCF_ABS_NEGATIVE_PERF_TOTAL,LASTCHANGED
"2026/09/01 00:05:00",F_T+LREG_0050,1,LOWERREG,0,0,-0.63949506,8,0,0,0,"2026/09/01 00:10:20"
"2026/09/01 00:05:00",F_T+RREG_0050,1,RAISEREG,0.38006912,0,-0.08762999,0,24.54985,18.00002,18.00002,"2026/09/01 00:10:20"
"2026/09/01 00:05:00",F_TASCAP_LREG_0210,1,LOWERREG,0,0,-0.26588458,8,0,0,0,"2026/09/01 00:10:20"
"2026/09/01 00:05:00",F_TASCAP_RREG_0220,1,RAISEREG,-0.73385796,-0.73384929,-0.28792949,0,590.56978,597.15514,597.16219,"2026/09/01 00:10:20"
"2026/09/01 00:10:00",F_T+LREG_0050,1,LOWERREG,-0.43962775,-0.43962775,-0.63949506,0,1.41659,2.76377,2.76377,"2026/09/01 00:14:20"
"2026/09/01 00:10:00",F_T+RREG_0050,1,RAISEREG,0.51570765,0,-0.08762999,0,5.43907,3.23356,3.23356,"2026/09/01 00:14:20"
"2026/09/01 00:10:00",F_TASCAP_LREG_0210,1,LOWERREG,0,0,-0.26588458,8,0,0,0,"2026/09/01 00:14:20"
"2026/09/01 00:10:00",F_TASCAP_RREG_0220,1,RAISEREG,-0.65567469,-0.6556243,-0.28792949,0,91.72612,91.72326,91.73031,"2026/09/01 00:14:20"
"2026/09/01 00:15:00",F_T+LREG_0050,1,LOWERREG,-0.76644615,-0.76644615,-0.63949506,0,1.38183,2.07845,2.07845,"2026/09/01 00:20:20"
"2026/09/01 00:15:00",F_T+RREG_0050,1,RAISEREG,0.72487449,0,-0.08762999,0,4.45593,2.32214,2.32214,"2026/09/01 00:20:20"
"2026/09/01 00:15:00",F_TASCAP_LREG_0210,1,LOWERREG,0.43709729,0,-0.26588458,0,31.37194,31.1546,31.15503,"2026/09/01 00:20:20"
...

Raw Text with Metadata

C,SETP.WORLD,DVD_FPP_RESIDUAL_CF,AEMO,PUBLIC,2026/10/09,17:49:58,001791532198061,MONTHLY_ARCHIVE,001791532198061
I,FPP,RESIDUAL_CF,1,INTERVAL_DATETIME,CONSTRAINTID,VERSIONNO,BIDTYPE,RESIDUAL_CF,NEGATIVE_RESIDUAL_CF,RESIDUAL_DCF,RESIDUAL_CF_REASON_FLAG,CF_ABS_POSITIVE_PERF_TOTAL,CF_ABS_NEGATIVE_PERF_TOTAL,NCF_ABS_NEGATIVE_PERF_TOTAL,LASTCHANGED
D,FPP,RESIDUAL_CF,1,"2026/09/01 00:05:00",F_T+LREG_0050,1,LOWERREG,0,0,-0.63949506,8,0,0,0,"2026/09/01 00:10:20"
D,FPP,RESIDUAL_CF,1,"2026/09/01 00:05:00",F_T+RREG_0050,1,RAISEREG,0.38006912,0,-0.08762999,0,24.54985,18.00002,18.00002,"2026/09/01 00:10:20"
D,FPP,RESIDUAL_CF,1,"2026/09/01 00:05:00",F_TASCAP_LREG_0210,1,LOWERREG,0,0,-0.26588458,8,0,0,0,"2026/09/01 00:10:20"
D,FPP,RESIDUAL_CF,1,"2026/09/01 00:05:00",F_TASCAP_RREG_0220,1,RAISEREG,-0.73385796,-0.73384929,-0.28792949,0,590.56978,597.15514,597.16219,"2026/09/01 00:10:20"
D,FPP,RESIDUAL_CF,1,"2026/09/01 00:10:00",F_T+LREG_0050,1,LOWERREG,-0.43962775,-0.43962775,-0.63949506,0,1.41659,2.76377,2.76377,"2026/09/01 00:14:20"
D,FPP,RESIDUAL_CF,1,"2026/09/01 00:10:00",F_T+RREG_0050,1,RAISEREG,0.51570765,0,-0.08762999,0,5.43907,3.23356,3.23356,"2026/09/01 00:14:20"
D,FPP,RESIDUAL_CF,1,"2026/09/01 00:10:00",F_TASCAP_LREG_0210,1,LOWERREG,0,0,-0.26588458,8,0,0,0,"2026/09/01 00:14:20"
D,FPP,RESIDUAL_CF,1,"2026/09/01 00:10:00",F_TASCAP_RREG_0220,1,RAISEREG,-0.65567469,-0.6556243,-0.28792949,0,91.72612,91.72326,91.73031,"2026/09/01 00:14:20"
D,FPP,RESIDUAL_CF,1,"2026/09/01 00:15:00",F_T+LREG_0050,1,LOWERREG,-0.76644615,-0.76644615,-0.63949506,0,1.38183,2.07845,2.07845,"2026/09/01 00:20:20"
D,FPP,RESIDUAL_CF,1,"2026/09/01 00:15:00",F_T+RREG_0050,1,RAISEREG,0.72487449,0,-0.08762999,0,4.45593,2.32214,2.32214,"2026/09/01 00:20:20"
D,FPP,RESIDUAL_CF,1,"2026/09/01 00:15:00",F_TASCAP_LREG_0210,1,LOWERREG,0.43709729,0,-0.26588458,0,31.37194,31.1546,31.15503,"2026/09/01 00:20:20"
...
C,"END OF REPORT",1003

Availability

Visibility: Public

This table is in the public monthly MMSDM archive.

I have collated the list of all those files into one place, in this CSV metadata file. (Columns year, month, url, compressed_size in bytes).

The earliest available data is month 12 of 2024. The most recent available data is month 9 of 2026.

Every month in between has a file. (No gaps.)

Warning

The REPORT_SUB_TYPE metadata column has the same column name as an actual columns RESIDUAL_CF. So the raw CSVs have duplicate column names. You will need to be careful when reading this CSV.

Data Size

Each year of data is approximately 9 MB when zipped, 93 MB as unzipped CSV.

Deduplication and PDR Loader Configuration

The primary keys are:

CONSTRAINTID
INTERVAL_DATETIME
VERSIONNO

The transaction type is "insert", which means that you will usually not see duplicate data. If you do, you can deduplicate based on the primary keys, without sorting first. Rows from different files with the same primary keys should have the same values.

PDR Loader configuration is:

Report Name	Report Subtype	Version
FPP	RESIDUAL_CF	1

This means that the CSV files start with metadata columns:

I,FPP,RESIDUAL_CF,1,...
D,FPP,RESIDUAL_CF,1,...

Links

This page as JSON (schema documented here, but may change)

Download a JSON Schema specification for this table.

Official AEMO schema documentation

Other Information

Package: FPP