IMPROVE Aerosol, Regional Haze Rule III (2018 Guidance)

Output file example (excerpt):


			SiteCode|POC|FactDate|ParamCode|MethodID|Units|FactValue|IGroup|Status|ProviderStatus|good_year|PatchedOrSubbedFlag|n_impairment|nyear|sn

			ACAD1|1|2021-01-01|aerosol_bext|1006|1/Mm|12.24376|70|V0|---|1|REG|118|15|118

			ACAD1|1|2021-01-01|ammNO3f|1006|ug/m^3|0.1117|70|V0|NM|1|REG|118|15|118

			ACAD1|1|2021-01-01|ammNO3f_bext|1006|1/Mm|1.02711|70|V0|NM|1|REG|118|15|118

			ACAD1|1|2021-01-01|ammNO3f_Large|1006|ug/m^3|0.00062|70|V0|NM|1|REG|118|15|118

			ACAD1|1|2021-01-01|ammNO3f_Small|1006|ug/m^3|0.11108|70|V0|NM|1|REG|118|15|118

			ACAD1|1|2021-01-01|ammSO4f|1006|ug/m^3|0.71016|70|V0|NM|1|REG|118|15|118

			ACAD1|1|2021-01-01|ammSO4f_bext|1006|1/Mm|6.08912|70|V0|NM|1|REG|118|15|118

			ACAD1|1|2021-01-01|ammSO4f_Large|1006|ug/m^3|0.02522|70|V0|NM|1|REG|118|15|118

			ACAD1|1|2021-01-01|ammSO4f_Small|1006|ug/m^3|0.68494|70|V0|NM|1|REG|118|15|118

			ACAD1|1|2021-01-01|AnthBext|1006|1/Mm|5.99525|70|V0|---|1|REG|118|15|118

			ACAD1|1|2021-01-01|AnthEammNO3|1006|1/Mm|0.55862|70|V0|NM|1|REG|118|15|118

			ACAD1|1|2021-01-01|AnthEammSO4|1006|1/Mm|4.24425|70|V0|NM|1|REG|118|15|118

			ACAD1|1|2021-01-01|AnthECM|1006|1/Mm|0.01113|70|V0|NM|1|REG|118|15|118

			ACAD1|1|2021-01-01|AnthELAC|1006|1/Mm|1.18125|70|V0|NM|1|REG|118|15|118

Schema description:

Field

Description

SiteCode

XF_SiteCode

POC

XF_POC

FactDate

XF_FactDate

ParamCode

XF_ParamCode

MethodID

XF_MethodID

Units

XF_Units

FactValue

XF_FactValue

IGroup

IGroup ("Impairment Group") indicates the quintile (percentile) based on sorting the annual data values from lowest to highest Impairment

IMPROVE convention bins the data values into "groups" based on this algortihm (where the prefix "p" stands for "percentile"):

IF the year's data did not meet the RHR completeness criteria or dv could not be calculated for some reason, then IGroup = 0
IF dv <= p20 Then IGroup = 10
IF dv > p20 AND dv < p40 THEN IGroup = 30
IF dv >= p40 AND dv <= p60 THEN IGroup = 50
IF dv > p60 AND dv < p80 THEN IGroup = 70
IF dv >= p80 then IGroup = 90

Status

XF_StatusCode

Flag	Description	Start Date	End Date	Records
I1	Invalid value - known reason	2004-03-10	2004-10-21	90
M1	Missing value because no value is available	1990-01-17	2021-12-27	95,994
M2	Missing value because invalidated by data originator	1990-09-05	2021-12-24	32,417
M3	Missing value due to clogged filter	2000-01-01	2021-12-03	5,695
V0	Valid value	1988-03-23	2021-12-30	22,369,420
V2	Valid estimated value	2011-01-03	2013-02-09	558
V4	Valid value despite failing to meet some QC or statistical criteria	1988-03-23	2018-12-25	282,044
V5	Valid value but qualified because of possible contamination	1990-09-01	2017-11-06	73,350
V6	Valid value but qualified due to non-standard sampling conditions	2000-01-01	2021-12-24	858,413

ProviderStatus

The status flag/code assigned to the data value by the Air Quality Group at Crocker Nuclear Laboratory at the University of California, Davis

good_year

Indicates whether or not the data meets RHR criteria for annual completeness

PatchedOrSubbedFlag

A code that indicates whether the data value is normal, patched, or substituted. The possible values are:

Flag	Start Date	End Date	Records
PAT	1988-04-02	2021-12-30	37,186
REG	1988-03-02	2021-12-30	12,623,159
SUB	2000-01-01	2018-12-19	38,252
---	1988-03-23	2018-12-25	361,729

n_impairment

The number of valid daily impairment values for the site and year

nyear

The number of number of years between 2000-2014 used to determine episodic thresholds

The number of valid observations for this year

IMPROVE Aerosol, Regional Haze Rule III (2018 Guidance)

Output file example (excerpt):

Schema description:

References: