IMPROVE Aerosol, Regional Haze Rule II (2003 Guidance)
Output file example (excerpt):
SiteCode|POC|FactDate|ParamCode|MethodID|Units|FactValue|HGroup|Status|ProviderStatus|good_year|PatchedOrSubbedFlag|n_dv|missing
ACAD1|1|2021-01-01|aerosol_bext|1010|1/Mm|12.24376|50|V0|---|1|REG|118|0
ACAD1|1|2021-01-01|ammNO3f|1010|ug/m^3|0.1117|50|V0|NM|1|REG|118|0
ACAD1|1|2021-01-01|ammNO3f_bext|1010|1/Mm|1.02711|50|V0|---|1|REG|118|0
ACAD1|1|2021-01-01|ammNO3f_Large|1010|ug/m^3|0.00062|50|V0|NM|1|REG|118|0
ACAD1|1|2021-01-01|ammNO3f_Small|1010|ug/m^3|0.11108|50|V0|NM|1|REG|118|0
ACAD1|1|2021-01-01|ammSO4f|1010|ug/m^3|0.71016|50|V0|NM|1|REG|118|0
ACAD1|1|2021-01-01|ammSO4f_bext|1010|1/Mm|6.08912|50|V0|---|1|REG|118|0
ACAD1|1|2021-01-01|ammSO4f_Large|1010|ug/m^3|0.02522|50|V0|NM|1|REG|118|0
ACAD1|1|2021-01-01|ammSO4f_Small|1010|ug/m^3|0.68494|50|V0|NM|1|REG|118|0
ACAD1|1|2021-01-01|CM_bext|1010|1/Mm|0.32673|50|V0|---|1|REG|118|0
ACAD1|1|2021-01-01|CM_calculated|1010|ug/m^3|0.54455|50|V0|NM|1|REG|118|0
ACAD1|1|2021-01-01|dv|1010|dv|8.85574|50|V0|---|1|REG|118|0
ACAD1|1|2021-01-01|ECf|1010|ug/m^3|0.1446|50|V0|NM|1|REG|118|0
ACAD1|1|2021-01-01|ECf_bext|1010|1/Mm|1.446|50|V0|---|1|REG|118|0
Schema description:
| Field | Description |
|---|
| SiteCode | XF_SiteCode |
| POC | XF_POC |
| FactDate | XF_FactDate |
| ParamCode | XF_ParamCode |
| MethodID | XF_MethodID |
| Units | XF_Units |
| FactValue | XF_FactValue |
| HGroup |
HGroup ("Haze Group") indicates the quintile (percentile) based on sorting the annual data values from lowest to highest Deciview (dv)
IMPROVE convention bins the data values into "groups" based on this algortihm (where the prefix "p" stands for "percentile"):
IF the year's data did not meet the RHR completeness criteria or dv could not be calculated for some reason, then HGroup = 0
IF dv <= p20 Then HGroup = 10
IF dv > p20 AND dv < p40 THEN HGroup = 30
IF dv >= p40 AND dv <= p60 THEN HGroup = 50
IF dv > p60 AND dv < p80 THEN HGroup = 70
IF dv >= p80 then HGroup = 90
|
| Status |
XF_StatusCode
| Flag | Description | Start Date | End Date | Records |
|---|
| I1 | Invalid value - known reason | 2004-03-10 | 2004-11-17 | 85 |
| M1 | Missing value because no value is available | 1988-03-02 | 2021-12-30 | 672,335 |
| M2 | Missing value because invalidated by data originator | 1990-09-01 | 2021-12-30 | 43,344 |
| M3 | Missing value due to clogged filter | 2000-01-01 | 2021-12-12 | 5,984 |
| V0 | Valid value | 1988-03-02 | 2021-12-30 | 11,644,995 |
| V2 | Valid estimated value | 2011-01-03 | 2013-02-09 | 366 |
| V4 | Valid value despite failing to meet some QC or statistical criteria | 1988-03-23 | 2020-12-17 | 282,162 |
| V5 | Valid value but qualified because of possible contamination | 1990-09-01 | 2017-11-06 | 32,415 |
| V6 | Valid value but qualified due to non-standard sampling conditions | 2000-01-01 | 2021-12-30 | 378,640 |
|
| ProviderStatus | The status flag/code assigned to the data value by the Air Quality Group at Crocker Nuclear Laboratory at the University of California, Davis |
| good_year |
Indicates whether or not the data meets RHR criteria for annual completeness |
| PatchedOrSubbedFlag |
A code that indicates whether the data value is normal, patched, or substituted. The possible values are:
| Flag | Description | Start Date | End Date | Records |
|---|
| PAT | The data value results from the RHR "patching" algorithm | 1988-04-02 | 2021-12-30 | 37,186 |
| REG | The data value results from a normal observation or calculation per the RHR guidance | 1988-03-02 | 2021-12-30 | 12,623,159 |
| SUB | The data value is a substituted value from another site or calculation procedure per the RHR guidance | 2000-01-01 | 2018-12-19 | 38,252 |
| --- | The data value has not been assigned a specific flag in this regard | 1988-03-23 | 2018-12-25 | 361,729 |
|
| n_dv | The number of valid daily dv values for the site and year |
| missing | The number of missing values for the site and year |
References: