Pipeline Processing
Pipeline Activation
ECLAIRs pipeline of the QLA Process shall be initiated in automatic way as soon as a given set of preliminary input data are made available by the PP pipeline of the QLA process. The amount and criteria of the set of data to be collected before activation is TBD. However the processing and analysis shall provide results within a typical timescale of 1 day.
ECLAIRs pipeline of the SA Process shall be initiated when all consolidated input data of a given observation (obsID) are made available by the PP of the SA process.
Prerequisites
All the predefined input data set along with the required parameters for the specified (QLA or SA) run shall be available before starting the activation of the pipeline.
Input and Output Data
Table 2 lists the input data for each component of the ECLAIRs pipeline and the pipeline or component from which they are generated. Meaning of input data acronyms are fully explained in AD5 for the data products (see also output of PP processing, sect. 5, Tab. 5.1) and in Table 3 of input auxiliary data. Brackets indicate optional input/output. An asterisks indicate that the information may be transmitted in the input files derived from previous components (e.g. in the fits headers) rather than by the direct reading of the specified data products.
Table Input and Auxiliary Data ECPI
PIPELINE COMPONENT |
INPUT and Auxiliary Data and SDP |
From |
OUTPUT SDP (primary in bold) |
Format |
|---|---|---|---|---|
Data Preparation and Correction (DPCO) |
SVO-OBP |
(PP) |
ECL-GTI-1 |
FITS-T |
SVO-HKS |
PP |
ECL-PIX-LIV |
FITS-T |
|
SVO-ATT-CNV |
PP |
ECL-EVT-COR |
FITS-T |
|
SVO-ORB-CNV |
PP |
|||
ECL-HKS |
PP |
|||
ECL-EVT-CNV |
PP |
|||
ECL-DET-CNV |
PP |
|||
AUX-ECL-INP-CNF |
EIC |
|||
AUX-ECL-HKP-LIM |
EIC |
|||
AUX-ECL-PIX-STA, THR |
EIC |
|||
AUX-ECL-DPI-DTI |
EIC |
|||
Calibration (CALI) |
ECL-GTI-1 |
DPCO |
ECL-GTI-2 |
FITS-T |
ECL-PIX-LIF |
DPCO |
ECL-EVT-CAL |
FITS-T |
|
ECL-EVT-COR |
DPCO |
|||
AUX-ECL-PIX-CAL |
EIC |
|||
(Selection) Binning, Uniformity, Background and Earth Correction (BUBE) |
SVO-OBP * |
(PP) |
ECL-GTI-3 |
FITS-T |
SVO-ATT-CNV * |
PP |
ECL-DET-IMA |
FITS-I |
|
SVO-ORB-CNV * |
PP |
ECL-DET-UBC |
FITS-I |
|
ECL-GTI-2 |
DPCO |
|||
ECL-PIX-LIF |
DPCO |
|||
ECL-EVT-CAL |
CALI |
|||
AUX-ECL-INP-CNF |
EIC/FSC |
|||
AUX-ECL-DET-UNI |
EIC |
|||
AUX-ECL-ORB-SAA |
EIC |
|||
AUX-ECL-BKG |
EIC/FSC |
|||
AUX-ECL-EAR-ALB |
EIC/FSC |
|||
AUX-ECL-EAR-MOD |
FSC/EIC |
|||
AUX-GPS-ECL-CAT |
FSC |
|||
Imaging Source Detection (IMAG) |
SVO-OBS-CNV * |
PP |
ECL-SKY-IMA |
FITS-I |
SVO-ATT-CNV * |
PP |
ECL-SOP-IMA |
FITS-T |
|
ECL-DET-UBC |
BUBE |
ECL-DET-MOD |
FITS-I |
|
AUX-ECL-INP-CNF |
EIC/FSC |
|||
AUX-ECL-RSP-VIG |
FSC/EIC |
|||
AUX-ECL-RSP-ATT |
FSC/EIC |
|||
AUX-ECL-RSP-ENE |
EIC |
|||
AUX-GPS-ECL-CAT |
FSC |
|||
Source Product Extraction (SOEX) |
SVO-OBS * |
PP |
ECL-EVS-Sii |
FITS-T |
SVO-ATT-CNV * |
PP |
ECL-LCS-Sii |
FITS-T |
|
SVO-ORB-CNV |
PP |
ECL-SPS-Sii |
FITS-T |
|
ECL-EVT-CAL |
CALI |
(ii = 0, n_sources) |
||
ECL-GTI-3 |
BUBE |
|||
ECL-DET-UBC |
BUBE |
|||
(ECL-SOP-IMA) |
(IMAG) |
|||
AUX-ECL-INP-CNF |
EIC |
|||
AUX-ECL-RSP-VIG |
EIC |
|||
AUX-ECL-RSP-ATT |
FSC |
|||
AUX-ECL-RSP-ENE |
EIC |
|||
AUX-GPS-ECL-CAT |
FSC |
|||
Mosaicking (MOSA) |
SVO-OBS * |
PP |
ECL-SKY-MOS |
FITS-I |
SVO-ATT-CNV * |
PP |
ECL-SOP-MOS |
FITS-T |
|
SVO-ORB-CNV * |
PP |
|||
ECL-SKY-IMA |
IMAG |
|||
ECL-SOP-IMA |
IMAG |
|||
Interactive SW (ECIS) |
All PP and ECPI products and Auxiliary Files |
PP ECPI EIC |
Report including text and graphic results. Alerts. |
pdf asci |
A preliminary list of ECLAIRs auxiliary data is reported in Table 3. Final list and data format will be described in detail in the FSC-EIC ICD or in the ECPI pipeline ADD.
Table Input Auxiliary Data
AUXILIARY DATA |
Description |
Used by |
From |
Freq |
|---|---|---|---|---|
AUX-ECL-INP-CNF |
Instrument Configuration parameters: geometry, mask pattern, materials |
All |
EIC |
Y |
AUX-ECL-HKP-CON |
Parameters for housekeeping conversion in physical units |
PP-ECL |
EIC |
Y |
AUX-ECL-HKP-LIM |
Limiting Values for housekeeping (at least two levels: alarm, best science) |
DPCO |
EIC |
Y |
AUX-ECL-PIX-STA |
ECLAIRs information on the DPIX characteristics: dead, noisy, live pixels, low-energy thresholds |
DPCO |
EIC |
M |
AUX-ECL-PIX-THR |
ECLAIRs information on the DPIX characteristics: dead, noisy, live pixels, low-energy thresholds |
DPCO |
EIC |
M |
AUX-ECL-DPI-DTI |
Parameters to compute the dead-time for DPIX |
DPCO |
EIC |
Y |
AUX-ECL-PIX-CAL |
Calibration parameters for channel-energy conversion: gains and offsets for each pix |
CALI |
EIC |
W |
AUX-ECL-DPI-UNI |
Uniformity of the DPIX plane |
BUBE |
EIC |
Y |
AUX-ECL-ORB-SAA |
Limits of SAA for ECLAIRs |
BUBE |
EIC/FSC |
M |
AUX-ECL-BKG |
Background Model or parameters |
BUBE |
EIC/FSC |
Y |
AUX-ECL-EAR-ALB |
Earth Albedo data or model parameters |
BUBE |
EIC/FSC |
Y |
AUX-ECL-EAR-MOD |
Earth Occultation Model parameters |
BUBE |
FSC/EIC |
Y |
AUX-ECL-EAR-RFL |
Earth Reflection Backg. data or model parameters |
BUBE |
FSC/EIC |
Y |
AUX-ECL-RSP-IRF |
Off-axis Normalization Sky Image (Vignetting) |
IMAG |
FSC/EIC |
Y |
SPEX |
||||
MOSA |
||||
AUX-ECL-RSP-ENE |
ECLAIRS Energy Response including ARF and RMF |
IMAG |
EIC |
Y |
SPEX |
||||
MOSA |
||||
AUX-ECL-RSP-ATT |
Attitude roto-translation matrix to correct bias between instrument and platform attitude (thermoplastic deformations). |
IMAG |
FSC/EIC |
Y |
SPEX |
FSC/EIC |
Y |
||
MOSA |
||||
AUX-GPS-ECL-CAT |
Source Catalogue regularly updated with the ECLAIRs results and possibly with MXT results |
BUBE |
FSC |
D |
IMAG |
||||
SPEX |
||||
MOSA |
||||
AUX-ECL-UGT-PAR |
Parameters of the UGTS |
DPCO |
EIC |
|
ECIS |
Pipeline input parameters are also needed to run the processes. Those will be specified in the architectural design document of the pipeline.
Table 2 lists also the output science data products (SDP) of each component of the ECLAIRs pipeline. Meaning of SDP acronyms are fully explained in AD5. SDP in bold are primary, the other are secondary as defined in AD5. Detailed description of the ECLAIRs primary SDP is reported elsewhere.