source: BAORadio/AmasNancay/v2/analysis-scriptsAndprg-description.txt @ 631

Last change on this file since 631 was 519, checked in by campagne, 13 years ago

give the status of ON-Off analysis (jec)
File size: 5.8 KB
Line 
1Title: Status of the programs and scripts used for Amas@Nancay analysis at CCIN2P3
2Revision: 14/9/11
3Author: J.E Campagne 22/7/11
4----------------------------
5
6Intro:
7All these tools are located for the while in J.E Campagne private directory, so they are not
8yet available to public usage and this note is essentially for information and software tracking.
9
10-----------------------------------------------------------
11Analysis program
12------------------------------------------------------------
13o analysis.cc
14        - perfom
15                . gain spectra determination + monitoring
16                . calibration coefficient determination + monitoring
17                . ON-OFF spectra determination (no RT calibration included)
18        - Todo
19                . include RT calibration
20        - comments
21                . ON-OFF part only validate for a single Abell85 run and not in batch mode (preliminary stage)
22                . GAIN part should be revalidated according to inPath argument
23               
24-----------------------------------------------------------
25Collection of  Bourne SHELL script for analysis
26------------------------------------------------------------
27
28A) Utilitary scripts to follow the DAQ & Analysis progress
29++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
30o statusdaq.sh
31--------------
32        - perform
33                . scan all the /baoradio/data/AmamNancay to look at the directories and and make
34                        a summary of the Data Acquisition
35
36o statusheader.sh
37-----------------
38        - perform
39                . scan Irods directories to look at header fits files extraction progress
40               
41o statusgain.sh
42---------------
43        - perform
44                . scan Irods directories to look at FINAL gain_* files production progress
45
46o statuscalib.sh
47----------------
48        - perform
49                . scan Irods directories to look at INTERMEDIATE calibcycle files production progress
50        - Todo
51                . scan also for FINAL calib_* files progress
52
53B) Utilitary scripts to send to BQS system high level task
54++++++++++++++++++++++++++++++++++++++++++++++++++++++++++             
55o submit2bqs-hdrfitsextractor.sh
56--------------------------------
57        - SHOULD BE DONE BEFORE gain/calib/analysis
58        - send the hdrfitsextractor.sh script to BQS system     
59        - Todo list
60                - TO MIGRATE TO NEW BATCH
61
62o submit2bqs-scaextractor.sh
63--------------------------------
64        - SHOULD BE DONE BEFORE gain/calib/analysis
65        - send statusdaq if necessary
66        - send the scaextractor.sh script to BQS system
67                although this script is called by getscafiles lower level script
68        - Todo list
69                - TO MIGRATE TO NEW BATCH
70
71o submit2qs-gainmaker.sh
72-------------------------
73        - send the gainmaker.sh script to BQS system
74        - Todo list
75                - TO MIGRATE TO NEW BATCH
76       
77o submit2qs-calibmaker.sh
78--------------------------
79        - send the calibmaker.sh script to BQS system
80        - Todo list
81                - TO MIGRATE TO NEW BATCH
82
83o submit2qs-onoffmaker.sh
84--------------------------
85        - send the onoffmaker.sh script to BQS system
86        - Todo list
87                - TO MIGRATE TO NEW BATCH
88
89               
90C) High level scripts
91++++++++++++++++++++++         
92o hdrfitsextractor.sh
93---------------------
94        - SHOULD BE DONE BEFORE ANYTHING
95        - perform
96                . extraction of the header part of the signalXYZ.fits files and
97                . put the results into Irods   
98        - use
99                . statusdaq.sh 
100
101o gainmaker.sh
102---------------
103        - perform
104                1) the extraction of signalXYZ.fits files
105                        concerned by the OFF-calibration time window
106                        of the cycle located at the middle of the run
107                2) . the analysis of the above fits files to determine the
108                        gains of each channel: produce gain_* files (monitoring + gain files)
109                        . put the results into Irods
110        - use
111                - statusdaq.sh, proc_script.sh, getscafiles.sh
112                - analysis.cc   
113       
114o calibmaker.sh
115---------------
116        - perfom
117                1) several x-checks to see at which stage of the analysis process we are
118                2) trig the proc_script.sh script if necessary to create the spectra fits files via specmfib.cc prg
119                3) . prepare the analysis of the above fits files
120                   . put calib_* files (monitoring +  calibration files) into Irods
121        - use
122                - statusdaq.sh, proc_script.sh, getscafiles.sh
123                - analysis.cc   
124
125o onoffmaker.sh (preliminary)
126----------------------------
127        - perform
128                1) several x-checks to see at which stage of the analysis process we are
129                2) trig the proc_script.sh script if necessary to create the spectra fits files via specmfib.cc prg
130                3) prepare the analysis of the above fits files
131                4) put dataRaw_*        (raw spectra),
132                       dataBAOCalib_*   (after BAO calibration),
133                       dataBAORTCalib_* (after BAO & RT calibration),
134                       diffOnOff_*      (ON-OFF spectra)
135
136D) Lower level scripts
137++++++++++++++++++++++
138               
139o proc_script.sh
140-----------------
141        - VERY BUSY script
142        - perform
143                1) all the preparation work to send in batch the "specmfib" program
144                        which perform the FFT and median/mean spectra for GAIN, CALIBRATION, ON-OFF task
145                2) the script that is sent in batch put the results into Irods 
146        - use
147                - getscafiles.sh, select.sh, getsignalfiles.sh
148        - Todo list
149                - TO MIGRATE TO NEW BATCH
150               
151
152o scaextractor.sh
153-----------------
154        - perform
155                1) extraction of the scaXYZ file
156                2) if the scaXYZ.sum and the scaXYZ.sum.trans files do not exist
157                        . create and put them into Irods
158                        . scaXYZ.sum = summary of the SCA file
159                        . scaXYZ.sum.trans = transformation of the date format of the scaXYZ.sum file   
160        - use
161                - sca.sh, transdate.sh
162               
163o sca.sh
164--------
165        - perform
166                . produce the scaXYZ.sum (= summary of the SCA file) from a scaXYZ file
167               
168o transdate.sh
169--------------
170        - perform
171                . produce the scaXYZ.sum.trans (= transformation of the date format) from the scaXYZ.sum file   
172
173o select.sh
174-----------
175        -perform
176                . the selection of the signalXYZ.fits files according to the type of task requested
177                        as ON, OFF, CALIBON, CALIBOFF, GAIN
178               
179o getscafiles.sh
180----------------
181        - perform
182                . download from Irods the scaXYZ, scaXYZ.sum and scaXYZ.sum.trans files
183        - use
184                scaextractor.sh
185               
186o getsignals.sh
187---------------
188        - perform
189                . download from Irods the signalXYZ.fits files
190               
191               
192               
193
Note: See TracBrowser for help on using the repository browser.