source: BAORadio/AmasNancay/trunk/analysis-scriptsAndprg-description.txt @ 611

Last change on this file since 611 was 610, checked in by campagne, 13 years ago

cleaning
File size: 5.9 KB
Line 
1Title: Status of the programs and scripts used for Amas@Nancay analysis at CCIN2P3
2Revision: 28/11/11 (JEC+AST)
3Author: J.E Campagne 22/7/11
4----------------------------
5
6Intro:
7All these tools are located for the while in J.E Campagne private directory, so they are not
8yet available to public usage and this note is essentially for information and software tracking.
9
10-----------------------------------------------------------
11Analysis program
12------------------------------------------------------------
13o analysis.cc
14        - perfom
15                . gain spectra determination + monitoring
16                . ON-OFF spectra without calibration
17                . calibration coefficient determination + monitoring
18                . ON-OFF spectra determination (no RT calibration included)
19        - Todo
20                . include RT calibration, or a RT/BAO calibration using a calibrator source
21        - comments
22                . the STANDARD usage since end september 11 is GAIN + ON-OFF wo calibration
23
24
25
26               
27-----------------------------------------------------------
28Collection of  Bourne SHELL script for analysis
29------------------------------------------------------------
30
31A) Utilitary scripts to follow the DAQ & Analysis progress
32++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
33o mkarchive.sh
34---------------
35        - perform the archive of a processing in Irods
36          . create a <ppTag>Arch<apTag> directory
37            . move the cabli_*.txt files
38            . move the *.ppf / *.fits files results of the analysis
39            . for the gain...fits only a copy is done to keep a version
40            . move the Off and On directorys
41          . create new fresh On and Off directory
42
43
44o statusdaq.sh
45--------------
46        - perform
47                . scan all the /baoradio/data/AmamNancay to look at the directories and and make
48                        a summary of the Data Acquisition
49
50o statusheader.sh
51-----------------
52        - perform
53                . scan Irods directories to look at header fits files extraction progress
54               
55o statusgain.sh
56---------------
57        - perform
58                . scan Irods directories to look at FINAL gain_* files production progress
59
60o statuscalib.sh
61----------------
62        - perform
63                . scan Irods directories to look at INTERMEDIATE calibcycle files production progress
64        - Todo
65                . scan also for FINAL calib_* files progress
66o statusonoff.sh
67----------------
68        - perform
69                . scan Irods On and Off directories to look at datacycle<cycle> contents
70
71o statusCycles.sh
72-----------------
73        - perform
74                . scan Irods directories to look at sca<>.sum files to count the number of cycles per run
75
76B) Utilitary scripts to send to GE system high level task (note old BQS batch is obsolete now)
77++++++++++++++++++++++++++++++++++++++++++++++++++++++++++             
78o submit2ge-hdrfitsextractor.sh
79--------------------------------
80        - SHOULD BE DONE BEFORE gain/calib/analysis
81        - send the hdrfitsextractor.sh script to GE system     
82
83
84o submit2ge-procspecmfib.sh
85-----------------------------
86        - SHOULD BE DONE for processing signals for FFT/paquet median filtering
87        - GAIN/CALIB/ON, OFF...
88        - prepare and send in batch the proc_specmfib.sh to GE
89        - exemple
90        ./submit2ge-procspecmfib.sh -src Abell85 -date 20110422 -type CALIBOFF -fcycle 8 -lcycle 14
91
92o submit2ge-anagainmaker.sh
93----------------------------
94        - done after proc_specmfib
95        - prepare and send the analyse.cc prg for gain computation
96        - exemple
97
98o submit2ge-anacalibmaker.sh
99----------------------------
100        - done after proc_specmfib
101        - prepare and send the analyse.cc prg for calibration computation
102        - exemples:
103        > $./submit2ge-anacalibmaker.sh -src Abell85 -date 20110410
104
105o submit2ge-scaextractor.sh
106--------------------------------
107        - SHOULD BE DONE BEFORE gain/calib/analysis
108        - send the scaextractor.sh script to GE system
109                although this script is called by getscafiles lower level script
110       
111               
112C) High level scripts
113++++++++++++++++++++++         
114o hdrfitsextractor.sh
115---------------------
116        - SHOULD BE DONE BEFORE ANYTHING
117        - perform
118                . extraction of the header part of the signalXYZ.fits files and
119                . put the results into Irods   
120        - use
121                . statusdaq.sh 
122
123o anagainmaker.sh
124-----------------
125        - perform
126          . the analysis to determine the
127                        gains of each channel: produce gain_* files (monitoring + gain files)
128          . put the results into Irods
129        - use
130                - getscafiles.sh
131                - analysis.cc   
132
133o anacalibmaker.sh
134------------------
135        - perfom
136          . prepare the analysis
137          . put calib_* files (monitoring +  calibration files) into Irods
138        - use
139                - getscafiles.sh
140                - analysis.cc   
141
142
143
144o anarawonoffmaker.sh
145---------------------
146        - perform
147                . prepare the analysis
148                . put dataRaw_*        (raw spectra),
149                      diffOnOffRaw_*   (ON-OFF spectra although not used by final analysis)
150
151D) Lower level scripts
152++++++++++++++++++++++
153
154o proc_specmfib.sh
155------------------
156        - perform all the preparation work to send in batch the "specmfib"
157          program which perform the FFT and median/mean spectra
158          for the GAIN/CALIB/ON-OFF... task
159        - use
160          - getscafiles.sh, select.sh, statusdaq.sh, getsignalfiles.sh
161        - comments
162          - this is the pre-processing of the data to be used before
163            anaXYZ script which are post-processing
164
165
166o scaextractor.sh
167-----------------
168        - perform
169                1) extraction of the scaXYZ file
170                2) if the scaXYZ.sum and the scaXYZ.sum.trans files do not exist
171                        . create and put them into Irods
172                        . scaXYZ.sum = summary of the SCA file
173                        . scaXYZ.sum.trans = transformation of the date format of the scaXYZ.sum file   
174        - use
175                - sca.sh, transdate.sh
176               
177o sca.sh
178--------
179        - perform
180                . produce the scaXYZ.sum (= summary of the SCA file) from a scaXYZ file
181               
182o transdate.sh
183--------------
184        - perform
185                . produce the scaXYZ.sum.trans (= transformation of the date format) from the scaXYZ.sum file   
186
187o select.sh
188-----------
189        -perform
190                . the selection of the signalXYZ.fits files according to the type of task requested
191                        as ON, OFF, CALIBON, CALIBOFF, GAIN
192               
193o getscafiles.sh
194----------------
195        - perform
196                . download from Irods the scaXYZ, scaXYZ.sum and scaXYZ.sum.trans files
197        - use
198                scaextractor.sh
199               
200o getsignals.sh
201---------------
202        - perform
203                . download from Irods the signalXYZ.fits files
204               
205               
206               
207
Note: See TracBrowser for help on using the repository browser.