Changeset 610 for BAORadio/AmasNancay/trunk
- Timestamp:
- Nov 28, 2011, 9:56:39 AM (13 years ago)
- Location:
- BAORadio/AmasNancay/trunk
- Files:
-
- 6 deleted
- 3 edited
Legend:
- Unmodified
- Added
- Removed
-
BAORadio/AmasNancay/trunk/analysis-scriptsAndprg-description.txt
r575 r610 1 1 Title: Status of the programs and scripts used for Amas@Nancay analysis at CCIN2P3 2 Revision: 11/10/11 (JEC)2 Revision: 28/11/11 (JEC+AST) 3 3 Author: J.E Campagne 22/7/11 4 4 ---------------------------- … … 21 21 - comments 22 22 . the STANDARD usage since end september 11 is GAIN + ON-OFF wo calibration 23 24 25 23 26 24 27 ----------------------------------------------------------- … … 71 74 . scan Irods directories to look at sca<>.sum files to count the number of cycles per run 72 75 73 B) Utilitary scripts to send to BQS system high level task76 B) Utilitary scripts to send to GE system high level task (note old BQS batch is obsolete now) 74 77 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 75 o submit2 bqs-hdrfitsextractor.sh78 o submit2ge-hdrfitsextractor.sh 76 79 -------------------------------- 77 80 - SHOULD BE DONE BEFORE gain/calib/analysis 78 - send the hdrfitsextractor.sh script to BQS system 79 - Todo list 80 - TO MIGRATE TO NEW BATCH 81 82 o submit2bqs-scaextractor.sh 83 -------------------------------- 84 - SHOULD BE DONE BEFORE gain/calib/analysis 85 - send the scaextractor.sh script to BQS system 86 although this script is called by getscafiles lower level script 87 - Todo list 88 - TO MIGRATE TO NEW BATCH 89 90 o submit2bqs-procspecmfib.sh 81 - send the hdrfitsextractor.sh script to GE system 82 83 84 o submit2ge-procspecmfib.sh 91 85 ----------------------------- 92 86 - SHOULD BE DONE for processing signals for FFT/paquet median filtering 93 87 - GAIN/CALIB/ON, OFF... 94 - prepare and send in batch the proc_specmfib.sh to BQS88 - prepare and send in batch the proc_specmfib.sh to GE 95 89 - exemple 96 ./submit2bqs-procspecmfib.sh -src Abell85 -date 20110422 -type CALIBOFF -fcycle 8 -lcycle 14 97 - Todo list 98 - TO MIGRATE TO NEW BATCH 99 100 o submit2bqs-anagainmaker.sh 90 ./submit2ge-procspecmfib.sh -src Abell85 -date 20110422 -type CALIBOFF -fcycle 8 -lcycle 14 91 92 o submit2ge-anagainmaker.sh 101 93 ---------------------------- 102 94 - done after proc_specmfib 103 95 - prepare and send the analyse.cc prg for gain computation 104 96 - exemple 105 - Todo list 106 - TO MIGRATE TO NEW BATCH 107 108 o submit2bqs-anacalibmaker.sh 97 98 o submit2ge-anacalibmaker.sh 109 99 ---------------------------- 110 100 - done after proc_specmfib 111 101 - prepare and send the analyse.cc prg for calibration computation 112 102 - exemples: 113 > $./submit2bqs-anacalibmaker.sh -src Abell85 -date 20110410 114 103 > $./submit2ge-anacalibmaker.sh -src Abell85 -date 20110410 104 105 o submit2ge-scaextractor.sh 106 -------------------------------- 107 - SHOULD BE DONE BEFORE gain/calib/analysis 108 - send the scaextractor.sh script to GE system 109 although this script is called by getscafiles lower level script 115 110 116 - Todo list117 - TO MIGRATE TO NEW BATCH118 119 o submit2qs-onoffmaker.sh (OBSOLETE ???)120 --------------------------121 - send the onoffmaker.sh script to BQS system122 - Todo list123 - TO MIGRATE TO NEW BATCH124 125 o submit2bqs-rawonoffmaker.sh (OBSOLETE ???)126 -----------------------------127 - used after the anagainmaker128 - prepare and send in batch the proc_rawonoff.sh to BQS system129 - exemple submit2bqs-rawonoffmaker.sh -src Abell85 -date 20110417 -fcycle 8 -lcycle 23 -type ON130 - Todo list131 - TO MIGRATE TO NEW BATCH132 133 o submit2qs-gainmaker.sh (OBSOLETE)134 -------------------------135 - send the gainmaker.sh script to BQS system136 - Todo list137 - TO MIGRATE TO NEW BATCH138 139 o submit2qs-calibmaker.sh (OBSOLETE)140 --------------------------141 - send the calibmaker.sh script to BQS system142 - Todo list143 - TO MIGRATE TO NEW BATCH144 145 111 146 112 C) High level scripts … … 158 124 ----------------- 159 125 - perform 160 . the analysis of the above fits filesto determine the126 . the analysis to determine the 161 127 gains of each channel: produce gain_* files (monitoring + gain files) 162 128 . put the results into Irods … … 168 134 ------------------ 169 135 - perfom 170 . prepare the analysis of the above fits files136 . prepare the analysis 171 137 . put calib_* files (monitoring + calibration files) into Irods 172 138 - use … … 175 141 176 142 177 o gainmaker.sh (OBOLETE) 178 --------------- 179 - perform 180 1) the extraction of signalXYZ.fits files 181 concerned by the OFF-calibration time window 182 of the cycle located at the middle of the run 183 2) . the analysis of the above fits files to determine the 184 gains of each channel: produce gain_* files (monitoring + gain files) 185 . put the results into Irods 186 - use 187 - statusdaq.sh, proc_script.sh, getscafiles.sh 188 - analysis.cc 189 190 o calibmaker.sh (OBSOLETE) 191 --------------- 192 - perfom 193 1) several x-checks to see at which stage of the analysis process we are 194 2) trig the proc_script.sh script if necessary to create the spectra fits files via specmfib.cc prg 195 3) . prepare the analysis of the above fits files 196 . put calib_* files (monitoring + calibration files) into Irods 197 - use 198 - statusdaq.sh, proc_script.sh, getscafiles.sh 199 - analysis.cc 200 201 o onoffmaker.sh (preliminary) 202 ---------------------------- 203 - perform 204 1) several x-checks to see at which stage of the analysis process we are 205 2) trig the proc_script.sh script if necessary to create the spectra fits files via specmfib.cc prg 206 3) prepare the analysis of the above fits files 207 4) put dataRaw_* (raw spectra), 208 dataBAOCalib_* (after BAO calibration), 209 dataBAORTCalib_* (after BAO & RT calibration), 210 diffOnOff_* (ON-OFF spectra) 143 144 o anarawonoffmaker.sh 145 --------------------- 146 - perform 147 . prepare the analysis 148 . put dataRaw_* (raw spectra), 149 diffOnOffRaw_* (ON-OFF spectra although not used by final analysis) 211 150 212 151 D) Lower level scripts … … 225 164 226 165 227 o proc_rawonoff.sh (OBSOLETE)228 ------------------229 - this is the script to use to perform the "datacycle" contents230 - perform all the preparation work to send in batch the "specmfib" program231 which perform the FFT and median/mean spectra for the ON-OFF task232 - use233 - getscafiles.sh, select.sh, statusdaq.sh, getsignalfiles.sh234 - comments235 - contrary to proc_script (below) specmfib is activated in the same thread236 237 o proc_script.sh (OBSOLETE)238 -----------------239 - VERY BUSY script240 - perform241 1) all the preparation work to send in batch the "specmfib" program242 which perform the FFT and median/mean spectra for GAIN, CALIBRATION, ON-OFF task243 2) the script that is sent in batch put the results into Irods244 - use245 - getscafiles.sh, select.sh, getsignalfiles.sh246 - Todo list247 - TO MIGRATE TO NEW BATCH248 249 250 166 o scaextractor.sh 251 167 ----------------- -
BAORadio/AmasNancay/trunk/mergeAnaFiles.cc
r609 r610 63 63 //-------------------------------------------------------------- 64 64 //Utility functions 65 // template <class T> 66 // void MeanSigma(TArray<T> const & a, T & mean, T & sig){ 67 // if (a.NbDimensions() < 1) 68 // throw RangeCheckError("MathArray<T>::MeanSigma(TArray<T> const & a..) Not Allocated Array a !"); 69 // const T * pe; 70 // sa_size_t j,k; 71 // mean=0.; 72 // sig = 0.; 73 // T valok; 74 // if (a.AvgStep() > 0) { // regularly spaced elements 75 // sa_size_t step = a.AvgStep(); 76 // sa_size_t maxx = a.Size()*step; 77 // pe = a.Data(); 78 // for(k=0; k<maxx; k+=step ) { 79 // valok = pe[k]; 80 // mean += valok; sig += valok*valok; 81 // } 82 // } 83 // else { // Non regular data spacing ... 84 // int_4 ka = a.MaxSizeKA(); 85 // sa_size_t step = a.Step(ka); 86 // sa_size_t gpas = a.Size(ka)*step; 87 // sa_size_t naxa = a.Size()/a.Size(ka); 88 // for(j=0; j<naxa; j++) { 89 // pe = a.DataBlock().Begin()+a.Offset(ka,j); 90 // for(k=0; k<gpas; k+=step) { 91 // valok = pe[k]; 92 // mean += valok; sig += valok*valok; 93 // } 94 // } 95 // } 96 // T dsz = (T)(a.Size()); 97 // mean /= dsz; 98 // if (dsz > 1.5) { 99 // sig = sig/dsz - mean*mean; 100 // sig *= (dsz/(dsz-1)); 101 // if (sig >= 0.) sig = sqrt(sig); 102 // } 103 // else sig = 0.; 104 // } 105 65 106 66 107 sa_size_t freqToChan(r_4 f){ … … 79 120 for (sa_size_t ir=0; ir<nr; ir++){ 80 121 TVector<r_4> tmp(mtx(Range(ir),Range(chLow,chHigh)),false); 81 doublemean, sigma;122 r_8 mean, sigma; 82 123 MeanSigma(tmp,mean,sigma); 83 124 vec(ir) = mean; … … 573 614 nr = calibBAOfactors_Off_Run_Ch0.NRows(); 574 615 for (sa_size_t ir=0; ir<nr; ++ir){ 575 //cout << "Calib. Off Run Ch0 cycle ["<< calibBAOfactors_Off_Run_Ch0(ir,0)<<"], val "576 //<< calibBAOfactors_Off_Run_Ch0(ir,1) << endl;616 cout << "Calib. Off Run Ch0 cycle ["<< calibBAOfactors_Off_Run_Ch0(ir,0)<<"], val " 617 << calibBAOfactors_Off_Run_Ch0(ir,1) << endl; 577 618 578 619 calibBAO_Off_Run_Ch0[(int)calibBAOfactors_Off_Run_Ch0(ir,0)] … … 625 666 << "Ch1 " << calibBAO_On_Cycle_Ch1[*ic] << endl; 626 667 } else { 627 cout << "Cycle NOT calibrated "<< endl;668 cout << "Cycle << " << *ic <<" NOT calibrated for file " << *iFile << endl; 628 669 } 629 670 }//debug … … 760 801 761 802 TVector<r_4> meanInRange_1410a1415Freq_OFF_noCalib(NUMBER_OF_CHANNELS); 803 // meanInRange(aSpecOff,ch1410,ch1415,meanInRange_1410a1415Freq_OFF_noCalib); 762 804 meanInRange(aSpecOffovOff,ch1410,ch1415,meanInRange_1410a1415Freq_OFF_noCalib); 763 805 … … 769 811 770 812 TVector<r_4> meanInRange_1410a1415Freq_ON_noCalib(NUMBER_OF_CHANNELS); 813 //meanInRange(aSpecOn,ch1410,ch1415,meanInRange_1410a1415Freq_ON_noCalib); 771 814 meanInRange(aSpecOnovOff,ch1410,ch1415,meanInRange_1410a1415Freq_ON_noCalib); 772 815 … … 845 888 fos << PPFNameTag(tag) << onoffevolution; 846 889 }//end of save 890 891 847 892 } 848 893 //JEC 14/11/11 New meanRawDiffOnOffCycles START … … 851 896 //Used like: 852 897 // 853 void 854 meanRawDiffOnOffCycles() throw(string) { 898 void meanRawDiffOnOffCycles() throw(string) { 855 899 list<string> listOfFiles; 856 900 string directoryName; … … 1095 1139 1096 1140 }//end save 1141 1142 1097 1143 } 1098 1144 //JEC 14/11/11 New meanRawDiffOnOffCycles END -
BAORadio/AmasNancay/trunk/plotRawDiffOnOff.pic
r608 r610 22 22 23 23 openppf rawOnOffDiff_${source}-${ncycles}Cycles.ppf 24 24 25 25 26 clearscript evolAt1420Freq
Note: See TracChangeset
for help on using the changeset viewer.