How to run analysis pipelines at Bologna (CNAF) computer center

Perform the following steps:

1. Logg in to one of the following machines

        ui01-virgo.cr.cnaf.infn.it.
        ui02-virgo.cr.cnaf.infn.it.
       

   These are the User Interface machine which shares the following directories with the Worker Nodes:

       /storage/gpfs_virgo3/home
       /storage/gpfs_virgo3/scratch
       /storage/gpfs_virgo3/virgo
     

   If possible use the scratch area, since it is world readable.
2. Change to one of the shared directories.

       (cmd.: cd /storage/gpfs_virgo3/home/gdebrecz)
       

3. Create a new directory, and enter into it.

       (cmd.: mkdir mywd; cd mywd)
       

4. IMPORTANT: Set the file creation mask to 0002, i.e. the files you are creating from now on will be group writeable.

      (cmd.: umask 0002)
       

5. Source VIRGO environment setting file:

      (cmd.:  . /opt/exp_software/virgo/lscsoft/etc/virgoenv.sh)
       

6. Launch some condor test job and check whether it works fine or not.

       (cmd:.
       cp /storage/gpfs_virgo3/home/gdebrecz/condortest/* .
       condor_submit vog-testjob.des
       )
       

7. If the testjobs finished OK, then from this point on you can do everything in the same way as on other clusters. Except the fact, that you have to copy the

       /opt/exp_software/virgo/lscsoft/etc/LSCdataFind
        

   executable and overwrite the one comes with the standard LSCsoft installation !

BE AWARE, that all your files and software _should be installed on the shared areas_ and should be group read/writeable so that your jobs on the Worker Nodes - which are running as a different user - could access it !

Notes:

1. You can find a test installation as an example here:

       /opt/exp_software/virgo/lscsoft/
       

   and have a look to

       /opt/exp_software/virgo/lscsoft/etc/s5grbenv.sh
        

   to see how I source the various files.

1. The system python installation should not be used, use the one installed in the above software area !