(r4) VirgoTechnical < RmiVirgo

RmiVirgo Web>VirgoTechnical (revision 4) (raw view)~~EditAttach~~
%INCLUDE{"WebHome" section="Virgotemplate_eng"}%
---++ Technical details
%TOC%
---+++ How to use this Twiki
If you are reading this, it means that you already have a Twiki account. Use the "Raw edit" button to edit pages, it's much
faster then the WYSIWYG editor.

---+++ Getting a certificate
In order to use the Virgo-Ligo computing facilities one needs a certificate. The easiest way is to get a certificate is to request one from the RMKI CA, [[http://pki.kfki.hu/][here]], or if you have a CERN NICE account you can obtain a certificate from [[https://ca.cern.ch/ca/][here]]
---+++ AFS account
For the KFKI AFS user home areas and Virgo Group project space =/afs/kfki.hu/project/virgo= you need an AFS account. If you don't have, ask for one by sending an e-mail to

<center>
gridadm@rmki.kfki.hu
</center>

You can find further info about the KFKI AFS system on the [[http://grid.kfki.hu/twiki/bin/view/KFKIAFS/WebHome][KFKI AFS Twiki Web]]

---+++ Registering in the Virgo Virtual Organisation
In order to use various computing facilities and have the proper access rights to the data you have to be a member of the Virgo Virtual Organisation.
With you certificate loaded into your browser register yourself on the [[https://voms.cnaf.infn.it:8443/voms/virgo/][Virgo VOMS Server]]

---+++ Grid User Interface
Having an AFS account one can use the =u1.kfki.hu= and =u2.kfki.hu= machines which are Grid User Interfaces. However if you are running
Red Heat binary compatible Linux distribution on your laptop (SL,SLC,CentOS, RES,etc), then you can use the AFS UI. To have a pre-configured Grid UI  environment
in your shell you just have to source the following files (depending on your shell):

=.  /afs/kfki.hu/project/virgo/gliteUI/current/etc/profile.d/grid-env.(c)sh=

---+++ Account for LSC , LDG 
In order to be able to use the CCs @ Caltech  you have to register (with your certificate) and follow the Instructions here: [[https://ligo.aset.psu.edu/account.shtml][https://ligo.aset.psu.edu/account.shtml]]
Give your mobile phone as contact, since they will call you back in order to confirm the registration.

Once you have the login, you can use your certificate to log into the =ldas-grid.ligo-la.caltech.edu= cluster, where you can submit jobs.

The LDG client description here: https://www.lsc-group.phys.uwm.edu/lscdatagrid/doc/index.html
---+++ Account for the Atlas cluster

I don't know how I got it... ;-) I guess this is somehow automatic after requesting for LSC account.
Machine name is =epimetheus.atlas.aei.uni-hannover.de=, or =h2.atlas.aei.uni-hannover.de=. 

---+++ Account for Lyon and Bologna
You have to ask to the Virgo responsibles for the two computing centers:

---++++Account for Bologna
Simply go to http://www.cnaf.infn.it/main/index.php/en/Reparto_Rete_e_Sistemi_Informatici/Sicurezza_Informatica
and follow the instructions. In the form you have to fill, please indicate Fulvio Ricci as INFN-CNAF contact person.
Cnaf people will explain how to login. Help from:

   * Fulvio Ricci: fulvio.ricci@roma1.infn.it 
   * Cristiano Palomba: Cristiano.Palomba@roma1.infn.it

---++++Account for Lyon
Contact:
   * Marie Anne Bizouard: mabizoua@lal.in2p3.fr

A description about the LAL software: [[https://www.lsc-group.phys.uwm.edu/daswg/projects/lal.html][https://www.lsc-group.phys.uwm.edu/daswg/projects/lal.html]]

---+++ Account  for the web pages:
Ask Gergo (Gergely.Debreczeni@cern.ch) for it.

---+++ Access to the DA pages and Cascina CC
Lot of useful info about DA: [[https://workarea.ego-gw.it/][https://workarea.ego-gw.it/]]. To get access to these pages and for the Cascina CC, write an e-mail to: service@ego-gw.it

---+++ Virgo software
Info about the Virgo software [[http://wwwcascina.virgo.infn.it/sDoc/VirgoReleases/Distributions/index.html][here]].  For any help:
   * swmgr@ego-gw.it
   * franco.carbognani@ego-gw.it
   * elena.cuoco@ego-gw.it

---+++ Data transfer and access from Bologna

---++++Virgo data in Bologna

V2 h(t) realises are used for searches. You can find infos about data location at:

https://workarea.ego-gw.it/ego2/virgo/data-analysis/data/data-in-lyon/data-in-bologna/

You will see that exists 3 h_t v2 realise, differing in the acquisition
rate. In that page, at the beginning
 you have the ffl files: these are files which point to the actual data
location and are used by the frame library
 through which we read the frame files with the data.
If you can't still access the page, here is the location of the ffl
files in Bologna:
<verbatim>
/opt/exp_software/virgo/virgoData/ffl/VSR1-HrecV2-16384.ffl
/opt/exp_software/virgo/virgoData/ffl/VSR1-HrecV2-16384.ffl
/opt/exp_software/virgo/virgoData/ffl/VSR1-HrecV2-16384.ffl
</verbatim>
All Virgo h(t)_V2 data should be about 1.4T. In the data there are obviously good and bad periods: we always use the data
 acquired when the ITF is in Science Mode. Moreover, there could still be problems which prevent from using the data. You can find the good segments,
together with the veto etc,  using the Virgo Data base:

https://vdb.virgo.infn.it/VDB/main.php

Physycal storage is =storm02.cr.cnaf.infn.it=, the directories:
=/storage/gpfs_virgoX/virgo/data/= ,X=1,2,4,5,6
---------------

---++++LIGO data in Bologna
<verbatim>
LHO-H1 /opt/exp_software/virgo/virgoData/ffl/H-H1_RDS_C03_L2.ffl
LHO-H2  /opt/exp_software/virgo/virgoData/ffl/H-H2_RDS_C03_L2.ffl
LLO-L1 /opt/exp_software/virgo/virgoData/ffl/L-L1_RDS_C03_L2.ff
</verbatim>

As for the good period in LIGO data, you could check if there are
already these infos  in the Virgo DA, otherwise you should use segFind, which is a LIGO tool.

As for installing the LIGO software and running in your cluster, you
could refer to the pages about LIGO software I sent to you yesterday - to install, a part from
LAL etc, also the tools they need. For CBC pipeline, you could ask to Frederique (marion@lapp.in2p3.fr)
about what is the status at Lyon.

---+++ Storage @ RMKI
A 40 TB storage is available. To browse it's content you can go to the [[https://virgo-se.kfki.hu][DPM browser]], ot use the DPM CLI on one of the Grid UI to interact with the server.
Docs on DPM CLI: [[https://twiki.cern.ch/twiki/bin/view/LCG/DpmApi][https://twiki.cern.ch/twiki/bin/view/LCG/DpmApi]]

%INCLUDE{"WebHome" section="Virgofooter_eng"}%
-- Main.GergelyDebreczeni - 25 Nov 2008
Topic revision: r4 - 2008-12-11 - GergelyDebreczeni
RmiVirgo
Copyright &© by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback