Elixir
VO Elixir was created to support bioinformatics researchers however connected with Elixir project.
ELIXIR CZ operates an infrastructure of computing and storage resources. This page provides an overview how to apply for the access to the resources and where to get further support.
ELIXIR CZ clusters and storage facilities are currently being purchased by the project. They will be fully integrated into MetaCentrum and CERIT-SC infrastructures. For the time being, by applying for the resources, you will get access to the general MetaCentrum and CERIT-SC infrastructures. MetaCentrum and CERIT-SC resources will be available for ELIXIR users even after dedicated ELIXIR resources become available. The principles and tools to access them will not change, either. There are several machines with prioritised and/or dedicated access for ELIXIR CZ members in MetaCentrum.
How to register to get access
Access to all available services requires registration into a special group.
- Registration form (standard ELIXIR CZ account) – for access to ELIXIR and MetaCentrum/CERIT-SC resources: Registration form, follow instructions provided there.
- Authentication via eduID.cz or eduGAIN is recommended for full access to ELIXIR and MetaCentrum/CERIT-SC services. Use the authentication via ELIXIR ID only if you can not use eduID.cz or eduGAIN and your ELIXIR ID account is associated with an academic institution. Otherwise you will get access to ELIXIR resources only (limited account).
Who can apply, terms and conditions
Unrestricted membership in this group is available for persons from academic environment of the Czech Republic and/or their research partners from abroad with research objectives directly related to ELIXIR activities. Members of the computation group are required to:
- comply with usage rules available at https://wiki.metacentrum.cz/wiki/Usage_rules and https://www.elixir-europe.org/services/compute/aai/aup
- provide acknowledgements in their publications that were supported by usage of the resources (see below)
- provide short annual report of achieved results using the resources that is necessary for reporting purposes needed for justification of further investments into the infrastructure.
Acknowledgement formula
The user of MetaCentrum/CERIT-SC resources offered to the ELIXIR community is obliged to use the following acknowledgement formula in all his publications created with the support of CESNET/CERIT-SC/ELIXIR CZ:
Computational resources were provided by the ELIXIR-CZ project (LM2018131), part of the international ELIXIR infrastructure.
Optional formula when MetaCentrum and CERIT-SC general resources have been deployed:
Computational resources were supplied by the project "e-Infrastruktura CZ" (e-INFRA LM2018140) provided within the program Projects of Large Research, Development and Innovations Infrastructures..
Users are also free to acknowledge all the infrastructures mentioned above when appropriate.
Services available for ELIXIR CZ
NGI HPC Computing and storage resources
- Webpage https://metavo.metacentrum.cz/
- Documentation https://wiki.metacentrum.cz/wiki/
- HPC registration: standard account (above)
- Quickstart guide: MetaCentrum PBS Pro Quick Start [PDF], https://wiki.metacentrum.cz/wiki/How_to_compute/Quick_start
- Dedicated ELIXIR CZ resources: https://wiki.metacentrum.cz/wiki/Elixir
MetaCloud
- Webpage https://metavo.metacentrum.cz/pbsmon2/cloud/
- Documentation https://wiki.metacentrum.cz/wiki/Kategorie:Clouds
- MetaCloud group registration (SSH key required): https://perun.metacentrum.cz/fed/registrar/?vo=meta&group=metacloud
- Quickstart guide: Cloud: https://wiki.metacentrum.cz/wiki/MetaCloud_testbed_%E2%80%93_quick_guide
Chipster
- Access: http://chipster.metacentrum.cz:8081/
- Documentation: https://wiki.metacentrum.cz/wiki/Chipster
- Registration: standard account (above)
Mascot
- Access: http://elmo.elixir-czech.cz/mascot/
- Registration: UOCHB
Galaxy
- Documentation https://wiki.metacentrum.cz/wiki/Galaxy
- Access: There are two Galaxy portals available in MetaCentrum/CERIT-SC:
- ELIXIR RE Galaxy
- Portal: https://repeatexplorer-elixir.cerit-sc.cz
- Registration – access to RE Galaxy requires special registration to RE group: https://metavo.metacentrum.cz/osobniv3/wayf/elixir.jsp
- MetaCentrum Galaxy
- Portal https://galaxy.metacentrum.cz/
- Registration: standard account (above)
- ELIXIR RE Galaxy
Running job on Elixir nodes or in MetaCentrum/CERIT-SC
- PBSPro server (batch system): elixir-pbs.elixir-czech.cz
- dedicated Elixir frontend: elmo.elixir-czech.cz
Step by Step tutorial Beginners guide shows how to run a job on MetaCentrum/CERIT-SC machines.
See also the PBS Pro Quick Start [PDF] to run an example job. You can also see video tutorial , which covers this topic (works with PuTTY and Windows)
To access the priority "elixircz" queue (https://metavo.metacentrum.cz/pbsmon2/queue/elixircz) you must specify the queue name and walltime n the qsub:
from any frontend:
$ qsub -q elixircz@elixir-pbs.elixir-czech.cz -l select=1:ncpus=2:mem=2gb:scratch_local=1gb -l walltime=24:00:00 script.sh
from elmo.elixir-czech.cz
elmo$ qsub -q elixircz -l select=1:ncpus=2:mem=2gb:scratch_local=1gb -l walltime=24:00:00 script.sh
Start with MetaCloud
- MetaCloud documentation MetaCloud testbed - quick guide
- MetaCloud video tutorial
Technical support
Should you run into any trouble applying for the resources, using them, or if you just need an advice regarding anything not mentioned here, please, feel free to write an email to MetaCentrum/CERIT-SC/ELIXIR CZ support staff (directed into a request tracking system):
mailto: support@elixir-czech.cz
Actual dedicated hardware for ELIXIR
New nodes from ELIXIR CZ project, in operation from March 2018:
- elmo1.hw.elixir-czech.cz - 224 CPU in total, SMP, 4 nodes with 56 CPUs, 768 GB RAM (Praha UOCHB)
- elmo2.hw.elixir-czech.cz - 96 CPU in total, HD, 4 nodes with 24 CPUs, 384 GB RAM (Praha UOCHB)
- elmo3.hw.elixir-czech.cz - 336 CPU in total, SMP, 6 nodes with 56 CPUs, 768 GB RAM (Brno)
- elmo4.hw.elixir-czech.cz - 96 CPU in total, HD, 4 nodes with 24 CPUs, 384 GB RAM (Brno)
- elmo5.hw.elixir-czech.cz - 896 CPU in total, HD, 27 nodes with 24 CPUs, 192 GB RAM (Brno)
- elan.cerit-sc.cz - 1792 CPU in total, HD, 56 nodes with 32 CPUs, 768 GB RAM (Brno)
frontend: http://elmo.elixir-czech.cz/ - designed for apache, mascot, samba
Storages
- storage-brno11-elixir.metacentrum.cz -- /storage/brno11-elixir/home (313 TB) Back-up policy: regularly local snapshots
- storage-praha5-elixir.metacentrum.cz -- /storage/praha5-elixir/home (157 TB) Back-up policy: back-up copy in different location
Other components:
- rack
- KVM CS-1708i, 8 ports
- InfiniScale IV IS5023Q IB-QDR switch
- Supermicro SSE-G24-TG4 L3 switch - 24GbE, 4xSFP+/C
- Box (JBOD) SAS/SATA,rPS with 62 x Seagate Constelation ES - 2TB/7200rpm/SAS
IPMI interfaces 10.1.7.252-4. Infiniband switch (addresses are 10.1.8.24{4,5,6}). Router, KVM and switch(supermicro sse-g24-tg4) 147.231.18.241-3. There is firewall at UOCHB.
1 node in PRF.JCU Ceske Budejovice (http://www.prf.jcu.cz)
- hagrid.prf.jcu.cz (160.217.209.34): computational node, 20 cores Intel Xeon 4850 @ 2GHz, 512GB RAM, 1.1 TB scratch (6 x 220GB SSD in RAID5), home from /storage/budejovice1 (!)
idrac 160.217.209.32, switch (160.217.209.126)
Current usage at https://metavo.metacentrum.cz/pbsmon2/nodes/physical
--
Links
- Elixir_projects
- PBSMon application https://metavo.metacentrum.cz/en/state/index.html
- Perun identity manager https://perun.metacentrum.cz/krb/gui/
Contatcs
- Jiří Vondrášek (UOCHB AV ČR Praha)
- Jiří Vohradský (MBÚ AV ČR)
- Jan Pačes (UMG AV ČR Praha)
- Miroslav Ruda (CESNET/CERIT-SC)
- Aleš Křenek (CESNET/CERIT-SC)
- Pavel Fibich (CESNET) - technically responsible person MetaCentrum side
- Jiri Polach (UOCHB) - technically responsible person UOCHB side