61 Works

HPC-Europa3 - D12.5 - Workload collocation based on container technologies to improve isolation

Rudyy, Oleksandr (BSC), Garcia-Gasulla, Marta (BSC) & Sirvent, Raül (BSC)
The aim of this report is to study containers resource isolation and explore Dynamic Resource Assignment techniques to maximize hardware utilization. Containers bring virtualization benefits to High-Performance Computing systems, thus allowing the safe execution of concurrent applications within the same computational node. In this situation it becomes possible to dynamically re-assign resources of multiples applications given their workload, maximizing the useful time the hardware is being used. Nevertheless, containers do not fully isolate their environment...

D12.1- Container-as-a-service analysis report

Niall Wilson
The main goal of this report is to evaluate the use of container technology in order to streamline the deployment of HPC end-user applications. Each application to be deployed typically has a number of dependencies in terms of supported versions of the OS, compilers and linked libraries, which make the maintenance of the different installations complex and error prone on typical HPC systems. The implementation of a lightweight virtualization strategy can strongly improve both the...

EUDAT D4.5: Data and Computing Landscape Characteristics and Scientific Communities’ Environment & Requirements (update)

Daan Broeder, Leon Du Toit, Jörg Meyer & Jan Bot
D4.5 reports on the findings of 14 face-to-face interviews and 10 desktop analyses in the form of a landscape study. Community specific analysis reports are summarised according to generic community features and compared within different scientific disciplines. We evaluate trends across these disciplines too. Findings with respect to EUDAT services and the EUDAT organization are extracted and discussed. A chapter on research libraries in Europe sets out trends in data management to which EUDAT can...

D4.9: Service Uptake within Communities (final)

Daan Broeder & Debora Testi
Deliverable D4.9 reports on the progress over the final year with respect to the uptake of EUDAT services by the research communities associated with EUDAT and on the work done on determining the requirements of those communities in relation to service building, service extensions and service provisioning that have been extracted from the research community service uptake plans and the Data Pilot proposals. D4.9 builds on the reporting done earlier in D4.6 about the administrative...

D6.3: Report on Status and Progress of Operations - Year 3

Reetz, Johannes (MPCDF), Weber, Pavel (KIT), Morelli, Giovanni (CINECA), Vicente, David (BSC), & Kaila, Urpo (CSC)
This document about WP6 “Operations” is the final report on the work concerning the federated service management of the EUDAT Common Data Infrastructure (CDI), the coordination the provisioning of resources and services and the enabling of data projects within the 3rd EUDAT2020 project year. The final achievements in projects enabling and the federated service management are presented.

HPC-Europa3 - D12.3 - Using container technologies to improve portability of applications in HPC

Muscianisi, Giuseppa (CINECA)
The aim of this deliverable is to provide indications about how to use container to improve portability of applications on HPC systems. Important steps to run a containerized application in a HPC system include the combination of a container instance within the job batch scheduler available on the system. In the first sections, this deliverable is focused about the usage of MPI libraries, network interconnection drivers and accelerators within a container. Then, some considerations about...

HPC-Europa3 - D12.3 - Using container technologies to improve portability of applications in HPC

Muscianisi, Giuseppa (CINECA)
The aim of this deliverable is to provide indications about how to use container to improve portability of applications on HPC systems. Important steps to run a containerized application in a HPC system include the combination of a container instance within the job batch scheduler available on the system. In the first sections, this deliverable is focused about the usage of MPI libraries, network interconnection drivers and accelerators within a container. Then, some considerations about...

D4.7: Activity Report, year 2

Daan Broeder, Thomas Zastrow, Yann Le Franc, Hilary Hanahoe & Caterina Piagentini
Deliverable D4.7 reports on the progress and achievements of WP4 since month 12 of EUDAT2020 with respect to task 4.3 “Community Engagement” and task 4.4 “External Research & Standard Organizations Liaison”. It describes the progress with the EUDAT working group process, the interaction with the EUDAT Data Pilots. In addition, EUDAT’s contacts with the RDA and the ESFRI clusters are described.

HPC-Europa3 - D12.5 - Workload collocation based on container technologies to improve isolation

Rudyy, Oleksandr (BSC), Garcia-Gasulla, Marta (BSC) & Sirvent, Raül (BSC)
The aim of this report is to study containers resource isolation and explore Dynamic Resource Assignment techniques to maximize hardware utilization. Containers bring virtualization benefits to High-Performance Computing systems, thus allowing the safe execution of concurrent applications within the same computational node. In this situation it becomes possible to dynamically re-assign resources of multiples applications given their workload, maximizing the useful time the hardware is being used. Nevertheless, containers do not fully isolate their environment...

HPC-Europa3 - D12.4 - Orchestration of applications packaged as containers

Sébastien, Gadrat (CNRS)
This deliverable is providing a status report of the use of Singularity containers within a workflow manager. The main goal will be to highlight potential constraints when running a workflow of containerized applications. A few workflow managers will be selected and evaluated, then a real use case will be fully implemented.

HPC-Europa3 - D12.2 - Container-as-a-service Technical Documentation

Wilson, Niall (ICHEC)
This document contains technical documentation related to the installation and usage of a number of container technologies used for HPC applications. It also demonstrates how container images can be created and used on different systems

HPC-Europa3 - D12.3 - Using container technologies to improve portability of applications in HPC

Muscianisi, Giuseppa (CINECA)
The aim of this deliverable is to provide indications about how to use container to improve portability of applications on HPC systems. Important steps to run a containerized application in a HPC system include the combination of a container instance within the job batch scheduler available on the system. In the first sections, this deliverable is focused about the usage of MPI libraries, network interconnection drivers and accelerators within a container. Then, some considerations about...

EUDAT D5.1: Report on Service Building Status and Progress, year 1

Mark Van De Sanden, Carl Johan Håkansson, Claudio Cacciari, Alison Packer, Emanuel Dima, Benedikt Von St. Vieth, Hannes Thiemann, Toni Cortes, Willem Elbers, Tobias Weigel, Roberto Mucci, Yann Le Franc & Christine Staiger
This document provides a comprehensive overview of the activities related to building data management services and of the architectural discussions about the EUDAT Common Data Infrastructure (CDI) that were conducted during the first year of the EUDAT2020 project. The service building activities concentrated on the consolidation and integration of the existing EUDAT services and on the uptake of new community requirements initiated from the community uptake plans and data pilots or as a result from...

CSC transnational access success story

CSC Atte Sillanpää
This document describes the fruitful collaboration of Dr. Volker Deringer from the University of Cambridge, UK, and Dr. Miguel Caro, from the Aalto University, Finland, which started through a HPC-Europa3 transnational access visit. The collaboration has resulted directly in three high-impact journal publications and was motivated by the different skills which together enabled carrying out ground-breaking research on industrially and scientifically important amorphous carbon films. The work has also advanced the simulation methods in general....

D8.6: Report on Experiences Applying the Prototype with Different Community Use Cases

Christian Pagé, Xavier Pivan, Emanuel Dima, Asela Rajapakse, Doron Goldfarb & Toni Cortes
This deliverable investigates potential new technologies and develop prototypes and proof-of-concept (PoC) services based on community requirements. The following communities have described Use Cases that solve some issues using EUDAT Services, and that uses exploratory, extensions and prototype services as well as concepts developed within WP8: ENES, CLARIN, EPOS, and LTER.

HPC-Europa3 - D12.1 - Container-as-a-service analysis report

Wilson, Niall (ICHEC)
The main goal of this report is to evaluate the use of container technology in order to streamline the deployment of HPC end-user applications. Each application to be deployed typically has a number of dependencies in terms of supported versions of the OS, compilers and linked libraries, which make the maintenance of the different installations complex and error prone on typical HPC systems. The implementation of a lightweight virtualization strategy can strongly improve both the...

HPC-Europa3 - D2.3 - First research projects directory

Testi, Debora (CINECA)
This first document in a series which collects the scientific results of some of the research visits carried out in the first year of the HPC-Europa3 Transnational Access visitor programme. The report clearly demonstrates the highly multidisciplinary nature of the programme as well as the relevant scientific results that the researchers achieve during their visits.

HPC-Europa3 - D2.2 - First Transnational Access summary report

Inglis, Catherine (UEDIN-EPCC)
This document is the first report on the HPC-Europa3 Transnational Access activity. It covers the first reporting period (Months 1-18, i.e. 1 May 2017 – 31 October 2018). In this report, we provide statistics relating to the number of applications received, users who were given access, and computing time used. There is also information about the outreach and dissemination activities, selection procedure, and the first HPC-Europa3 users’ group meeting, the Transnational Access Meeting (TAM 2018).

HPC-Europa3 - D2.1 - Marketing Plan

Catherine Inglis (UEDIN-EPCC)
This Marketing Plan explains how HPC-Europa3 will aim to ensure that the highest number of relevant research groups in all of the eligible countries is informed of the opportunities offered by the programme. It provides details of how the HPC-Europa3 consortium will publicise the opportunities offered by the programme, and disseminate the results of the work carried out with the support of the programme. It also discusses how the effectiveness of the marketing activities will...

CSC Transnational Access success story

Atte Sillanpää, Miguel A Caro & Volker Deringer
This document describes the fruitful collaboration of Dr. Volker Deringer from the University of Cambridge, UK, and Dr. Miguel Caro, from the Aalto University, Finland, which started through a HPC-Europa3 transnational access visit. The collaboration has resulted directly in three high-impact journal publications and was motivated by the different skills which together enabled carrying out ground-breaking research on industrially and scientifically important amorphous carbon films. The work has also advanced the simulation methods in general....

D2.7: Certification Implementation Report

Heiko Tjalsma
In this deliverable the question is answered how trustworthiness by means of DSA certification can be achieved within the EUDAT infrastructure. This turned out to be a complicated issue. A partial solution has been found for making the EUDAT services trustworthy for data repositories wanting to user these services for (long-term) storage.

D2.6: Implementation Report on Cost Model Pilots

Magchiel Bijsterbosch
This report contains the main findings, conclusions and recommendations of the EUDAT working group on Cost Recovery.

D7.3: EUDAT/PRACE Joint Call for Proposals

Fiameni, Giuseppe (CINECA), Coutin, Stephané (CINES), Morelli, Giovanni (CINECA) & Jankowski, Michal (PSNC)
This document describes the work undertaken by Task 7.1 "Joint Access to Data and HPC Services" within the EUDAT2020 project focusing on the definition of synergies with other EU e-infrastructures and mostly on the interoperability achieved between EUDAT and PRACE. The main objective of this conducted work was to realize cross-infrastructure services that enable the required seamless access to a combined infrastructure offering in pairing the available data and high-performance computing resources.

DAITF-ICRI-2012-Workshop

Francoise Genova
This ZIP-file contins the set of slides and documents that were presented at the DAITF workshop (and the report) that was held in conjunction with the ICRI 2012 conference in Copenhagen. This workshop brought together 74 data experts from many regions of the world. Finally, this workshop resulted in the clear vision that a global initiative should be established to improve data sharing and reuse which later became the Research Data Alliance. In particular L....

Registration Year

  • 2017
    21
  • 2018
    25
  • 2019
    15

Resource Types

  • Text
    61

Data Centers

  • CSC - IT Center for Science
    60
  • Aalto University
    1