1

EGI FedCloud Task Force Demo

EGI Technical Forum 2012 – Prague 17/21 Sep

Matteo Turilli

Chair EGI FedCloud Task Force

Senior Research Associate, OeRC, University of Oxford

matteo.turilli@oerc.ox.ac.uk

Demo Team

Mattieu Puel

Boris Parak

Jan Meizner

Björn Hagemeier

Florian Feldhaus

Piotr Kasprzak

Stuart Kenny

Zeeshan Ali Shah Roberto Rosende Dopazo

Emir Imamagic

Alvaro Simon

Michel Drescher

Peter Solagna

Alison Packer

John Gordon

Kostas Koumantaros

Daniele Lezzi

Elisabetta Ronchieri

Ilja Livenson

Task Force Mandate and Organisation

• Mandate: 18 months, September 2011 – March 2013.

• Activities: divided into 3 blocks of 6 months each.

• Workgroups:

– working units within the Task Force.

– Investigate a specified set of capabilities for a federation of clouds.

– Have leaders and collaborators.

• Workbenches: sections of the TF Wiki site collecting and documenting the

activities of each workgroup.

• Meetings: weekly conference call. F2F every 3 months.

https://wiki.egi.eu/wiki/Fedcloud-tf

CNRS LMU

OerC

Masaryk

TUD

IFAE

Cyfronet

SixSq

BSC

CESNET

TCD

SRCE

DANTE

FZJ

GRNET

GWDG

Utrecht

STFC

SARA KTH

INFN

FCTSG

EGI.eu

Task Force Members and Technologies

Members

• 60 individuals.

• 23 institutions.

• 13 countries.

Technologies

• 7 OpenNebula.

• 3 StratusLab.

• 3 OpenStack.

• 1 Okeanos.

• 1 WNoDeS.

Stakeholders • 15 Resource Providers.

• 7 Technology Providers.

• 5 User Communities.

• 3 Liaisons.

Task Force Deliverables

Blueprint document

https://wiki.egi.eu/wiki/Fedcloud-tf:Blueprint

FedCloud test bed

https://wiki.egi.eu/wiki/Fedcloud-tf:Testbed

Federation Test bed

Resource Providers

OpenNebula, OpenStack, Okeanos, WNoDeS…

VM Mngmt

OCCI 1.1

Information

GLUE 2.0+

LDAP/BDII

VM sharing

Marketplace

Accounting

OGF UR+ [StAR]

Message Bus

Monitoring

Nagios

AAI

X509 [SSO, OpenID, Shib]

Clients

Brokers

Portals

… Data

CDMI 1.0 [OVF 1.1]

BNCweb (CLARIN)

• Interface to the British National Corpus (100ml words).

• Widely used in a wide variety of computational linguistic applications.

• Searching the text and exploiting the detailed textual metadata.

• Open source project, freely available for educational and research purposes.

Use cases

1. Teaching a masters course in 'Exploring English Usage' in October-November

2012, and 'Corpus Linguistics' in February-March 2013.

2. Federated search in the CLARIN European e-Infrastructure.

3. Build additional web services on top of BNCWeb, e.g. adding improved

visualizations of the search results.

Demo – BNCweb

Demo Use Case

Resource Provider

GWDG

OCCI 1.1

CDMI 1.0

Information

GLUE 2.0

LDAP

Monitoring

Nagios

Accounting

OGF UR

UR+ & StAR

VM metadata

Marketplace

Resource Provider

CESNET

Resource Provider

CYFRONET

Resource Provider

KTH

Resource Provider

CESGA

Resource Provider

Venus-C

OCCI 1.1

CDMI 1.0

OCCI 1.1

OCCI 1.1

CDMI 1.0

OCCI 1.1

CDMI 1.0

Resource Provider

FZJ

OCCI 1.1

User

x.509

SSH key

Lgn/Pswrd

Resource Provider

IN2P3-CC

OCCI 1.1

Demo Federation View

Information

GLUE 2.0

BDII

Monitoring

Nagios

Accounting

OGF UR

UR+ & StAR

Message Bus

VM metadata

Marketplace

Resource Provider

Venus-C CDMI 1.0

Resource Provider

GWDG (ON/OS)

OCCI 1.1

CDMI 1.0 MP/UR Clients

Resource Provider

CESNET (ON)

OCCI 1.1

CDMI 1.0

Resource Provider

CYFRONET (ON)

OCCI 1.1

Resource Provider

KTH (ON)

OCCI 1.1

CDMI 1.0

Resource Provider

CESGA (ON)

OCCI 1.1

Resource Provider

FZJ (OS)

OCCI 1.1 LDAP

MP/UR Clients

LDAP

ON = OpenNebula.

OS = OpenStack.

MP = Marketplace.

UR = Usage Records.

Resource Provider

IN2P3-CC (OS)

OCCI 1.1 LDAP

MP/UR Clients

Message Bus

CDMI 1.0

Resource Provider

Venus-C

OCCI 1.1 Resource Provider

CESNET (ON) CDMI 1.0

OCCI 1.1 Resource Provider

CYFRONET (ON)

OCCI 1.1 Resource Provider

KTH (ON) CDMI 1.0

OCCI 1.1 Resource Provider

CESGA (ON)

MP/UR Clients

LDAP

MP/UR Clients

LDAP

MP/UR Clients

LDAP

MP/UR Clients

LDAP

Conclusions

Integration

• Third cycle of the TF, 6 months into March 2013.

• Requirements for the integration of the test bed into the EGI infrastructure.

• OCCI client and first broker deployment.

• Focus on use cases.

• Opening of the test bed to early adopters.

Task Force resources

• Mailing List: fedcloud-tf@mailman.egi.eu

• Wiki site: http://go.egi.eu/tf-fedclouds

• GitHub: https://github.com/EGI-FCTF

• Indico site: https://www.egi.eu/indico/categoryDisplay.py?categId=56

11

Thank you

Matteo Turilli

Chair EGI FedCloud Task Force

Senior Research Associate, OeRC, University of Oxford

matteo.turilli@oerc.ox.ac.uk