Federatief HO&O Cloud. Sessie: smart sharing van ICT infrastructuur Axel Berg Anwar Osseyran

Transcriptie

1 Federatief HO&O Cloud Sessie: smart sharing van ICT infrastructuur Axel Berg Anwar Osseyran

2 Hybride Federatief HO&O cloud model Gebruikers Nationale Onderzoeksprioriteiten (Big Science) Long-tail of science Hoger Onderwijs Gebruikers bij instellingen Cloud leveranciers Vertrouwen Europese e-infrastructuur (PRACE, GEANT, EGI, EUDAT) Hybride federatieve HO&Ocloud (datacenter, netwerk, compute, storage, applicaties, data) van High-end tot Commodity SURF nationale e-infrastructuur Diverse Publieke Cloud providers Interoperabel, elastisch, kosteneffectief, multi-vendor, veilig Eigen capaciteit instellingen

3 Hybride Federatief HO&O cloud model Gebruikers Nationale Onderzoeksprioriteiten (Big Science) Long-tail of science Hoger Onderwijs Gebruikers bij instellingen Cloud leveranciers Vertrouwen Europese e-infrastructuur (PRACE, GEANT, EGI, EUDAT) Hybride federatieve HO&Ocloud (datacenter, netwerk, compute, storage, applicaties, data) van High-end tot Commodity SURF nationale e-infrastructuur Diverse Publieke Cloud providers Interoperabel, elastisch, kosteneffectief, multi-vendor, veilig Eigen capaciteit instellingen

4 Uitgangspunten voor SURF Coöperatie Cloud Strategie! De behoefte van het HO&O staat centraal! Het hele cloud spectrum (public, private, community, hybrid cloud/mix&match): users are choosers! Ontwikkeling van diensten samen met early adopter instellingen: co-creatie! Diensten worden aangeboden aan alle instellingen via one stop shop! Coöperatie ontzorgt: contractvoorwaarden, vendor-management, support etc

5 Sector Clouds Federative Prosumer Approach! Scalability & competitiveness: " Maximize utilization factor " Public Cloud is integrated! Sustainability: " Federation of existing data centers, discarding of legacy high PUE data centers! Security and performance: " Sector specific security " Better disaster recovery and higher performance by resource aggregation! Community support: " Customer intimacy & sector expertise " Community collaboration and sharing " Better negotiation position with providers

6 Many businesses are reluctant to make the move to public cloud, they opt alternatively for private cloud deployment off-premises, taking advantage of the relative maturity of local hosters. says IDC (27 Apr 2015) Selecting multiple cloud providers for federated provisioning improves performance, reliability and fault tolerance and minimizes cost of cloud services than choosing a single cloud provider. 70% Growth 8% Growth

7

8

9

10

11

12

13 Future datacenters will look like private IaaS clouds, supporting the flexible and agile execution of virtualized services. The ultimate challenge is cloud federation, which involves different architectures & levels of coupling among datacenters.

14 Example of Federative Cloud Services EDUCAUSE DuraCloud To leverage best practices in curation, metadata, usability, and data integrity for the long haul

15 Example of Federative Cloud Services The Massachusetts Open Cloud Federation of administratively distinct clouds

16 Example of Federative Cloud Services Helix Nebula: The Science Cloud Strategic Plan!! Establish multitenant, multiprovider cloud infrastructure Identify and adopt policies for trust, security and privacy! Create governance structure! Define funding schemes Bob Jones (CERN) 28 November 2014 To support the computing capacity needs for the ATLAS experiment Setting up a new service to simplify analysis of large genomes, for a deeper insight into evolution and biodiversity To create an Earth Observation platform, focusing on earthquake and volcano research To improve the speed and quality of research for finding surrogate biomarkers based on brain images Addi.onal)Users:) Suppliers) Adopters) 16)

17 Evolution of the Datacenter Source: Intel 2015 Federated: share data securely across public and private clouds

18 Software-Defined Data Center! All infrastructure (compute, network, storage) is virtualized and delivered as a service, and the control of this data center is entirely automated by software! The ideal architecture for private, hybrid and public clouds

19 Federatief HO&O datacenter Strategische & business design principes! Beter gebruik door van federatie datacenters (personeel, servers, footprint, facilities)! Schaalvoordelen (opex, capex, risico s)! Duurzaamheidvoordelen (energie, CO 2, menskracht, geld)! Bevorderen multivendor, virtualisatie en SDx! Hogere beschikbaarheid, utilisatie en redundantie (services, data), integratie Nationaal datacenter! Service-oriëntatie: ontzorgen datacenter operaties bij individuele instellingen! Betere QoS en veiligheid (privacy en security kaders, data in NL)

20 SURFsara national datacenter! Partnership between SURFsara and TelecityGroup for the development of a national datacenter for higher education and research! Operational medio 2016, 800m 2 (2 floors) and ondemand power 1.8MW for SURFsara! Available for national e-infrastructure services and SURF cooperation cloud! Datacenter in a datacenter, smart sharing of HPC datacenter and commercial datacenter facilities " High energy density per rack! Low PUE (1.2) # sustainable and low costs: " From PUE 1.5 to PUE 1.2 per MW/yr # 300kW/yr # > ,-/yr 11

21 Sharing compute resources! SURFsara national supercomputer Cartesius ( cores) " Shared resource for Dutch scientific community, high utilization factor through on-demand growth " Estimated average utilization gain: 15% # 50kW/yr # ,-/ yr " Warm-water cooling: (30 C in, 45 C out # free-cooling most of the year) # estimated PUE advantage compared to air-cooling of 0,1 (starting from PUE of 1,2) # 85kW/yr # ,-/yr " Next optimization: energy-aware scheduling of workloads! Educated guess of potential for federated IaaS for Higher Education & Research in NL " Estimated average energy use per VM: 30-60W " VM s # kW " Per 10% optimization of utilization factor # 30-60kW/yr for VM s # ,-

22 Hybride Federatief HO&O cloud model Gebruikers Nationale Onderzoeksprioriteiten (Big Science) Long-tail of science Hoger Onderwijs Gebruikers bij instellingen Cloud leveranciers Vertrouwen Europese e-infrastructuur (PRACE, GEANT, EGI, EUDAT) Hybride federatieve HO&Ocloud (datacenter, netwerk, compute, storage, applicaties, data) van High-end tot Commodity SURF nationale e-infrastructuur Diverse Publieke Cloud providers Interoperabel, elastisch, kosteneffectief, multi-vendor, veilig Eigen capaciteit instellingen

23 Let's collaborate and share the smart way