CLOUD COMPUTING Principles and Paradigms Edited by Rajkumar Buyya The University of Melbourne and Manjrasoft Pty Ltd., Australia James Broberg The University of Melbourne, Australia Andrzej Goscinski Deakin University, Australia CLOUD COMPUTING CLOUD COMPUTING Principles and Paradigms Edited by Rajkumar Buyya The University of Melbourne and Manjrasoft Pty Ltd., Australia James Broberg The University of Melbourne, Australia Andrzej Goscinski Deakin University, Australia Copyright r 2011 by John Wiley & Sons, Inc All rights reserved Published by John Wiley & Sons, Inc., Hoboken, New Jersey Published simultaneously in Canada No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning, or otherwise, except as permitted under Section 107 or 108 of the 1976 United States Copyright Act, without either the prior written permission of the Publisher, or authorization through payment of the appropriate per-copy fee to the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, (978) 750-8400, fax (978) 750-4470, or on the web at www.copyright.com Requests to the Publisher for permission should be addressed to the Permissions Department, John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030, (201) 748-6011, fax (201) 748-6008, or online at http://www.wiley.com/go/permission Limit of Liability/Disclaimer of Warranty: While the publisher and author have used their best efforts in preparing this book, they make no representations or warranties with respect to the accuracy or completeness of the contents of this book and specifically disclaim any implied warranties of merchantability or fitness for a particular purpose No warranty may be created or extended by sales representatives or written sales materials The advice and strategies contained herein may not be suitable for your situation You should consult with a professional where appropriate Neither the publisher nor author shall be liable for any loss of profit or any other commercial damages, including but not limited to special, incidental, consequential, or other damages For general information on our other products and services or for technical support, please contact our Customer Care Department within the United States at (800) 762-2974, outside the United States at (317) 572-3993 or fax (317) 572-4002 Wiley also publishes its books in a variety of electronic formats Some content that appears in print may not be available in electronic formats For more information about Wiley products, visit our web site at www.wiley.com Library of Congress Cataloging-in-Publication Data: Cloud computing : principles and paradigms / edited by Rajkumar Buyya, James Broberg, Andrzej Goscinski p ; cm Includes bibliographical references and index ISBN 978-0-470-88799-8 (hardback) Cloud computing I Buyya, Rajkumar, 1970À II Broberg, James III Goscinski, Andrzej QA76.585.C58 2011 004.67u8—dc22 2010046367 Printed in the United States of America 10 CONTENTS PREFACE XV ACKNOWLEDGMENTS CONTRIBUTORS XIX XXI PART I FOUNDATIONS Introduction to Cloud Computing William Voorsluys, James Broberg, and Rajkumar Buyya 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 Cloud Computing in a Nutshell / Roots of Cloud Computing / Layers and Types of Clouds / 13 Desired Features of a Cloud / 16 Cloud Infrastructure Management / 17 Infrastructure as a Service Providers / 26 Platform as a Service Providers / 31 Challenges and Risks / 34 Summary / 37 References / 37 Migrating into a Cloud 43 T S Mohan 2.1 2.2 2.3 2.4 Introduction / 43 Broad Approaches to Migrating into the Cloud / 48 The Seven-Step Model of Migration into a Cloud / 51 Conclusions / 54 Acknowledgments / 55 References / 55 v vi CONTENTS Enriching the ‘Integration as a Service’ Paradigm for the Cloud Era 57 Pethuru Raj 3.1 3.2 3.3 3.4 3.5 3.6 3.7 3.8 3.9 3.10 3.11 3.12 3.13 An Introduction / 57 The Onset of Knowledge Era / 59 The Evolution of SaaS / 59 The Challenges of SaaS Paradigm / 61 Approaching the SaaS Integration Enigma / 63 New Integration Scenarios / 67 The Integration Methodologies / 69 SaaS Integration Products and Platforms / 72 SaaS Integration Services / 80 Businesses-to-Business Integration (B2Bi) Services / 84 A Framework of Sensor—Cloud Integration [3] / 89 SaaS Integration Appliances / 94 Conclusion / 95 References / 95 The Enterprise Cloud Computing Paradigm 97 Tariq Ellahi, Benoit Hudzia, Hui Li, Maik A Lindner, and Philip Robinson 4.1 4.2 4.3 4.4 4.5 4.6 4.7 4.8 PART II Introduction / 97 Background / 98 Issues for Enterprise Applications on the Cloud / 103 Transition Challenges / 106 Enterprise Cloud Technology and Market Evolution / 108 Business Drivers Toward a Marketplace for Enterprise Cloud Computing / 112 The Cloud Supply Chain / 115 Summary / 117 Acknowledgments / 117 References / 118 INFRASTRUCTURE AS A SERVICE (IAAS) Virtual Machines Provisioning and Migration Services Mohamed El-Refaey 5.1 Introduction and Inspiration / 123 121 123 CONTENTS 5.2 5.3 5.4 5.5 5.6 5.7 5.8 vii Background and Related Work / 124 Virtual Machines Provisioning and Manageability / 130 Virtual Machine Migration Services / 132 VM Provisioning and Migration in Action / 136 Provisioning in the Cloud Context / 145 Future Research Directions / 151 Conclusion / 154 References / 154 On the Management of Virtual Machines for Cloud Infrastructures 157 Ignacio M Llorente, Rube´n S Montero, Borja Sotomayor, David Breitgand, Alessandro Maraschini, Eliezer Levy, and Benny Rochwerger 6.1 6.2 6.3 6.4 6.5 The Anatomy of Cloud Infrastructures / 158 Distributed Management of Virtual Infrastructures / 161 Scheduling Techniques for Advance Reservation of Capacity / 166 Capacity Management to meet SLA Commitments / 172 Conclusions and Future Work / 185 Acknowledgments / 186 References / 187 Enhancing Cloud Computing Environments Using a Cluster as a Service 193 Michael Brock and Andrzej Goscinski 7.1 7.2 7.3 7.4 7.5 7.6 7.7 Introduction / 193 Related Work / 194 RVWS Design / 197 Cluster as a Service: The Logical Design / 202 Proof of Concept / 212 Future Research Directions / 218 Conclusion / 219 References / 219 Secure Distributed Data Storage in Cloud Computing Yu Chen, Wei-Shinn Ku, Jun Feng, Pu Liu, and Zhou Su 8.1 8.2 8.3 Introduction / 221 Cloud Storage: from LANs TO WANs / 222 Technologies for Data Security in Cloud Computing / 232 221 viii CONTENTS 8.4 8.5 PART III Open Questions and Challenges / 242 Summary / 246 References / 246 PLATFORM AND SOFTWARE AS A SERVICE (PAAS/IAAS) 249 Aneka—Integration of Private and Public Clouds 251 Christian Vecchiola, Xingchen Chu, Michael Mattess, and Rajkumar Buyya 9.1 9.2 9.3 9.4 9.5 9.6 9.7 10 Introduction / 251 Technologies and Tools for Cloud Computing / 254 Aneka Cloud Platform / 257 Aneka Resource Provisioning Service / 259 Hybrid Cloud Implementation / 262 Visionary thoughts for Practitioners / 269 Summary and Conclusions / 271 Acknowledgments / 272 References / 273 CometCloud: An Autonomic Cloud Engine 275 Hyunjoo Kim and Manish Parashar 10.1 10.2 10.3 10.4 10.5 10.6 11 Introduction / 275 CometCloud Architecture / 276 Autonomic Behavior of CometCloud / 280 Overview of CometCloud-based Applications / 286 Implementation and Evaluation / 287 Conclusion and Future Research Directions / 295 Acknowledgments / 295 References / 296 T-Systems’ Cloud-Based Solutions for Business Applications Michael Pauly 11.1 11.2 11.3 11.4 Introduction / 299 What Enterprises Demand of Cloud Computing / 300 Dynamic ICT Services / 302 Importance of Quality and Security in Clouds / 305 299 632 25.6.7 ACHIEVING PRODUCTION READINESS FOR CLOUD SERVICES Communication Readiness The purpose of communication readiness is to identify all the activities related to communication issues related to the service operation (e.g., identify medium, format, key personnel to be notified for customer support or during critical message) Communication readiness criteria include customer support scenarios, frequently asked questions (FAQs), help-desk personnel, and key personnel when there are abnormalities in the service operations Assessing production readiness in terms of communication readiness means: Identify all the activities related to communication issues related to service operation 25.6.8 Service Operational Readiness Being production ready also requires a certain level of maturity in operational processes Operational processes include the technology and management tools implementation to ensure the smooth running of the cloud infrastructure These operational processes are broadly categorized into the following:  Event management is a process that monitors all events occurring through the IT infrastructure to allow for normal operation, as well as to detect and escalate exception conditions  Incident management is a process that focuses on restoring, as quickly as possible, the service to normal operating conditions in the event of an exception, in order to minimize business impact  Problem management is a process that drives root-cause analysis to determine and resolve the cause of events and incidents (reactive), and activities to determine patterns based on service behavior to prevent future events or incidents (proactive)  Request fulfillment is a process that involves the management of customer or user requests that are not generated as an incident from an unexpected service delay or disruption  Security Management is a process to allow authorized users to use the service while restricting access to nonauthorized users (access control)  Provisioning management is a process that allows the cloud service provider to configure and maintain the infrastructure remotely Advantages include ease of use, speed in provisioning, and ease of maintenance of the cloud infrastructure Assessing production readiness in terms of service operational readiness means: Ready to support the operations and maintenance of the services 25.6 25.6.9 ASSESSING PRODUCTION READINESS 633 Key Performance Indicators (KPIs) KPIs should be set and defined as part of the service design to develop an effective metric of measurement for the service An effectiveness service metric can be achieved by focusing on a few vital, meaningful indicators that are economical and useful for measuring results of the service performance Some of the examples of KPIs that can be established are:  Metrics measuring performance of the service against the strategic business and IT plans  Metrics on risks and compliance against regulatory, security, and corporate governance requirements for the service  Metrics measuring financial contributions of the service to the business  Metrics monitoring the key IT processes supporting the service  Service-level reporting  Metrics measuring customer satisfaction Assessing production readiness in terms of key performance indicators means: Effective metric of measurement for the service has been developed 25.6.10 Acceptance Testing The last criteria before a cloud service is ready for production is an adequate level of measurement set in the KPI metrics There are several tests that should be planned and carried out:  Load Testing Simulating expected and stretched loads for stress testing  User Testing Simulating user activities, including provisioning, transactional, and other usage patterns  Fault Tolerance Testing Fault tolerance testing is to stress test the service architecture in the event of an unexpected fault  Recovery Testing Testing of recovery procedures in the event of failure to determine the accuracy of recovery procedures and the effects of failure on the consumers  Network Testing Assessment of network readiness and latency requirements to determine if the cloud infrastructure is capable of allowing the maximum number of concurrent consumers (under planned maximum load)  Charging and Billing Testing Validate charging, billing and invoicing for the use of a cloud services 634 ACHIEVING PRODUCTION READINESS FOR CLOUD SERVICES Assessing production readiness in terms of acceptance testing means: The service has passed an adequate level of measurement set in KPI metrics 25.7 SUMMARY In this chapter we discussed the consideration for cloud service providers to build the cloud service To the cloud service provider, designing, building, implementing, and commissioning underlying technology infrastructure translates to creating the foundation to produce the service that is ready for consumption This chapter provides clarity on what are the elements that are required to be assessed, evaluated, tested, and accepted prior to classifying a produced service is ready for consumption These foundation elements will be used to produce the cloud service that will be ready for consumption REFERENCES K Stanoevska-Slabeva, and T Wozniak, S Ristol, Grid and Cloud Computing: A Business Perspective on Technology and Applications, Springer, Berlin, 2009 The Stationery Office, The Official Introduction to the ITIL Service Lifecycle, OGC (Office of Government Commerce), United Kingdom, 2007 J van Bon and A van der Veen, Foundations of IT Service Management based on ITIL, Vol 3, Van Haren Publishing, Zaltbommel, September 2007 M Miller, Cloud Computing: Web-based applications that change the way you work and collaborate online, Que, 2008 D C Plummer, D Smith, T J Bittman, D W Cearley, D J Cappuccio, D Scott, R Kumar, and B Robertson, Gartner highlights five attributes of cloud computing, Gartner Report, Vol G00167182, pp 1À5, May 5, 2009 R Buyya, C S Yeo, and S Venugopal, Market-oriented cloud computing: Vision, hype, and reality for delivering IT services as computing utilities, in Proceedings of the 10th IEEE International Conference on High Performance Computing and Communications (HPCC 2008, IEEE CS Press, Los Alamitos, CA, USA), Dalian, China, September 25À27, 2008 D Alger, Build the Best Data Center Facility for Your Business, Cisco Press, Indianapolis, USA, June 2005 INDEX Amazon Cloud, 459 NET, 83 Integration as a Service, 57 Admission Control, 420 Adoption, 99 Amazon Web Service, 28, 459 Aneka, 32, 251 Apache VCL, 21 App Engine, 32 Application as a Service, 438 Application Performance, 366 Application Service Providers, 415, 595 AppLogic, 21 Attribute, 197 Authentication, 239 Authorization, 240 Autonomic Cloud, 275 Autonomic Computing, 13 Availability, 20 B2Bi, 84 Boomi Software, 74 Budget-Based policy, 291 Bungee Connect, 74 Business Applications, 299 Business Drivers, 112 Business Orientation, 400 Cast Iron Systems, 94 Change Management, 551, 559 Charging Model, 619 Citrix Essentials, 22 Client-side attack, 240 Cloud Environment, 440 Cloud Infrastructure, 157 Cloud Mashups, 533 Cloud Migration, 50 Cloud Practices, 468 Cloud Security, 577 Cloud Services, 615 Cloud Storage, 513, 519 CloudFront, 513 CloudMQ, 79 Cluster as a Service, 193 CometCloud, 275 Compliance, 305 Components, 470 Confidentiality, 228 Connectivity, 70 Connector, 197 Consumption, 99 Content Delivery Networks, 511 Credentials, 477 Customization, 17, 304 Data Integrity, 71 Data Location, 603 Data Lock-In, 35 Data Management, 541 Data Mediation, 70 Data privacy protection, 234 Data Privacy, 596 Data Protection, 604 Data Security, 573 Data Storage, 221 Deming Cycle, 559 Cloud Computing: Principles and Paradigms, Edited by Rajkumar Buyya, James Broberg and Andrzej Goscinski Copyright r 2011 John Wiley & Sons, Inc 635 636 INDEX Deployment Models, 15 Digital identity, 584 Disaster Recovery, 36, 607 Distributed Management Task Force, 129 Distributed Management, 157 Drivers, 300 Elastic Compute Cloud, 28 Elasticity, 16, 399 Energy Efficiency, 36 Enomaly ECP, 22 Enterprise Cloud Computing, 98 Eucalyptus, 22 Fault-Tolerance, 36 Feasibility Analysis, 425 Federated Cloud, 393 Federation, 398 Flexiscale, 30 Force.com, 34 GoGrid, 30 Google App Engine, 195 Governance, 71 GrepTheWeb Hadoop, 486 GrepTheWeb, 479 Grid Computing, GridGain, 385 Hadoop, 375 HadoopMapReduce, 381 Haizea, 149 Heroku, 34 High Performance Computing, 346 Hybrid Clouds, 15 Hypervisor, 28 IDEAS, 364 Identity, 579 Image Management, 163 Image Registration, 287 Independence, 399 Informatics On-Demand, 81 Information Card, 581 Infrastructure as a Service, 13 Integration as a Service, 57 Interoperability, 533 Isolation, 399 Jitterbit, 72 Job Monitoring, 208 Job Submission, 207 Joyent, 30 Jurisdictions, 600 Key Performance Indicators, 633 KVM, 11 LAN, 222 Law Compliance, 597 Leasing, 169 Legal Issues, 593 Licensing Agreements, 601 Linxter, 79 Load balancing, 27 Mainframes, Managed Service Provider, 418 Management, 391 MapReduce, 355, 373 MapReduce.NET, 384 Market Evolution, 108 Mashups, Maturity Model, 563 Microsoft Azure, 34 Microsoft Internet Service Bus, 82 Migration Services, 123 Modularization, 304 Monitoring, 391 Montage, 356 Multimedia Streaming, 535 Multiobjective optimization, 334 Multiplayer Games, 491 Multi-tenancy, 604 Negotiation, 20 Networking, 164 Nimbus 3, 23 Notification, 198 On-boarding, 427 Online MQ, 79 Open Cloud Computing Interface Working Group, 129 Open Grid Forum, 129 Open Source, 610 OpenNebula, 24 INDEX Download from Wow! eBook OpenPEX, 24 Operating System, 28 OpSource Connect, 75 Outsourcing, 595 oVirt, 24 Performance Prediction, 439 Persistence, 31 Per-usage Metering, 16 Platform as a Service, 14 Private Clouds, 251 Productivity, 301 Provisioning, 123, 544 Public Clouds, 251 Quality of Service, 323, 618, 521 Query Integrity Assurance, 234 Rackspace Cloud Servers, 31 Recovery, 20 Regulatory Compliance, 555 Replication, 242 Repudiation, 228, 579 Requirements, 300 Reservation, 20 Result collection, 208 Risk Allocation, 603 Salesforce, 196 SAP, 316 Scaling, 27 Scheduling, 166 Scientific Applications, 345 Self Service, 16 Semantic, 70 Service Design, 623 Service Discovery, 194 Service Level Agreements, 413 Service Life Cycle, 620 Service Management, 615 Service Operation, 625 Service Oriented Architecture, Service Publication, 194 Service Selection, 194 Service Transition, 624 Service Paradigm, 57 Service Level Objectives, 413 Services Agreements, 601 637 Simple API for Grid Applications, 354 Skynet, 384 SnapLogic, 75 Socio-cultural, 557 Software as a Service, 15 Solution, 300 Standard Contracts, 602 Standardization, 35, 129 Storage Delivery Network, 515 Storage, 222 Subcontracting, 605 Subscription Model, 620 Threats, 407 Transition, 106 Trust, 400, 579 T-Systems, 299 Untrustworthy Storage, 235 User Interface, 26 Utility computing, Utility Model, 620 Value at Risk, 286 Value Composition, 618 vCloud, 25 Virtual Administration, 467 Virtual Appliances, 12 Virtual Engine, 440 Virtual Environments, 537 Virtual Machines, 123 Virtual Management Initiative, 129 Virtualization Format, 12 Virtualization Support, 18 Virtualization, 10 VMWare, 11 vSphere, 25 WAN, 222 Web, 2, Web Server, 134 Web Services Description Language, 193 Web Services, Winning Environment, 558 Workflow Engine, 321 Workflow Management System, 324 Workload-Based policy, 291 Xen, 11 ... to Cloud Computing William Voorsluys, James Broberg, and Rajkumar Buyya 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 Cloud Computing in a Nutshell / Roots of Cloud Computing / Layers and Types of Clouds... behind this model is offering computing, storage, and software “as a service.” Cloud Computing: Principles and Paradigms, Edited by Rajkumar Buyya, James Broberg and Andrzej Goscinski Copyright... Security in the Cloud / 574 573 CONTENTS 23.3 23.4 23.5 23.6 23.7 23.8 23.9 24 xiii Homo Sapiens and Digital Information / 575 Cloud Computing and Data Security Risk / 576 Cloud Computing and Identity