4.4 Article

OpenStack Neat: a framework for dynamic and energy-efficient consolidation of virtual machines in OpenStack clouds

期刊

出版社

WILEY
DOI: 10.1002/cpe.3314

关键词

cloud computing; OpenStack; virtualization; dynamic VM consolidation; framework

向作者/读者索取更多资源

Dynamic consolidation of virtual machines (VMs) is an efficient approach for improving the utilization of physical resources and reducing energy consumption in cloud data centers. Despite the large volume of research published on this topic, there are very few open-source software systems implementing dynamic VM consolidation. In this paper, we propose an architecture and open-source implementation of OpenStack Neat, a framework for dynamic VM consolidation in OpenStack clouds. OpenStack Neat can be configured to use custom VM consolidation algorithms and transparently integrates with existing OpenStack deployments without the necessity of modifying their configuration. In addition, to foster and encourage further research efforts in the area of dynamic VM consolidation, we propose a benchmark suite for evaluating and comparing dynamic VM consolidation algorithms. The proposed benchmark suite comprises OpenStack Neat as the base software framework, a set of real-world workload traces, performance metrics and evaluation methodology. As an application of the proposed benchmark suite, we conduct an experimental evaluation of OpenStack Neat and several dynamic VM consolidation algorithms on a five-node testbed, which shows significant benefits of dynamic VM consolidation resulting in up to 33% energy savings. Copyright (C) 2014 John Wiley & Sons, Ltd.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.4
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Computer Science, Information Systems

DebtCom: Technical Debt-Aware Service Recomposition in SaaS Cloud

Satish Kumar, Tao Chen, Rami Bahsoon, Rajkumar Buyya

Summary: In this article, we propose DebtCom, a framework that determines whether to trigger recomposition based on the technical debt metaphor and time-series prediction of workload. Our core idea is that recomposition can be unnecessary if the under-/over-utilization only cause temporarily negative effects, and the current composition plan, although carries debt, can generate greater benefit in the long-term. The results confirm that, in contrast to the state-of-the-art, DebtCom achieves better utility while having lower cost and number of recompositions, rendering each composition plan more sustainable.

IEEE TRANSACTIONS ON SERVICES COMPUTING (2023)

Article Multidisciplinary Sciences

A sustainable and secure load management model for green cloud data centres

Deepika Saxena, Ashutosh Kumar Singh, Chung-Nan Lee, Rajkumar Buyya

Summary: The unsustainable demand and ineffective load management in Cloud Data Centres (CDCs) lead to high energy consumption, resource contention, excessive carbon emission, and security threats. A novel Sustainable and Secure Load Management (SaS-LM) Model is proposed to address these issues by dynamically adjusting the load to maximize security and sustainability. An evolutionary optimization algorithm called Dual-Phase Black Hole Optimization (DPBHO) is used to estimate resource usage and detect congestion. SaS-LM is evaluated using real-world Google Cluster VM traces and shows significant reductions in carbon emission and energy consumption, as well as improved resource utilization.

SCIENTIFIC REPORTS (2023)

Article Computer Science, Theory & Methods

SLA Management in Intent-Driven Service Management Systems: A Taxonomy and Future Directions

Yogesh Sharma, Deval Bhamare, Nishanth Sastry, Bahman Javadi, Rajkumar Buyya

Summary: This article reviews how intent-driven service management systems manage and fulfill SLA requirements and proposes four intent management activities performed in a closed-loop manner. The article categorizes and compares existing SLA management techniques in IDSM systems and suggests future research directions.

ACM COMPUTING SURVEYS (2023)

Article Computer Science, Theory & Methods

Placement of Microservices-based IoT Applications in Fog Computing: A Taxonomy and Future Directions

Samodha Pallewatta, Vassilis Kostakos, Rajkumar Buyya

Summary: This article introduces the utilization of fog computing paradigm and microservice architecture in IoT applications, and their relationship. Efficient placement algorithms are required for microservices-based IoT applications to achieve diverse performance requirements and overcome the challenges introduced by the architecture.

ACM COMPUTING SURVEYS (2023)

Article Computer Science, Theory & Methods

Deep reinforcement learning for application scheduling in resource-constrained, multi-tenant serverless computing environments

Anupama Mampage, Shanika Karunasekera, Rajkumar Buyya

Summary: Serverless computing has gained much attention in recent years as it shifts the burden of resource management to cloud service providers. However, efficiently managing resources while maintaining function performance is challenging due to the dynamic and multi-tenant nature of serverless systems.

FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE (2023)

Article Computer Science, Theory & Methods

Multi-search-routes-based methods for minimizing makespan of homogeneous and heterogeneous resources in Cloud computing

Guangyao Zhou, Wenhong Tian, Rajkumar Buyya

Summary: Cloud computing is a large-scale distributed computing system that dynamically provides elastic services to users. Resource scheduling in Cloud computing, which aims to minimize makespan, is usually NP-Hard. This paper proposes multi-search-routes-based algorithms, integrating LPT and BFD as basic search routes with the OneStep neighborhood search algorithm, to optimize scheduling schemes for homogeneous and heterogeneous resources. Theoretical derivations and extensive experiments demonstrate the superiority of the proposed algorithms in minimizing makespan problems.

FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE (2023)

Article Computer Science, Hardware & Architecture

Adaptive Cloud Bundle Provisioning and Multi-Workflow Scheduling via Coalition Reinforcement Learning

Xiaogang Wang, Jian Cao, Rajkumar Buyya

Summary: This paper proposes an adaptive cloud bundle provisioning and multi-workflow scheduling model that dynamically scales resources on multi-type VM instances for the execution of complex workflows. The performance of the proposed algorithms is demonstrated to be superior to that of existing policies.

IEEE TRANSACTIONS ON COMPUTERS (2023)

Article Computer Science, Information Systems

A Distributed Deep Reinforcement Learning Technique for Application Placement in Edge and Fog Computing Environments

Mohammad Goudarzi, Marimuthu Palaniswami, Rajkumar Buyya

Summary: Fog/Edge computing is a new computing paradigm that supports resource-constrained IoT devices by placing their tasks on edge and/or cloud servers. However, existing centralized Deep Reinforcement Learning (DRL)-based placement techniques lack generalizability and quick adaptability. To address this, we propose a distributed application placement technique based on IMPALA, which significantly improves the execution cost of IoT applications. Our technique utilizes recurrent layers to capture temporal behaviors and a replay buffer to enhance sample efficiency.

IEEE TRANSACTIONS ON MOBILE COMPUTING (2023)

Article Computer Science, Theory & Methods

An Instability-Resilient Renewable Energy Allocation System for a Cloud Datacenter

Haiying Shen, Haoyu Wang, Jiechao Gao, Rajkumar Buyya

Summary: In this paper, a stable and reliable renewable energy allocation system is proposed to address the issues of increasing electricity cost, energy consumption, and harmful gas emissions in datacenters due to the instability of renewable energy supply. Using deep learning technique, the system predicts the probability of producing the desired amount of each renewable energy source and forecasts the energy demands of each physical machine group. By solving an optimization problem and utilizing reinforcement learning method, renewable energy resources with different instabilities are matched with different physical machine groups for supply. The amount of computing resource allocated to each job is adjusted based on job deadline and failure probability in each physical machine group, and a failure prediction based energy saving method is proposed. Real trace driven experiments demonstrate the effectiveness of the proposed methods in reducing SLO violations, total energy monetary cost, and total carbon emission compared to other methods.

IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS (2023)

Article Computer Science, Hardware & Architecture

Mobi-Sense: mobility-aware sensor-fog paradigm for mission-critical applications using network coding and steganography

Anwesha Mukherjee, Shreya Ghosh, Soumya K. Ghosh, Rajkumar Buyya

Summary: This paper proposes a delay-aware and secure service provisioning model for mission-critical applications, using a mobility-aware sensor-fog paradigm based on network coding and steganography. The proposed model outperforms the conventional sensor-cloud framework in terms of delay and power consumption, according to theoretical and simulation results.

JOURNAL OF SUPERCOMPUTING (2023)

Article Computer Science, Hardware & Architecture

A two-tier coordinated load balancing strategy over skewed data streams

Dawei Sun, Minghui Wu, Zhihong Yang, Atul Sajjanhar, Rajkumar Buyya

Summary: In this paper, a coordinated load balancing strategy (St-Stream) is proposed to address the problem of skewed data streams. The strategy performs migration pairing for resources at the task allocation stage, cuts and moves out tasks from high-load nodes in a hierarchical manner, and places the moved-out operators in the routing table. A two-tier coordination scheme is also designed to adjust the skewed load within nodes and dynamically restore balance between nodes. Experimental results show that the proposed strategy improves cluster load balance and enhances the performance of the stream processing system.

JOURNAL OF SUPERCOMPUTING (2023)

Article Computer Science, Hardware & Architecture

E-CropReco: a dew-edge-based multi-parametric crop recommendation framework for internet of agricultural things

Somnath Bera, Tanushree Dey, Anwesha Mukherjee, Rajkumar Buyya

Summary: This paper proposes an IoT framework based on dew computing, edge computing, and federated learning for crop productivity prediction and recommendation. The framework analyzes soil parameters, environmental parameters, and weather data to predict crop productivity and recommend suitable crops. The proposed framework reduces delay and power consumption compared to both the conventional sensor-cloud framework and the edge-cloud framework. Four machine learning algorithms are compared based on their performance, and each obtains over 95% prediction accuracy. An Android application is also proposed for crop recommendation.

JOURNAL OF SUPERCOMPUTING (2023)

Article Computer Science, Information Systems

OpenStackDP: a scalable network security framework for SDN-based OpenStack cloud infrastructure

Prabhakar Krishnan, Kurunandan Jain, Amjad Aldweesh, P. Prabu, Rajkumar Buyya

Summary: This paper introduces a network data plane-based architecture that combines SDN, NFV and ML/AI to improve network management in OpenStack Clouds, ensuring predictability, reliability and security. The framework consists of lightweight monitoring, anomaly-detecting intelligent sensors, ML/AI-based threat analytics engine, and defensive actions deployed as VNFs, enabling high-speed threat detection and rapid response. The simulations and analysis show that this framework substantially secures and outperforms prior OpenStack solutions for Cloud architectures.

JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS (2023)

Review Computer Science, Hardware & Architecture

AI augmented Edge and Fog computing: Trends and challenges

Shreshth Tuli, Fatemeh Mirhakimi, Samodha Pallewatta, Syed Zawad, Giuliano Casale, Bahman Javadi, Feng Yan, Rajkumar Buyya, Nicholas R. Jennings

Summary: In recent years, there has been a shift in computing paradigms towards decentralized systems like IoT, Edge, Fog, Cloud, and Serverless. This shift has been powered by the adoption of AI-driven autonomous systems for managing distributed computing resources. This survey explores the evolution of data-driven AI methods and their impact on computing systems, focusing on resource management and QoS optimization. It also discusses future research directions and the potential of AI-driven computing systems.

JOURNAL OF NETWORK AND COMPUTER APPLICATIONS (2023)

Article Computer Science, Information Systems

Resource Provisioning Using Meta-Heuristic Methods for IoT Microservices With Mobility Management

Shinu M. Rajagopal, M. Supriya, Rajkumar Buyya

Summary: The fog and edge computing paradigm offer a distributed architecture for smart healthcare systems driven by IoT applications, reducing latency and improving system efficiency.

IEEE ACCESS (2023)

暂无数据