4.6 Article

A Multi-Objective Approach for Optimal Energy Management in Smart Home Using the Reinforcement Learning

Journal

SENSORS
Volume 20, Issue 12, Pages -

Publisher

MDPI
DOI: 10.3390/s20123450

Keywords

reinforcement learning; home energy management; appliance scheduling; human-appliance interaction; user comfort

Funding

  1. National Research Foundation of Korea(NRF) - Korea government(MSIT) [2019R1F1A1042721]
  2. BK21 Plus project (SW Human Resource Development Program for Supporting Smart Life) - Ministry of Education, School of Computer Science and Engineering, Kyungpook National University, Korea [21A20131600005]
  3. National Research Foundation of Korea [2019R1F1A1042721] Funding Source: Korea Institute of Science & Technology Information (KISTI), National Science & Technology Information Service (NTIS)

Ask authors/readers for more resources

Maintaining a fair use of energy consumption in smart homes with many household appliances requires sophisticated algorithms working together in real time. Similarly, choosing a proper schedule for appliances operation can be used to reduce inappropriate energy consumption. However, scheduling appliances always depend on the behavior of a smart home user. Thus, modeling human interaction with appliances is needed to design an efficient scheduling algorithm with real-time support. In this regard, we propose a scheduling algorithm based on human appliances interaction in smart homes using reinforcement learning (RL). The proposed scheduling algorithm divides the entire day into various states. In each state, the agents attached to household appliances perform various actions to obtain the highest reward. To adjust the discomfort which arises due to performing inappropriate action, the household appliances are categorized into three groups i.e., (1) adoptable, (2) un-adoptable, (3) manageable. Finally, the proposed system is tested for the energy consumption and discomfort level of the home user against our previous scheduling algorithm based on least slack time phenomenon. The proposed scheme outperforms the Least Slack Time (LST) based scheduling in context of energy consumption and discomfort level of the home user.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Theory & Methods

Integration of Big Data analytics embedded smart city architecture with RESTful web of things for efficient service provision and energy management

Bhagya Nathali Silva, Murad Khan, Kijun Han

FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE (2020)

Article Telecommunications

Cost- and comfort-aware aggregated modified least slack time-based domestic power scheduling for residential communities

Bhagya Nathan Silva, Kyuchang Lee, Yongtak Yoon, Jihun Han, ZhenBo Cao, Kijun Han

Summary: The emergence of smart grid has revolutionized energy consumption patterns and conservation strategies. Household appliance scheduling has gained popularity due to its consideration of sustainable energy and user behaviors. In this study, we propose a least slack time (LST)-based scheduling algorithm with consumption thresholds to minimize electricity cost and maximize user comfort and sustainable energy usage.

TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES (2022)

Article Telecommunications

Intelligent Internet of Things gateway supporting heterogeneous energy data management and processing

Muhammad Diyan, Bhagya Nathali Silva, Jihun Han, ZhenBo Cao, Kijun Han

Summary: The increasing demand for electrical energy, smart grid, and renewable energy has created opportunities for Electrical Energy Data Management and Processing Systems (EEDMS). However, implementing and maintaining EEDMS is a challenging task, and the heterogeneous energy data generated from residential and commercial sectors pose challenges for standard IoT architecture. In order to overcome these challenges, a scalable multitasking IoT gateway (IoTGW) is proposed, along with a Data Loading and Storing Module (DLSM) that enables a high dynamic distributed framework.

TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES (2022)

Article Chemistry, Multidisciplinary

Deep Learning Entrusted to Fog Nodes (DLEFN) Based Smart Agriculture

Kyuchang Lee, Bhagya Nathali Silva, Kijun Han

APPLIED SCIENCES-BASEL (2020)

Article Chemistry, Multidisciplinary

Development of Computer-Aided Semi-Automatic Diagnosis System for Chronic Post-Stroke Aphasia Classification with Temporal and Parietal Lesions: A Pilot Study

Bhagya Nathali Silva, Murad Khan, Ruchire Eranga Wijesinghe, Samantha Thelijjagoda, Kijun Han

APPLIED SCIENCES-BASEL (2020)

Article Chemistry, Analytical

Scheduling Sensor Duty Cycling Based on Event Detection Using Bi-Directional Long Short-Term Memory and Reinforcement Learning

Muhammad Diyan, Murad Khan, Nathali Bhagya Silva, Kijun Han

SENSORS (2020)

Article Chemistry, Multidisciplinary

Intersection Routing Based on Fuzzy Multi-Factor Decision for VANETs

Zhenbo Cao, Bhagya Nathali Silva, Muhammad Diyan, Jilong Li, Kijun Han

APPLIED SCIENCES-BASEL (2020)

Article Computer Science, Information Systems

Mitigating Broadcasting Storm Using Multihead Nomination Clustering in Vehicular Content Centric Networks

Ayesha Siddiqa, Muhammad Diyan, Muhammad Toaha Raza Khan, Malik Muhammad Saad, Dongkyun Kim

Summary: The paper proposes a vehicular-content-centric network scheme that uses in-network caching to satisfy content requests. A multihead nomination clustering scheme is introduced to address communication issues, resulting in improved communication rate and cache success ratio.

ELECTRONICS (2021)

Article Engineering, Electrical & Electronic

Minimizing the Effect of Specular Reflection on Object Detection and Pose Estimation of Bin Picking Systems Using Deep Learning

Daksith Jayasinghe, Chandima Abeysinghe, Ramitha Opanayaka, Randima Dinalankara, Bhagya Nathali Silva, Ruchire Eranga Wijesinghe, Udaya Wijenayake

Summary: The rapid evolution of industrial automation has increased the usage of industrial applications like robot arm manipulation and bin picking. However, the accuracy of object detection and pose estimation in these applications is affected by specular reflections in visual data. This work aims to improve the performance of industrial bin-picking tasks by intelligently removing specular reflections using a deep learning-based neural network model called SpecToPoseNet. The proposed method achieves a significant reduction in the fail rate of object detection compared to other models, making it a positive influence in industrial contexts.

MACHINES (2023)

Proceedings Paper Computer Science, Information Systems

Intelligent Home Energy Management System based on Bi-directional Long-short Term Memory and Reinforcement Learning

Muhammd Diyan, Murad Khan, Cao Zhenbo, Bhagya Nathali Silva, Jihun Han, Ki Jun Han

Summary: This article proposes an intelligent home energy management system (IHEMS) with a prediction model based on Bi-directional long short Term memory (Bi-LSTM) and an optimization model based on reinforcement learning to address the uncertainty of future energy load and its cost.

35TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2021) (2021)

Proceedings Paper Computer Science, Hardware & Architecture

Vehicular Adhoc Networks Protocol to Avoid Traffic Signal Delay

Muhammad Diyan, Bhagya Nathali Silva, Jihun Han, Kyuchang Lee, Cao Zhenbo, Kijun Han

2020 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE WORKSHOPS (WCNCW) (2020)

No Data Available