2024 : 2 : 26
maryam Amiri

maryam Amiri

Academic rank: Assistant Professor
ORCID: https://orcid.org/0000-0002-7411-9552
Education: PhD.
ScopusId: 57146848900
Faculty: Engineering
Address:
Phone: 32625522

Research

Title
IDS fitted Q improvement using fuzzy approach for resource provisioning in cloud
Type
JournalPaper
Keywords
Q learning, fuzzy approach, IDS fitted Q, cloud computing, resources provisioning
Year
2017
Journal journal of intelligent and fuzzy systems
DOI
Researchers Leyli Mohammad-Khanli ، Mohammad-Reza Feizi-Derakhshi ، maryam Amiri

Abstract

Reinforcement Learning (RL) is used to find the best policy. A policy is a rule that maps a given state to an appropriate action. The RL is used to learn utility functions for dynamic resource allocation. According to the future demand of resources, the learned policy maps the appropriate resources in a way that wasting energy and resources is stopped and Service Level Agreements (SLA) violation and Quality of Service (QoS) dropping are also avoided. However, The RL encounters a lot of problems in this field such as: having good policies in the early phases of learning and the learning time to converge to the optimal policy. This paper deals with these problems using the appropriate initialization of Q learning and a new fuzzy approach to increase the convergence speed to the optimal policy. The fuzzy approach presented in this paper improves the accuracy and speed of convergence of Q learning. Firstly, the proposed method predicts the future workload, then determines the appropriate number of physical machines by using the optimal policy learned by improved Q learning. The evaluation results show the advantages of accuracy and convergence speed of the proposed method in comparison with the similar methods.