Situ-Centric Reinforcement Learning for Recommendation of Tasks in Activities of Daily Living In Smart Homes

Thumbnail Image
Oyeleke, Richard O.
Yu, Chen-Yeou
Major Professor
Committee Member
Journal Title
Journal ISSN
Volume Title
©2018 IEEE
Chang, Carl
Professor Emeritus
Research Projects
Organizational Units
Organizational Unit
Computer Science

Computer Science—the theory, representation, processing, communication and use of information—is fundamentally transforming every aspect of human endeavor. The Department of Computer Science at Iowa State University advances computational and information sciences through; 1. educational and research programs within and beyond the university; 2. active engagement to help define national and international research, and 3. educational agendas, and sustained commitment to graduating leaders for academia, industry and government.

The Computer Science Department was officially established in 1969, with Robert Stewart serving as the founding Department Chair. Faculty were composed of joint appointments with Mathematics, Statistics, and Electrical Engineering. In 1969, the building which now houses the Computer Science department, then simply called the Computer Science building, was completed. Later it was named Atanasoff Hall. Throughout the 1980s to present, the department expanded and developed its teaching and research agendas to cover many areas of computing.

Dates of Existence

Related Units

Journal Issue
Is Version Of
In this paper, we propose a new recommendation system that considers the changing human mental state, behavior and environmental contexts to provide guidance to persons diagnosed of mild cognitive impairment (MCI) or Alzheimer’s in performing their activities of daily living (ADLs). The recommendation system is based on the Situframework that represents an activity as a sequence of situations, and a situation is a 3-tuple where M denotes human mental state, B is the behavior context and E is the environmental context. More so, it uses an automaton to model an activity thereby generating corresponding task sequences. Interactions between the inhabitants and the sensor networks and the activity being performed are represented as an information space. It then uses a modified model learning algorithm as its decision making tool to recommend appropriate actions or tasks sequence to the inhabitant in a situation of uncertainty caused by episode of confusion or memory loss to ensure he reaches his goal. Consequently, this helps ensure that safety of the person is not compromised when he makes a poor decision regarding the sequence in which ADL tasks are to be performed. We use a single activity class dataset generated from a smart home for 50 independent learning experiments for three (3) ADLs case studies. The accuracy of the sequential-tasks recommendations was found to be high. We further evaluated the risk sensitivity of the recommendation system using the action selection probabilities and corresponding reward points associated with performing a task. The results show that the proposed recommendation system is risk averse.
This is a manuscript of a proceeding published as R. O. Oyeleke, C. -Y. Yu and C. K. Chang, "Situ-Centric Reinforcement Learning for Recommendation of Tasks in Activities of Daily Living In Smart Homes," 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC), 2018, pp. 317-322, doi: 10.1109/COMPSAC.2018.10250. Posted with permission.

© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.