A journal of IEEE and CAA , publishes high-quality papers in English on original theoretical/experimental research and development in all areas of automation
Volume 4 Issue 4
Oct.  2017

IEEE/CAA Journal of Automatica Sinica

  • JCR Impact Factor: 6.171, Top 11% (SCI Q1)
    CiteScore: 11.2, Top 5% (Q1)
    Google Scholar h5-index: 51, TOP 8
Turn off MathJax
Article Contents
Ali Safavi and Mehrdad H. Zadeh, "Teaching the User By Learning From the User: Personalizing Movement Control in Physical Human-robot Interaction," IEEE/CAA J. Autom. Sinica, vol. 4, no. 4, pp. 704-713, Oct. 2017. doi: 10.1109/JAS.2017.7510634
Citation: Ali Safavi and Mehrdad H. Zadeh, "Teaching the User By Learning From the User: Personalizing Movement Control in Physical Human-robot Interaction," IEEE/CAA J. Autom. Sinica, vol. 4, no. 4, pp. 704-713, Oct. 2017. doi: 10.1109/JAS.2017.7510634

Teaching the User By Learning From the User:Personalizing Movement Control in Physical Human-robot Interaction

doi: 10.1109/JAS.2017.7510634
Funds:  This work is supported in part by the McLaren Foundation, USA
More Information
  • This paper proposes a novel approach for physical human-robot interactions (pHRI), where a robot provides guidance forces to a user based on the user performance. This framework tunes the forces in regards to behavior of each user in coping with different tasks, where lower performance results in higher intervention from the robot. This personalized physical human-robot interaction (p2HRI) method incorporates adaptive modeling of the interaction between the human and the robot as well as learning from demonstration (LfD) techniques to adapt to the users' performance. This approach is based on model predictive control where the system optimizes the rendered forces by predicting the performance of the user. Moreover, continuous learning of the user behavior is added so that the models and personalized considerations are updated based on the change of user performance over time. Applying this framework to a field such as haptic guidance for skill improvement, allows a more personalized learning experience where the interaction between the robot as the intelligent tutor and the student as the user, is better adjusted based on the skill level of the individual and their gradual improvement. The results suggest that the precision of the model of the interaction is improved using this proposed method, and the addition of the considered personalized factors to a more adaptive strategy for rendering of guidance forces.


  • loading
  • [1]
    A. De Santis, B. Siciliano, A. De Luca, and A. Bicchi, "An atlas of physical human-robot interaction, " Mech. Mach. Theory, vol. 43, no. 3, pp. 253-270, Mar. 2008. http://www.sciencedirect.com/science/article/pii/S0094114X07000547
    O. Khatib, K. Yokoi, O. Brock, K. Chang, and A. Casal, "Robots in human environments: basic autonomous capabilities, " Int. J. Robot. Res. , vol. 18, no. 7, pp. 684-696, Jul. 1999. http://ci.nii.ac.jp/naid/30006463318
    D. Feygin, M. Keehner, and R. Tendick, "Haptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill, " in Proc. 10th Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, Orlando, FL, USA, 2002, pp. 40-47. http://dl.acm.org/citation.cfm?id=797513
    J. Liu, S. C. Cramer, and D. J. Reinkensmeyer, "Learning to perform a new movement with robotic assistance: comparison of haptic guidance and visual demonstration, " J. Neuroeng. Rehabil. , vol. 3, p. 20, Aug. 2006. http://europepmc.org/abstract/MED/16945148
    S. A. Bowyer, B. L. Davies, and F. R. Baena, "Active constraints/virtual fixtures: a survey, " IEEE Trans. Robot. , vol. 30, no. 1, pp. 138-157, Feb. 2014. http://ieeexplore.ieee.org/document/6634270/
    J. J. Abbott, P. Marayong, and A. M. Okamura, "Haptic virtual fixtures for robot-assisted manipulation, " in Robotics Research, S, Thrun, R. Brooks, and H. Durrant-Whyte, Eds. Berlin Heidelberg, Germany: Springer, 2007, pp. 49-64. doi: 10.1007/978-3-540-48113-3_5.pdf
    S. Fisackerly and M. H. Zadeh, "Haptic-enabled virtual handwriting: multimodal handwriting instructions for young students, " in Proc. 2010 IEEE Int. Symp. Haptic Audio-Visual Environments and Games (HAVE), Phoenix, AZ, USA, 2010, pp. 1-6. http://ieeexplore.ieee.org/document/5623963/
    A. Bettini, P. Marayong, S. Lang, A. M. Okamura, and G. D. Hager, "Vision-assisted control for manipulation using virtual fixtures, " IEEE Trans. Robot. , vol. 20, no. 6, pp. 953-966, Dec. 2004. http://dl.acm.org/citation.cfm?id=2211701
    L. Peternel, T. Noda, T. Petrič, A. Ude, J. Morimoto, and J. Babič, "Adaptive control of exoskeleton robots for periodic assistive behaviours based on EMG feedback minimisation, " PLoS One, vol. 11, no. 2, p. e0148942, Feb. 2016. http://pubmedcentralcanada.ca/pmcc/articles/PMC4755662/
    D. Lee and C. Ott, "Incremental kinesthetic teaching of motion primitives using the motion refinement tube, " Auton. Robots, vol. 31, no. 2-3, pp. 115-131, Oct. 2011. http://dl.acm.org/citation.cfm?id=2036633
    M. K. Lee, J. Forlizzi, S. Kiesler, P. Rybski, J. Antanitis, and S. Savetsila, "Personalization in HRI: a longitudinal field experiment, " in Proc. 7th ACM/IEEE Int. Conf. Human-Robot Interaction (HRI), Boston, MA, USA, 2012, pp. 319-326. http://ieeexplore.ieee.org/document/6249574/
    C. M. Hong, C. M. Chen, M. H. Chang, and S. C. Chen, "Intelligent web-based tutoring system with personalized learning path guidance, " in Proc. 7th IEEE Int. Conf. Advanced Learning Technologies, Niigata, Japan, 2007, pp. 512-516. http://ieeexplore.ieee.org/document/4281081/
    J. M. Liu, C. K. Wong, and K. K. Hui, "An adaptive user interface based on personalized learning, " IEEE Intell. Syst. , vol. 18, no. 2, pp. 52-57, Mar. -Apr. 2003.
    A. Gams, T. Petrič, M. Do, B. Nemec, J. Morimoto, T. Asfour, and A. Ude, "Adaptation and coaching of periodic motion primitives through physical and visual interaction, " Robot. Auton. Syst. , vol. 75, pp. 340-351, Jan. 2016. http://dl.acm.org/citation.cfm?id=2873502
    T. W. Bickmore and R. W. Picard, "Establishing and maintaining long-term human-computer relationships, " ACM Trans. Computer-Human, vol. 12, no. 2, pp. 293-327, Jun. 2005.
    J. Fasola and M. J. MatariĆ, "Using socially assistive human-robot interaction to motivate physical exercise for older adults, " Proc. IEEE, vol. 100, no. 8, pp. 2512-2526, Aug. 2012. http://www.sciencedirect.com/science/article/pii/B9780128008812000220
    S. M. Rabbitt, A. E. Kazdin, and B. Scassellati, "Integrating socially assistive robotics into mental healthcare interventions: applications and recommendations for expanded use, " Clin. Psychol. Rev. , vol. 35, pp. 35-46, Feb. 2015. http://www.sciencedirect.com/science/article/pii/S0272735814000993
    A. Safavi and M. Zadeh, "Model-based haptic guidance in surgical skill improvement, " in Proc. 2015 IEEE Int. Conf. Systems, Man, and Cybernetics (SMC), Kowloon, Hong Kong, China, 2015, pp. 1104-1109.
    A. Safavi, L. Huynh, H. Rahmat-Khah, E. Zahedi, and M. H. Zadeh, "A novel MPC approach to optimize force feedback for human-robot shared control, " in Proc. 2015 IEEE/RSJ Int. Conf. Intelligent Robots and Systems (IROS), Hamburg, Germany, 2015, pp. 3018-3023. http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7353793
    M. Power, H. Rafii-Tari, C. Bergeles, V. Vitiello, and G. Z. Yang, "A cooperative control framework for haptic guidance of bimanual surgical tasks based on learning from demonstration, " in Proc. 2015 IEEE Int. Conf. Robotics and Automation (ICRA), Seattle, WA, USA, 2015, pp. 5330-5337. http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=7139943
    B. D. Argall, S. Chernova, M. Veloso, and B. Browning, "A survey of robot learning from demonstration, " Robot. Auton. Syst., vol.57, no.5, pp.469-483, May 2009. doi: 10.1016/j.robot.2008.10.024
    M. H. Zadeh and K. Khorasani, "Control strategies for a haptic device interfacing with virtual environment, " in Proc. IEEE Conf. Robotics, Automation and Mechatronics, Singapore, vol. 1, pp. 181-185, 2004. http://ieeexplore.ieee.org/xpls/icp.jsp?arnumber=1438913
    J. R. Medina, M. Lawitzky, A. Mörtl, D. Lee, and S. Hirche, "An experience-driven robotic assistant acquiring human knowledge to improve haptic cooperation, " in Proc. 2011 IEEE/RSJ Int. Conf. Intelligent Robots and Systems (IROS), San Francisco, CA, USA, 2011, pp. 2416-2422. http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6095026
    R. Chipalkatty, H. Daepp, M. Egerstedt, and W. Book, "Human-in-the-loop: MPC for shared control of a quadruped rescue robot, " in Proc. 2011 IEEE/RSJ Int. Conf. Intelligent Robots and Systems (IROS), San Francisco, CA, USA, 2011, pp. 4556-4561. http://ieeexplore.ieee.org/xpls/icp.jsp?arnumber=6094601
    F. Tatti, N. Gurari, and G. Baud-Bovy, "Static force rendering performance of two commercial haptic systems, " in Proc. 9th Int. Conf. EuroHaptics 2014: Haptics: Neuroscience, Devices, Modeling, and Applications, Berlin, Heidelberg, Germany, 2014, pp. 342-350. http://ci.nii.ac.jp/ncid/BB17916302
    A. Jarillo Silva, O. A. Domínguez Ramrez, V. Parra Vega, and J. P. Ordaz Oliver, "PHANToM OMNI haptic device: kinematic and manipulability, " in Proc. CERMA 2009 Electronics, Robotics and Automotive Mechanics Conference, Cuernavaca, Morelos, Mexico, 2009, pp. 193-198. http://ieeexplore.ieee.org/document/5341989/
    D. E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning. Reading, Mass., USA:Addison-Wesley, 1989.
    Y. Wang and S. Boyd, "Fast model predictive control using online optimization, " IEEE Trans. Control Syst. Technol. , vol. 18, no. 2, pp. 267-278, Mar. 2010. http://ieeexplore.ieee.org/document/5153127/
    I. Oropesa, P. Sánchez-González, P. Lamata, M. K. Chmarra, J. B. Pagador, J. A. Sánchez-Margallo, F. M. Sánchez-Margallo, and E. J. Gómez, "Methods and tools for objective assessment of psychomotor skills in laparoscopic surgery, " J. Surg. Res. , vol. 171, no. 1, pp. e81-e95, Nov. 2011. http://www.ncbi.nlm.nih.gov/pubmed/21924741
    J. Yang, Y. S. Xu, and C. S. Chen, "Hidden Markov model approach to skill learning and its application to telerobotics, " IEEE Trans. Robot. Autom. , vol. 10, no. 5, pp. 621-31, Oct. 1994. http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=326567
    A. Gersho and R. M. Gray, Vector Quantization and Signal Compression. Boston, USA:Kluwer Academic Press, 1992.
    D. A. Reynolds and R. C. Rose, "Robust text-independent speaker identification using gaussian mixture speaker models, " IEEE Trans. Speech Audio Proc. , vol. 3, no. 1, pp. 72-83, Jan. 1995. http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=365379
    J. Rosen, J. D. Brown, L. Chang, M. N. Sinanan, and B. Hannaford, "Generalized approach for modeling minimally invasive surgery as a stochastic process using a discrete Markov model, " IEEE Trans. Biomed. Eng. , vol. 53, no. 3, pp. 399-413, Mar. 2006. http://ieeexplore.ieee.org/document/1597490/
    T. M. Kowalewski, "Real-time quantitative assessment of surgical skill, " Ph. D. dissertation, University of Washington, Washington, USA, 2012.
    L. E. Baum, T. Petrie, G. Soules, and N. Weiss, "A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains, " Ann. Math. Statist. , vol. 41, no. 1, pp. 164-171, Feb. 1970.
    F. H. Halvorsen, "Virtual reality simulation in laparoscopic surgical education, " Ph. D. dissertation, Department of Cardiothoracic Surgery, Oslo University Hospital, University of Oslo, Oslo, Norway, 2014.
    A. M. Derossis, G. M. Fried, M. Abrahamowicz, H. H. Sigman, J. S. Barkun, and J. L. Meakins, "Development of a model for training and evaluation of laparoscopic skills, " Amer. J. Surg. , vol. 175, no. 6, pp. 482-487, Jun. 1998. http://www.sciencedirect.com/science/article/pii/S0002961098000804
    K. Levenberg, "A method for the solution of certain non-linear problems in least squares, " Quart. Appl. Math. , vol. 2, pp. 164-168, Jan. 1944.


    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(10)  / Tables(2)

    Article Metrics

    Article views (1143) PDF downloads(103) Cited by()


    DownLoad:  Full-Size Img  PowerPoint