Deep-learning trust estimation in multi-agent systems

Cristian Balas; Robert Karlsen; Paul Muench; Dariusz Mikulski; Nizar Al-Holou

doi:10.1117/12.2264152

5 May 2017 Deep-learning trust estimation in multi-agent systems

Cristian Balas, Robert Karlsen, Paul Muench, Dariusz Mikulski, Nizar Al-Holou

Proceedings Volume 10195, Unmanned Systems Technology XIX; 1019510 (2017) https://doi.org/10.1117/12.2264152
Event: SPIE Defense + Security, 2017, Anaheim, CA, United States

Abstract

In this paper we propose a trust algorithm, dubbed NeuroTrust, based on a multi-layered neural network. Previous work introduced trust as a performance estimation algorithm between team members in multi-agent systems, to allow for behavior optimization of the team. The trust model was developed based on an Acceptance Observation History (AOH) and confirmation and tolerance parameters to control trust growth and decay. Further work proposed certain improvements, in an autonomous vehicles convoy scenario, by considering agent diversity and a non-linear relationship between trust and vehicle control. In this work we show a further optimization using a deep recurrent neural network. This multi-layered neural network delivers trust as a probability function estimation with AOH as a sliding window batch input. The neural network is pre-trained using supervised learning, to emulate the previous trust model, as baseline. This pre-trained model is then exposed to future optimization using on-line reinforcement learning. The proposed trust model could be adaptable to a variety of systems, external conditions, and agent diversity. One application example where such a biologically-inspired trust model is suitable would be for soldier-machine teaming. Furthermore, particularly in the autonomous convoy scenario, we can account for the trust-control relationship nonlinearity in the trust domain, thus simplifying the control algorithm.

Citation Download Citation

Cristian Balas, Robert Karlsen, Paul Muench, Dariusz Mikulski, and Nizar Al-Holou "Deep-learning trust estimation in multi-agent systems", Proc. SPIE 10195, Unmanned Systems Technology XIX, 1019510 (5 May 2017); https://doi.org/10.1117/12.2264152

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available