图 书 馆
基于影响弱耦合策略的DEC-POMDPs抽象Influence-based Policy Abstraction for Weakly-coupled DEC-POMDPs |
|
| 课程网址: | http://videolectures.net/icaps2010_witwicki_ibpa/ |
| 主讲教师: | Stefan Witwicki |
| 开课单位: | 密西根大学 |
| 开课时间: | 2010-11-15 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | Decentralized POMDPs are powerful theoretical models for coordinating agents’ decisions in uncertain environments, but the generally-intractable complexity of optimal joint policy construction presents a significant obstacle in applying Dec-POMDPs to problems where many agents face many policy choices. Here, we argue that when most agent choices are independent of other agents’ choices, much of this complexity can be avoided: instead of coordinating full policies, agents need only coordinate policy abstractions that explicitly convey the essential interaction influences. To this end, we develop a novel framework for influence-based policy abstraction for weakly-coupled transition-dependent Dec-POMDP problems that subsumes several existing approaches. In addition to formally characterizing the space of transition-dependent influences, we provide a method for computing optimal and approximately-optimal joint policies. We present an initial empirical analysis, over problems with commonly-studied flavors of transition-dependent influences, that demonstrates the potential computational benefits of influence-based abstraction over state-of-the-art optimal policy search methods. |
| 关 键 词: | 政策协调; 联合策略; 实证分析; 优化策略搜索方法 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2020-09-28：heyf |
| 阅读次数: | 41 |