Scenarios
We apply the extended Social MDP framework to a multi-agent gridworld which consists of two agents (a yellow robot and red robot), two physical landmarks (a construction site and a tree) and three objects (an axe, wooden log, and a water bucket). Physical goals consist of moving the desired objects to one of the landmarks. Agents can have no social goal or one of the five social goals: cooperation, conflict, competition, coercion, or exchange leading to 2x6x6 = 72 scenarios.
| Scenario # | Yellow Robot | Red Robot | ||
|---|---|---|---|---|
| Physical Goal | Social Goal | Social Goal | Physical Goal | |
| Scenario 1 | Tree | None | Cooperate | Construction Site |
| Scenario 2 | Construction Site | None | Conflict | Tree |
| Scenario 3 | Tree | None | Competiton | Construction Site |
| Scenario 4 | Tree | None | Coercion | Construction Site |
| Scenario 5 | Construction Site | None | Exchange | Tree |
| Scenario 6 | Tree | None | None | Construction Site |
| Scenario 7 | Tree | Cooperate | Cooperate | Construction Site |
| Scenario 8 | Construction Site | Cooperate | Conflict | Tree |
| Scenario 9 | Tree | Cooperate | Competiton | Construction Site |
| Scenario 10 | Tree | Cooperate | Coercion | Construction Site |
| Scenario 11 | Construction Site | Cooperate | Exchange | Tree |
| Scenario 12 | Tree | Cooperate | None | Construction Site |
| Scenario 13 | Construction Site | Conflict | Cooperate | Tree |
| Scenario 14 | Construction Site | Conflict | Conflict | Tree |
| Scenario 15 | Tree | Conflict | Competiton | Construction Site |
| Scenario 16 | Construction Site | Conflict | Coercion | Tree |
| Scenario 17 | Tree | Conflict | Exchange | Construction Site |
| Scenario 18 | Construction Site | Conflict | None | Tree |
| Scenario 19 | Tree | Competiton | Cooperate | Construction Site |
| Scenario 20 | Construction Site | Competiton | Conflict | Tree |
| Scenario 21 | Tree | Competiton | Competiton | Construction Site |
| Scenario 22 | Construction Site | Competiton | Coercion | Tree |
| Scenario 23 | Construction Site | Competiton | Exchange | Tree |
| Scenario 24 | Tree | Competiton | None | Construction Site |
| Scenario 25 | Construction Site | Coercion | Cooperate | Tree |
| Scenario 26 | Tree | Coercion | Conflict | Construction Site |
| Scenario 27 | Tree | Coercion | Competiton | Construction Site |
| Scenario 28 | Tree | Coercion | Coercion | Construction Site |
| Scenario 29 | Construction Site | Coercion | Exchange | Tree |
| Scenario 30 | Tree | Coercion | None | Construction Site |
| Scenario 31 | Construction Site | Exchange | Cooperate | Tree |
| Scenario 32 | Construction Site | Exchange | Conflict | Tree |
| Scenario 33 | Construction Site | Exchange | Competiton | Tree |
| Scenario 34 | Construction Site | Exchange | Coercion | Tree |
| Scenario 35 | Tree | Exchange | Exchange | Construction Site |
| Scenario 36 | Construction Site | Exchange | None | Tree |
| Scenario 37 | Construction Site | None | Cooperate | Construction Site |
| Scenario 38 | Tree | None | Conflict | Tree |
| Scenario 39 | Tree | None | Competiton | Tree |
| Scenario 40 | Tree | None | Coercion | Tree |
| Scenario 41 | Construction Site | None | Exchange | Construction Site |
| Scenario 42 | Construction Site | None | None | Construction Site |
| Scenario 43 | Construction Site | Cooperate | Cooperate | Construction Site |
| Scenario 44 | Construction Site | Cooperate | Conflict | Construction Site |
| Scenario 45 | Tree | Cooperate | Competiton | Tree |
| Scenario 46 | Construction Site | Cooperate | Coercion | Construction Site |
| Scenario 47 | Construction Site | Cooperate | Exchange | Construction Site |
| Scenario 48 | Construction Site | Cooperate | None | Construction Site |
| Scenario 49 | Construction Site | Conflict | Cooperate | Construction Site |
| Scenario 50 | Construction Site | Conflict | Conflict | Construction Site |
| Scenario 51 | Tree | Conflict | Competiton | Tree |
| Scenario 52 | Tree | Conflict | Coercion | Tree |
| Scenario 53 | Tree | Conflict | Exchange | Tree |
| Scenario 54 | Tree | Conflict | None | Tree |
| Scenario 55 | Construction Site | Competiton | Cooperate | Construction Site |
| Scenario 56 | Construction Site | Competiton | Conflict | Construction Site |
| Scenario 57 | Tree | Competiton | Competiton | Tree |
| Scenario 58 | Tree | Competiton | Coercion | Tree |
| Scenario 59 | Tree | Competiton | Exchange | Tree |
| Scenario 60 | Tree | Competiton | None | Tree |
| Scenario 61 | Construction Site | Coercion | Cooperate | Construction Site |
| Scenario 62 | Tree | Coercion | Conflict | Tree |
| Scenario 63 | Tree | Coercion | Competiton | Tree |
| Scenario 64 | Tree | Coercion | Coercion | Tree |
| Scenario 65 | Construction Site | Coercion | Exchange | Construction Site |
| Scenario 66 | Tree | Coercion | None | Tree |
| Scenario 67 | Construction Site | Exchange | Cooperate | Construction Site |
| Scenario 68 | Tree | Exchange | Conflict | Tree |
| Scenario 69 | Tree | Exchange | Competiton | Tree |
| Scenario 70 | Tree | Exchange | Coercion | Tree |
| Scenario 71 | Construction Site | Exchange | Exchange | Construction Site |
| Scenario 72 | Construction Site | Exchange | None | Construction Site |
Scenario 1
Red robot's goals Social:Cooperate; Physical:Construction Site
Yellow robot's goals Social:None; Physical:Tree
| Level 1 | Level 2 |
|
|
Scenario 2
Red robot's goals Social:Conflict; Physical:Tree
Yellow robot's goals Social:None; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 3
Red robot's goals Social:Competition; Physical:Construction Site
Yellow robot's goals Social:None; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 4
Red robot's goals Social:Coercion; Physical:Construction Site
Yellow robot's goals Social:None; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 5
Red robot's goals Social:Exchange; Physical:Tree
Yellow robot's goals Social:None; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 6
Red robot's goals Social:None; Physical:Construction Site
Yellow robot's goals Social:None; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 7
Red robot's goals Social:Cooperate; Physical:Construction Site
Yellow robot's goals Social:Cooperate; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 8
Red robot's goals Social:Conflict; Physical:Tree
Yellow robot's goals Social:Cooperate; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 9
Red robot's goals Social:Competition; Physical:Construction Site
Yellow robot's goals Social:Cooperate; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 10
Red robot's goals Social:Coercion; Physical:Construction Site
Yellow robot's goals Social:Cooperate; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 11
Red robot's goals Social:Exchange; Physical:Tree
Yellow robot's goals Social:Cooperate; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 12
Red robot's goals Social:None; Physical:Construction Site
Yellow robot's goals Social:Cooperate; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 13
Red robot's goals Social:Cooperate; Physical:Tree
Yellow robot's goals Social:Conflict; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 14
Red robot's goals Social:Conflict; Physical:Tree
Yellow robot's goals Social:Conflict; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 15
Red robot's goals Social:Competition; Physical:Construction Site
Yellow robot's goals Social:Conflict; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 16
Red robot's goals Social:Coercion; Physical:Tree
Yellow robot's goals Social:Conflict; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 17
Red robot's goals Social:Exchange; Physical:Construction Site
Yellow robot's goals Social:Conflict; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 18
Red robot's goals Social:None; Physical:Tree
Yellow robot's goals Social:Conflict; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 19
Red robot's goals Social:Cooperate; Physical:Construction Site
Yellow robot's goals Social:Competition; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 20
Red robot's goals Social:Conflict; Physical:Tree
Yellow robot's goals Social:Competition; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 21
Red robot's goals Social:Competition; Physical:Construction Site
Yellow robot's goals Social:Competition; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 22
Red robot's goals Social:Coercion; Physical:Tree
Yellow robot's goals Social:Competition; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 23
Red robot's goals Social:Exchange; Physical:Tree
Yellow robot's goals Social:Competition; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 24
Red robot's goals Social:None; Physical:Construction Site
Yellow robot's goals Social:Competition; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 25
Red robot's goals Social:Cooperate; Physical:Tree
Yellow robot's goals Social:Coercion; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 26
Red robot's goals Social:Conflict; Physical:Construction Site
Yellow robot's goals Social:Coercion; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 27
Red robot's goals Social:Competition; Physical:Construction Site
Yellow robot's goals Social:Coercion; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 28
Red robot's goals Social:Coercion; Physical:Construction Site
Yellow robot's goals Social:Coercion; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 29
Red robot's goals Social:Exchange; Physical:Tree
Yellow robot's goals Social:Coercion; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 30
Red robot's goals Social:None; Physical:Construction Site
Yellow robot's goals Social:Coercion; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 31
Red robot's goals Social:Cooperate; Physical:Tree
Yellow robot's goals Social:Exchange; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 32
Red robot's goals Social:Conflict; Physical:Tree
Yellow robot's goals Social:Exchange; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 33
Red robot's goals Social:Competition; Physical:Tree
Yellow robot's goals Social:Exchange; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 34
Red robot's goals Social:Coercion; Physical:Tree
Yellow robot's goals Social:Exchange; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 35
Red robot's goals Social:Exchange; Physical:Construction Site
Yellow robot's goals Social:Exchange; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 36
Red robot's goals Social:None; Physical:Tree
Yellow robot's goals Social:Exchange; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 37
Red robot's goals Social:Cooperate; Physical:Construction Site
Yellow robot's goals Social:None; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 38
Red robot's goals Social:Conflict; Physical:Tree
Yellow robot's goals Social:None; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 39
Red robot's goals Social:Competition; Physical:Tree
Yellow robot's goals Social:None; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 40
Red robot's goals Social:Coercion; Physical:Tree
Yellow robot's goals Social:None; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 41
Red robot's goals Social:Exchange; Physical:Construction Site
Yellow robot's goals Social:None; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 42
Red robot's goals Social:None; Physical:Construction Site
Yellow robot's goals Social:None; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 43
Red robot's goals Social:Cooperate; Physical:Construction Site
Yellow robot's goals Social:Cooperate; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 44
Red robot's goals Social:Conflict; Physical:Construction Site
Yellow robot's goals Social:Cooperate; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 45
Red robot's goals Social:Competition; Physical:Tree
Yellow robot's goals Social:Cooperate; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 46
Red robot's goals Social:Coercion; Physical:Construction Site
Yellow robot's goals Social:Cooperate; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 47
Red robot's goals Social:Exchange; Physical:Construction Site
Yellow robot's goals Social:Cooperate; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 48
Red robot's goals Social:None; Physical:Construction Site
Yellow robot's goals Social:Cooperate; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 49
Red robot's goals Social:Cooperate; Physical:Construction Site
Yellow robot's goals Social:Conflict; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 50
Red robot's goals Social:Conflict; Physical:Construction Site
Yellow robot's goals Social:Conflict; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 51
Red robot's goals Social:Competition; Physical:Tree
Yellow robot's goals Social:Conflict; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 52
Red robot's goals Social:Coercion; Physical:Tree
Yellow robot's goals Social:Conflict; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 53
Red robot's goals Social:Exchange; Physical:Tree
Yellow robot's goals Social:Conflict; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 54
Red robot's goals Social:None; Physical:Tree
Yellow robot's goals Social:Conflict; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 55
Red robot's goals Social:Cooperate; Physical:Construction Site
Yellow robot's goals Social:Competition; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 56
Red robot's goals Social:Conflict; Physical:Construction Site
Yellow robot's goals Social:Competition; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 57
Red robot's goals Social:Competition; Physical:Tree
Yellow robot's goals Social:Competition; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 58
Red robot's goals Social:Coercion; Physical:Tree
Yellow robot's goals Social:Competition; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 59
Red robot's goals Social:Exchange; Physical:Tree
Yellow robot's goals Social:Competition; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 60
Red robot's goals Social:None; Physical:Tree
Yellow robot's goals Social:Competition; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 61
Red robot's goals Social:Cooperate; Physical:Construction Site
Yellow robot's goals Social:Coercion; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 62
Red robot's goals Social:Conflict; Physical:Tree
Yellow robot's goals Social:Coercion; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 63
Red robot's goals Social:Competition; Physical:Tree
Yellow robot's goals Social:Coercion; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 64
Red robot's goals Social:Coercion; Physical:Tree
Yellow robot's goals Social:Coercion; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 65
Red robot's goals Social:Exchange; Physical:Construction Site
Yellow robot's goals Social:Coercion; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 66
Red robot's goals Social:None; Physical:Tree
Yellow robot's goals Social:Coercion; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 67
Red robot's goals Social:Cooperate; Physical:Construction Site
Yellow robot's goals Social:Exchange; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 68
Red robot's goals Social:Conflict; Physical:Tree
Yellow robot's goals Social:Exchange; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 69
Red robot's goals Social:Competition; Physical:Tree
Yellow robot's goals Social:Exchange; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 70
Red robot's goals Social:Coercion; Physical:Tree
Yellow robot's goals Social:Exchange; Physical:Tree
| Level 1 | Level 2 |
|
|
|
Scenario 71
Red robot's goals Social:Exchange; Physical:Construction Site
Yellow robot's goals Social:Exchange; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|
Scenario 72
Red robot's goals Social:None; Physical:Construction Site
Yellow robot's goals Social:Exchange; Physical:Construction Site
| Level 1 | Level 2 |
|
|
|