MultiTree Tournaments
Uses a consistent set MCTS parameters for each game, and increases budget from 40m to 200ms to 1000ms per decision.
The settings used for each game are from the best performing quadrant between 0/30 rollout length and the use of PI/IS-MCTS (Perfect Information or Information Set):
| Quadrant | Games |
|---|---|
| R0 IS-MCTS | Love Letter, Uno |
| R0 PI-MCTS | Dots and Boxes, Virus |
| R30 IS-MCTS | Colt Express, Diamant, Exploding Kittens, Poker, Dominion |
| R30 PI-MCTS | Tic-Tac-Toe, Sushi GO! |
The error bars show 95% confidence intervals for the percentage chance of winning a game (binomial test). Each tournament consists of a number of games with agents assigned positions at random under two constraints: i) that each agent plays the same number of games, and ii) that no agent appears more than once in any one game.
Results by Tree and Game
The tabs below plot the win rate for each agent displaying the five agents that differ by Opponent Tree policy for each combination or rollout length and IS-MCTS. This gives four plots per game.
ColtExpress
2P
3P
4P
5P
Diamant
2P
3P
4P
5P
Dominion
2P
3P
4P
DotsAndBoxes
2P
3P
4P
5P
ExplodingKittens
2P
3P
4P
5P
LoveLetter
2P
3P
4P
Poker
2P
3P
4P
5P
SushiGo
2P
3P
4P
5P
TicTacToe
2P
Uno
2P
3P
4P
5P
Virus
2P
3P
4P
5P
Games run in each tournament
ColtExpress
| Game | Player Count | Budget (ms) | Total Games | Games played by each agent |
|---|---|---|---|---|
| ColtExpress | 2 | 1000 | 20530 | 8212 |
| ColtExpress | 2 | 200 | 40000 | 16000 |
| ColtExpress | 2 | 40 | 80000 | 32000 |
| ColtExpress | 3 | 1000 | 18000 | 10800 |
| ColtExpress | 3 | 200 | 60000 | 36000 |
| ColtExpress | 3 | 40 | 120000 | 72000 |
| ColtExpress | 4 | 1000 | 19212 | 15369 |
| ColtExpress | 4 | 200 | 64000 | 51200 |
| ColtExpress | 4 | 40 | 120000 | 96000 |
| ColtExpress | 5 | 1000 | 11220 | 11220 |
| ColtExpress | 5 | 200 | 42285 | 42285 |
| ColtExpress | 5 | 40 | 200000 | 200000 |
Diamant
| Game | Player Count | Budget (ms) | Total Games | Games played by each agent |
|---|---|---|---|---|
| Diamant | 2 | 1000 | 24990 | 9996 |
| Diamant | 2 | 200 | 60000 | 24000 |
| Diamant | 2 | 40 | 100000 | 40000 |
| Diamant | 3 | 1000 | 31338 | 18802 |
| Diamant | 3 | 200 | 90000 | 54000 |
| Diamant | 3 | 40 | 150000 | 90000 |
| Diamant | 4 | 1000 | 31004 | 24803 |
| Diamant | 4 | 200 | 80544 | 64435 |
| Diamant | 4 | 40 | 165560 | 132448 |
| Diamant | 5 | 1000 | 31140 | 31140 |
| Diamant | 5 | 200 | 100000 | 100000 |
| Diamant | 5 | 40 | 250000 | 250000 |
Dominion
| Game | Player Count | Budget (ms) | Total Games | Games played by each agent |
|---|---|---|---|---|
| Dominion | 2 | 1000 | 12000 | 4800 |
| Dominion | 2 | 200 | 40000 | 16000 |
| Dominion | 2 | 40 | 80000 | 32000 |
| Dominion | 3 | 1000 | 12000 | 7200 |
| Dominion | 3 | 200 | 48000 | 28800 |
| Dominion | 3 | 40 | 120000 | 72000 |
| Dominion | 4 | 1000 | 16000 | 12800 |
| Dominion | 4 | 200 | 64000 | 51200 |
| Dominion | 4 | 40 | 120000 | 96000 |
DotsAndBoxes
| Game | Player Count | Budget (ms) | Total Games | Games played by each agent |
|---|---|---|---|---|
| DotsAndBoxes | 2 | 1000 | 10000 | 4000 |
| DotsAndBoxes | 2 | 200 | 40000 | 16000 |
| DotsAndBoxes | 2 | 40 | 80000 | 32000 |
| DotsAndBoxes | 3 | 1000 | 15000 | 9000 |
| DotsAndBoxes | 3 | 200 | 60000 | 36000 |
| DotsAndBoxes | 3 | 40 | 120000 | 72000 |
| DotsAndBoxes | 4 | 1000 | 24000 | 19200 |
| DotsAndBoxes | 4 | 200 | 80000 | 64000 |
| DotsAndBoxes | 4 | 40 | 160000 | 128000 |
| DotsAndBoxes | 5 | 1000 | 30000 | 30000 |
| DotsAndBoxes | 5 | 200 | 100000 | 100000 |
| DotsAndBoxes | 5 | 40 | 200000 | 200000 |
ExplodingKittens
| Game | Player Count | Budget (ms) | Total Games | Games played by each agent |
|---|---|---|---|---|
| ExplodingKittens | 2 | 1000 | 16000 | 6400 |
| ExplodingKittens | 2 | 200 | 40000 | 16000 |
| ExplodingKittens | 2 | 40 | 40000 | 16000 |
| ExplodingKittens | 3 | 1000 | 24000 | 14400 |
| ExplodingKittens | 3 | 200 | 60000 | 36000 |
| ExplodingKittens | 3 | 40 | 90000 | 54000 |
| ExplodingKittens | 4 | 1000 | 32000 | 25600 |
| ExplodingKittens | 4 | 200 | 80000 | 64000 |
| ExplodingKittens | 4 | 40 | 200000 | 160000 |
| ExplodingKittens | 5 | 1000 | 40000 | 40000 |
| ExplodingKittens | 5 | 200 | 100000 | 100000 |
| ExplodingKittens | 5 | 40 | 150000 | 150000 |
LoveLetter
| Game | Player Count | Budget (ms) | Total Games | Games played by each agent |
|---|---|---|---|---|
| LoveLetter | 2 | 1000 | 20000 | 8000 |
| LoveLetter | 2 | 200 | 60000 | 24000 |
| LoveLetter | 2 | 40 | 80000 | 32000 |
| LoveLetter | 3 | 1000 | 18000 | 10800 |
| LoveLetter | 3 | 200 | 75000 | 45000 |
| LoveLetter | 3 | 40 | 120000 | 72000 |
| LoveLetter | 4 | 1000 | 24000 | 19200 |
| LoveLetter | 4 | 200 | 80000 | 64000 |
| LoveLetter | 4 | 40 | 160000 | 128000 |
Poker
| Game | Player Count | Budget (ms) | Total Games | Games played by each agent |
|---|---|---|---|---|
| Poker | 2 | 1000 | 60000 | 24000 |
| Poker | 2 | 200 | 100000 | 40000 |
| Poker | 2 | 40 | 100000 | 40000 |
| Poker | 3 | 1000 | 45243 | 27145 |
| Poker | 3 | 200 | 150000 | 90000 |
| Poker | 3 | 40 | 150000 | 90000 |
| Poker | 4 | 1000 | 52572 | 42057 |
| Poker | 4 | 200 | 160000 | 128000 |
| Poker | 4 | 40 | 320000 | 256000 |
| Poker | 5 | 1000 | 46790 | 46790 |
| Poker | 5 | 200 | 150000 | 150000 |
| Poker | 5 | 40 | 250000 | 250000 |
SushiGo
| Game | Player Count | Budget (ms) | Total Games | Games played by each agent |
|---|---|---|---|---|
| SushiGo | 2 | 1000 | 14000 | 5600 |
| SushiGo | 2 | 200 | 40000 | 16000 |
| SushiGo | 2 | 40 | 80000 | 32000 |
| SushiGo | 3 | 1000 | 18000 | 10800 |
| SushiGo | 3 | 200 | 60000 | 36000 |
| SushiGo | 3 | 40 | 120000 | 72000 |
| SushiGo | 4 | 1000 | 24000 | 19200 |
| SushiGo | 4 | 200 | 80000 | 64000 |
| SushiGo | 4 | 40 | 160000 | 128000 |
| SushiGo | 5 | 1000 | 27500 | 27500 |
| SushiGo | 5 | 200 | 100000 | 100000 |
| SushiGo | 5 | 40 | 200000 | 200000 |
TicTacToe
| Game | Player Count | Budget (ms) | Total Games | Games played by each agent |
|---|---|---|---|---|
| TicTacToe | 2 | 1000 | 20000 | 8000 |
| TicTacToe | 2 | 200 | 40000 | 16000 |
| TicTacToe | 2 | 40 | 40000 | 16000 |
Uno
| Game | Player Count | Budget (ms) | Total Games | Games played by each agent |
|---|---|---|---|---|
| Uno | 2 | 200 | 3428 | 1371 |
| Uno | 2 | 40 | 19054 | 7621 |
| Uno | 3 | 200 | 8694 | 5216 |
| Uno | 3 | 40 | 30000 | 18000 |
| Uno | 4 | 200 | 13232 | 10585 |
| Uno | 4 | 40 | 20000 | 16000 |
| Uno | 5 | 200 | 15470 | 15470 |
| Uno | 5 | 40 | 50000 | 50000 |
Virus
| Game | Player Count | Budget (ms) | Total Games | Games played by each agent |
|---|---|---|---|---|
| Virus | 2 | 1000 | 30000 | 12000 |
| Virus | 2 | 200 | 80000 | 32000 |
| Virus | 2 | 40 | 100000 | 40000 |
| Virus | 3 | 1000 | 39000 | 23400 |
| Virus | 3 | 200 | 90000 | 54000 |
| Virus | 3 | 40 | 150000 | 90000 |
| Virus | 4 | 1000 | 48000 | 38400 |
| Virus | 4 | 200 | 160000 | 128000 |
| Virus | 4 | 40 | 280000 | 224000 |
| Virus | 5 | 1000 | 46600 | 46600 |
| Virus | 5 | 200 | 150000 | 150000 |
| Virus | 5 | 40 | 250000 | 250000 |