AlphaGo

Keywords: Software

A Go-playing program that was developed by DeepMind (now Google DeepMind).

Algorithm

Combines MCTS with two neural networks: a policy network and a value network.

DeepMind published the algorithm in the journal Nature: [ext] https://storage.googleapis.com/deepmind-media/alphago/AlphaGoNaturePaper.pdf

[edit]

Accomplishments

October 2015—First AI program to defeat a professional player on a 19×19 board without any handicap. This was against the French player Fan Hui (2p) who lost 0–5^[1].

March 2016—Defeated Lee Sedol 4–1 in a 5-game match with a prize purse of one million USD. AlphaGo won the first three games by resignation. Then, in the fourth game, Lee Sedol played a tesuji in the centre that led to victory after it had looked like AlphaGo had been winning in the opening. AlphaGo made several clear mistakes before resigning, showing how its policy networks are susceptible to over-valuing forcing moves if they lead to a higher perceived winning percentage. In a close match, Lee resigned the fifth game, giving a final score of 4–1 for AlphaGo. Lee had been winning early in the game after AlphaGo could not correctly read out a two-stone edge squeeze and made a mistake locally, but later in the game he neglected to play a more aggressive extension in the upper part of the board, instead preferring to play safe and make eye shape. When Lee resigned, AlphaGo was estimated to be winning by about 2.5 points, with 7.5 komi under Chinese scoring.

December 2016-January 2017—Defeated top pro players 60 times in a row online, playing anonymously as “Master”. A 61st game was called off because AlphaGo’s opponent disconnected. The games were played with short time controls on Tygem and Fox Weiqi. It seems clear that AlphaGo is now superhuman at the game of Go, and pros probably need to take at least a 2 stone handicap to be even with it.

May 2017—Defeated Ke Jie 3–0 in a 3-game match during the Future of Go Summit in Wuzhen, China.

[1] These are the results of the five formal games with longer time controls. Five informal games with shorter time controls were also played and Fan Hui won two of them by resignation (see Silver et al. 2016; p. 493). The kifu of the formal games seem to be available at page 488 (op. cit.).

[edit]

AlphaGo vs. Lee Sedol Challenge match 2016

15 minute video summaries of each game on YouTube: 1 2 3 4 5
Full game videos, approx 5 hours each, on YouTube: 1 2 3 4 5
Game records (sgf, plain moves)
Game records (sgf, with comments of observers) (tictactoe was so kind to relay the games on KGS)

[edit]

External Links

Nature News http://www.nature.com/news/google-ai-algorithm-masters-ancient-game-of-go-1.19234
Silver et al., "Mastering the game of Go with deep neural networks and tree search," Nature 529, 484-489 (2016) http://www.nature.com/nature/journal/v529/n7587/full/nature16961.html
Google DeepMind http://deepmind.com/alpha-go.html
Documentary on youtube: https://www.youtube.com/watch?v=WXuK6gekU1Y
3D visualizations of games: AlphaGo vs. Fan Hui, AlphaGo vs. Lee Sedol and AlphaGo on the Future of Go Summit

[edit]

AlphaGo quick online games against many professionals 2016/2017

Between 2016-12-29 and 2017-01-05 AlphaGo played games under aliases Magist and Master(P) on Tygem and Foxy servers against tens of professional players, among them the highest ranking players of the time Ke Jie 9p and Park Junghwan 9p. This collection consists of 60 games which all AlphaGo won (except one in which opponent connection was lost and is marked as tie).

[edit]

60 Games and commentaries

SGF collection of 60 games by Marcel Grünauer [ext] http://rechne.net/dl/the_master_files.zip or as pdf: [ext] https://www.mindo.io/alphago_60_games.pdf

Games 1-41 could be viewed on browser at [ext] http://www.go-baduk-weiqi.de/masterp-schlaegt-go-profis/ (German site) and games 42-60 [ext] http://www.go-baduk-weiqi.de/masterp-alias-mastergo-spielt-60zu0/ (in German)

Here are commentaries or analysis by various people on game by game (player names fixed per [ext] https://www.reddit.com/r/baduk/comments/5ozzp7/complete_list_of_masters_opponents/ ).

[edit]

01 2016-12-29 Magist - (manhan7(P)) Pan Tingyu (潘亭宇)

English, video, Tyler Oyakawa ~3D [ext] https://www.youtube.com/watch?v=ABRLrxT9dkw&t=126s

English, video, Michael Redmond 9p [ext] https://www.youtube.com/watch?v=9z1aRyynaBI
Corresponding sgf-file with variations: [ext] http://www.usgo.org/news/wp-content/uploads/2017/03/master01_NNannotated.sgf

[edit]

02 2016-12-29 Magist - (bandari(P)) Zhang Ziliang

English, video, Tyler Oyakawa ~3D Who is Master(P) #2 [ext] https://www.youtube.com/watch?v=9bUu2XFLxWw

English, video, Michael Redmond 9p [ext] https://www.youtube.com/watch?v=LJ8d_KTKZ-Q
Corresponding sgf-file with variations: [ext] http://www.usgo.org/news/wp-content/uploads/2017/03/master02_NN_annotated.sgf

[edit]

03 2016-12-29 (ShengR(P)) Ding Shixiong - Magist

[edit]

04 2016-12-29 Magist - (wohu(P)) Xie Erhao

English, video, Michael Redmond 9p [ext] https://www.youtube.com/watch?v=3jGkC9jeU5s
Corresponding sgf-file with variations: [ext] http://www.usgo.org/news/wp-content/uploads/2017/03/master04_Xie_Erhao.sgf

[edit]

05 2016-12-29 (trace(P)) Yu Zhiying - Magist

English, video, Brady Daniels ~3d, AlphaGo - Whatever You Do Is Wrong, [ext] https://youtu.be/6rB2cYOeppQ

[edit]

10 2016-12-30 Magist - (Hopeldo(P)) Meng Tailing

Chinese video, Mi Yuting 9p (is it he?), [ext] https://www.youtube.com/watch?v=CqUgsydtO_Y (no longer available?)

[edit]

11 2016-12-30 Master - (FengYu?(P)) Chen Hao

[edit]

12 2016-12-30 Master - (atomy(P)) Liu Yuhang ==== (this really is #13)

English, video, Tyler Oyakawa ~3D Who is Master(P)? #3 [ext] https://www.youtube.com/watch?v=8zuBPi9BjLo

[edit]

13 2016-12-30 Master - (YuSSSS(P)) Wang Haoyang ==== (this really is #12)

[edit]

14 2016-12-30 (Chop(P)) Yan Zaiming - Master

[edit]

15 2016-12-30 Magister - (XIUZHI(P)) Park Junghwan

[edit]

16 2016-12-30 Master - (lxlx(P)) Lian Xiao

English, video, Brady Daniels ~3d, Appreciating AlphaGo, [ext] https://youtu.be/YtQM8fx87PU

[edit]

17 2016-12-30 Master - (lxlx(P)) Lian Xiao

English, video, Michael Redmond 9p [ext] https://www.youtube.com/watch?v=2BCcxfyvh1w
Corresponding sgf-file with variations: [ext] http://www.usgo.org/news/wp-content/uploads/2017/03/master17_Lian_Xiao.sgf

[edit]

18 2016-12-30 (Kiss88(P)) Ke Jie - Master

English, video, Haylee 4p, Haylee's World of Go/Baduk, AlphaGo's Online Game Review 1 - Ke Jie, [ext] https://www.youtube.com/watch?v=b_24iaUMRFs

English, text comments in SGF viewer, 6d, [ext] https://gokibitz.com/kifu/S16_4wYrg

Chinese, video, [ext] https://www.youtube.com/watch?v=ZrOuXGH3Jg8 (no longer available?)

English video, Jennie Shen 2p translating commentaries of Meng Tailing 6p and adding own analysis, [ext] https://www.youtube.com/watch?v=8AqoP_N2WVU

[edit]

19 2016-12-30 Master - (Kiss88(P)) Ke Jie

English, video, Haylee 4p, Haylee's World of Go/Baduk, AlphaGo's Online Game Review 2 - Ke Jie, [ext] https://www.youtube.com/watch?v=_NR_K4oPtCU

[edit]

20 2016-12-30 (XIUZHI(P)) Park Junghwan - Master

English, video, Haylee 4p, Haylee's World of Go/Baduk, AlphaGo's Online Game Review 3 - Park Junghwan [ext] https://www.youtube.com/watch?v=xrOv9lqi4xE

Chinese video, Mi Yuting 9p with Meng Tailing 6p??, [ext] https://www.youtube.com/watch?v=52GT2XiptwU (no longer available?)

English, video, Michael Redmond 9p [ext] https://www.youtube.com/watch?v=9D7h3ROQzAI
Corresponding sgf-file with variations: [ext] http://www.usgo.org/news/wp-content/uploads/2017/04/master15_ParkJunghwan_Master_Redmond.sgf
Remark: In the video and sgf-file the game is erroneously referred to as #15.

[edit]

21 2016-12-31 Master - (Loong(P)) Chen Yaoye

[edit]

22 2016-12-31 Master - (Loong(P)) Chen Yaoye

English video, Michael Redmond 9p [ext] https://www.youtube.com/watch?v=G5OKn2lWICk
Corresponding sgf-file with variations: [ext] http://www.usgo.org/news/wp-content/uploads/2017/05/RR08-master22_Master-Chen_Yaoye-2_final.sgf

[edit]

23 2016-12-31 (abc2080(P)) Kim Junghyun - Master

English, video, Tyler Oyakawa ~3d(?), Who is Master(P)? #5 vs Kim Jiseok [ext] https://www.youtube.com/watch?v=y0KQ0z8Cxx4

English, video, Michael Redmond 9p [ext] https://www.youtube.com/watch?v=RJh_EJcDx8Q

[edit]

24 2016-12-31 (XIUZHI(P)) Park Junghwan - Master

English video, Jennie Shen 2p translating commentaries of Meng Tailing 6p and adding own analysis, [ext] https://www.youtube.com/watch?v=aTbxf8-w6AE

[edit]

25 2016-12-31 Master - (XIUZHI(P)) Park Junghwan

English, video, Haylee 4p, Haylee's World of Go/Baduk, AlphaGo's Online Game Review 4 - Park Junghwan [ext] https://www.youtube.com/watch?v=bO9CvC7lZ-o

English translated SGF, [ext] http://lifein19x19.com/forum/viewtopic.php?p=215719#p215719

[edit]

26 2016-12-31 (dauning(P)) Yun Chanhee - Master

English, video, Dwyrin 5d, AlphaGo vs Tygem - An 8p Falls to Master(P), [ext] https://www.youtube.com/watch?v=z9P8wG6b4-8

[edit]

27 2016-12-31 (ddcg) Fan Tingyu - Master

English, video, Brady Daniels ~3d, AlphaGo - Whatever You Do Is Wrong, [ext] https://youtu.be/6rB2cYOeppQ?t=19m36s

[edit]

28 2016-12-31 (Hopeldo(P)) Meng Tailing - Master

[edit]

29 2016-12-31 Master - (Strive(P)) Mi Yuting

English translation, Mi Yuting 9p with Meng Tailing 6p, Text in SGF viewer in Forum, [ext] http://www.lifein19x19.com/forum/viewtopic.php?p=215654#p215654

Chinese video, ??, [ext] https://www.youtube.com/watch?v=ifKtZFGaO5k (no longer available?)

English video, Jennie Shen 2p translating commentaries of Meng Tailing 6p and adding own analysis, [ext] https://www.youtube.com/watch?v=0y7DUHzWOEg

[edit]

30 2016-12-31 Master - (930115) Tang Weixing

Chinese video, Tang Weixing 9p with Meng Tailing 6p, [ext] https://www.youtube.com/watch?v=khOMKHTWOgw (no longer available?)

English subtitled video, Tang Weixing 9p and Meng Tailing 6p, [ext] https://www.youtube.com/watch?v=QupHEQbuc30

English video, Jennie Shen 2p translating commentaries of Meng Tailing 6p and adding own analysis, [ext] https://www.youtube.com/watch?v=T7dJbrNPLZs

[edit]

31 2017-01-01 (black2012) Li Qincheng - Master

English video, Michael Redmond 9p [ext] https://www.youtube.com/watch?v=d_LJnMlwPeQ
Corresponding sgf-file with variations: [ext] http://www.usgo.org/news/wp-content/uploads/2017/05/RR11-master31_Li_Qincheng-Master_final.sgf

[edit]

32 2017-01-02 Master - (星宿老仙) Gu Li

English, video, Michael Redmond 9p [ext] https://www.youtube.com/watch?v=YmH7ChHp6rM
Corresponding sgf-file with variations: [ext] http://www.usgo.org/news/wp-content/uploads/2017/04/2016.04.22_RR12-master32-Master-Gu_Li_kgs-variations04.03.sgf

[edit]

33 2017-01-02 (星宿老仙) Gu Li - Master

English, video, Michael Redmond 9p [ext] https://www.youtube.com/watch?v=Ymgv3kdLLXg
Corresponding sgf-file with variations: [ext] http://www.usgo.org/news/wp-content/uploads/2017/04/RR13-master33_Gu_Li_02_annotated.sgf

[edit]

34 2017-01-02 (jingjing) Dang Yifei - Master

[edit]

35 2017-01-02 Master - (kuangren) Jiang Weijie

English, video, Michael Redmond 9p [ext] https://www.youtube.com/watch?v=1vVe1pKmhQ4
Corresponding sgf-file with variations: [ext] http://www.usgo.org/news/wp-content/uploads/2017/05/RR14_master35_Jiang_Weijie_01_annotated-final.sgf

[edit]

36 2017-01-02 (INDIANA13) Gu Zihao - Master

English video, Michael Redmond 9p [ext] https://www.youtube.com/watch?v=gWabLAkvpIQ
Corresponding sgf-file with variations: [ext] http://www.usgo.org/news/wp-content/uploads/2017/05/RR15_master36_Gu_Zihao_01_final.sgf

[edit]

37 2017-01-02 (pyh) Park Yeonghun - Master

English video, Ryan Li 1p & Stephanie Yin 1p, [ext] https://www.youtube.com/watch?v=tgPuGxqlQrY

[edit]

38 2017-01-02 (天选) Tuo Jiaxi - Master

[edit]

39 2017-01-02 (jpgo01) Iyama Yuta - Master

[edit]

40 2017-01-02 Master - (愿我能) Meng Tailing

Chinese video, Mi Yuting 9p (is it he?), [ext] https://www.youtube.com/watch?v=ip4J4KT-ZWI (no longer available?)

[edit]

41 2017-01-02 (airforce9) Kim Jiseok

Haylee: AlphaGo's Online Game Review 5 - Kim Jiseok : [ext] https://www.youtube.com/watch?v=on314lXDv9Q

[edit]

42 2017-01-03 (smile) Yang Dingxin - Master

[edit]

43 2017-01-03 (piaojie) Kang Dongyun - Master

[edit]

44 2017-01-03 Master - (spinmove) An Sungjoon

[edit]

45 2017-01-03 (leaf) Shi Yue - Master

English video, Ryan Li 1p & Stephanie Yin 1p, [ext] https://www.youtube.com/watch?v=8ye-L4JdAxM

[edit]

46 2017-01-03 Master - (剑过无声) Lian Xiao

[edit]

47 2017-01-03 (段誉) Tan Xiao - Master

English video, Michael Redmond 9p [ext] https://www.youtube.com/watch?v=zYOQ2Xwpedg
Corresponding sgf-file with variations: [ext] http://www.usgo.org/news/wp-content/uploads/2017/05/RR16_master47_Tan_Xiao_FINAL.sgf

[edit]

48 2017-01-03 Master - (maker) Park Junghwan

English, video, Nick Sibicky(4D) Go Lecture #233 - Alpha Go Strikes Back! [ext] https://www.youtube.com/watch?v=v8Eh41m7gVA

English video, Michael Redmond 9p [ext] https://www.youtube.com/watch?v=aXsZGEqe1kA
Corresponding sgf-file with variations: [ext] http://www.usgo.org/news/wp-content/uploads/2017/05/2017.05.14_master48_Park_Jungwhan_final.sgf

[edit]

49 2017-01-03 Master - (wonfun) Weon Seongjin

[edit]

50 2017-01-03 Master - (潜伏) Ke Jie

English video, Simon Janin (3D) [ext] https://www.youtube.com/watch?v=XqCSwmcJqlQ

English, video, Michael Redmond 9p [ext] https://www.youtube.com/watch?v=O375GjxwhhQ
Corresponding sgf-file with variations: [ext] http://www.usgo.org/news/wp-content/uploads/2017/05/2017.04.27_master-ke-jie51-kgscomments-final.sgf

[edit]

51 2017-01-04 Master - (周俊勳) Zhou Junxun

[edit]

52 2017-01-04 Master - (ykpcx) Fan Tingyu

[edit]

53 2017-01-04 (kongm) Huang Yunsong - Master

[edit]

54 2017-01-04 (聂卫平) Nie Weiping - Master

[edit]

55 2017-01-04 Master - (谜团) Chen Yaoye

[edit]

56 2017-01-04 (shadowpow) Cho Hanseung - Master

[edit]

57 2017-01-04 (nparadigm) Shin Jinseo - Master

[edit]

58 2017-01-04 Master - (小香馋猫) Chang Hao

[edit]

59 2017-01-04 (Eason) Zhou Ruiyang - Master

[edit]

60 2017-01-04 Master - (古力) Gu Li

[edit]

News links on quick games

Yonhap News Agency S. Korean Go master says upgraded AlphaGo 'too strong' for humans http://english.yonhapnews.co.kr/news/2017/01/10/0200000000AEN20170110005500315.html
Korean JoongAng Daily, Learning from AlphaGo http://koreajoongangdaily.joins.com/news/article/article.aspx?aid=3028376

[edit]

AlphaGo Zero 2017

25 minute video (which are now unavailable to watch) of some of the 80 self-play games released of AlphaGo Zero against older AlphaGo Master version on YouTube: 1 2 3 4 5

SGFs of Alpha Go games

Nature News

[edit]

AlphaGo

Algorithm

Accomplishments

AlphaGo vs. Lee Sedol Challenge match 2016

External Links

AlphaGo quick online games against many professionals 2016/2017

60 Games and commentaries

01 2016-12-29 Magist - (manhan7(P)) Pan Tingyu (潘亭宇)

02 2016-12-29 Magist - (bandari(P)) Zhang Ziliang

03 2016-12-29 (ShengR(P)) Ding Shixiong - Magist

04 2016-12-29 Magist - (wohu(P)) Xie Erhao

05 2016-12-29 (trace(P)) Yu Zhiying - Magist

06 2016-12-29 (AoXiang?(P)) Li Xiangyu - Magist

07 2016-12-29 (cfs(P)) Qiao Zhijian - Magist

08 2016-12-29 Magist - (3qiKing(P)) Han Yizhou

09 2016-12-29 (Hopeldo(P)) Meng Tailing - Magist

10 2016-12-30 Magist - (Hopeldo(P)) Meng Tailing

11 2016-12-30 Master - (FengYu?(P)) Chen Hao

12 2016-12-30 Master - (atomy(P)) Liu Yuhang ==== (this really is #13)

13 2016-12-30 Master - (YuSSSS(P)) Wang Haoyang ==== (this really is #12)

14 2016-12-30 (Chop(P)) Yan Zaiming - Master

15 2016-12-30 Magister - (XIUZHI(P)) Park Junghwan

16 2016-12-30 Master - (lxlx(P)) Lian Xiao

17 2016-12-30 Master - (lxlx(P)) Lian Xiao

18 2016-12-30 (Kiss88(P)) Ke Jie - Master

19 2016-12-30 Master - (Kiss88(P)) Ke Jie

20 2016-12-30 (XIUZHI(P)) Park Junghwan - Master

21 2016-12-31 Master - (Loong(P)) Chen Yaoye

22 2016-12-31 Master - (Loong(P)) Chen Yaoye

23 2016-12-31 (abc2080(P)) Kim Junghyun - Master

24 2016-12-31 (XIUZHI(P)) Park Junghwan - Master

25 2016-12-31 Master - (XIUZHI(P)) Park Junghwan

26 2016-12-31 (dauning(P)) Yun Chanhee - Master

27 2016-12-31 (ddcg) Fan Tingyu - Master

28 2016-12-31 (Hopeldo(P)) Meng Tailing - Master

29 2016-12-31 Master - (Strive(P)) Mi Yuting

30 2016-12-31 Master - (930115) Tang Weixing

31 2017-01-01 (black2012) Li Qincheng - Master

32 2017-01-02 Master - (星宿老仙) Gu Li

33 2017-01-02 (星宿老仙) Gu Li - Master

34 2017-01-02 (jingjing) Dang Yifei - Master

35 2017-01-02 Master - (kuangren) Jiang Weijie

36 2017-01-02 (INDIANA13) Gu Zihao - Master

37 2017-01-02 (pyh) Park Yeonghun - Master

38 2017-01-02 (天选) Tuo Jiaxi - Master

39 2017-01-02 (jpgo01) Iyama Yuta - Master

40 2017-01-02 Master - (愿我能) Meng Tailing

41 2017-01-02 (airforce9) Kim Jiseok

42 2017-01-03 (smile) Yang Dingxin - Master

43 2017-01-03 (piaojie) Kang Dongyun - Master

44 2017-01-03 Master - (spinmove) An Sungjoon

45 2017-01-03 (leaf) Shi Yue - Master

46 2017-01-03 Master - (剑过无声) Lian Xiao

47 2017-01-03 (段誉) Tan Xiao - Master

48 2017-01-03 Master - (maker) Park Junghwan

49 2017-01-03 Master - (wonfun) Weon Seongjin

50 2017-01-03 Master - (潜伏) Ke Jie

51 2017-01-04 Master - (周俊勳) Zhou Junxun

52 2017-01-04 Master - (ykpcx) Fan Tingyu

53 2017-01-04 (kongm) Huang Yunsong - Master

54 2017-01-04 (聂卫平) Nie Weiping - Master

55 2017-01-04 Master - (谜团) Chen Yaoye

56 2017-01-04 (shadowpow) Cho Hanseung - Master

57 2017-01-04 (nparadigm) Shin Jinseo - Master

58 2017-01-04 Master - (小香馋猫) Chang Hao

59 2017-01-04 (Eason) Zhou Ruiyang - Master

60 2017-01-04 Master - (古力) Gu Li

News links on quick games

AlphaGo Zero 2017

See also