Convolutional Neural Networks (CNNs) are responsible for the major breakthroughs in image recognition made in the past few years. In this chapter we will cover:
- Implementing a Simpler CNN
- Implementing an Advanced CNN
- Retraining Existing CNN models
- Applying Stylenet/Neural-Style
- Implementing DeepDream
熟悉基本操作后，转入Model的具体实践，以及可视化。
Let's look at how to achieve it by Tensorflow.
Log赏析：
Successfully downloaded train-images-idx3-ubyte.gz 9912422 bytes. Extracting temp/train-images-idx3-ubyte.gz
Successfully downloaded train-labels-idx1-ubyte.gz 28881 bytes. Extracting temp/train-labels-idx1-ubyte.gz
Successfully downloaded t10k-images-idx3-ubyte.gz 1648877 bytes. Extracting temp/t10k-images-idx3-ubyte.gz
Successfully downloaded t10k-labels-idx1-ubyte.gz 4542 bytes. Extracting temp/t10k-labels-idx1-ubyte.gz
Generation # 5. Train Loss: 2.28. Train Acc (Test Acc): 14.00 (14.00) Generation # 10. Train Loss: 2.22. Train Acc (Test Acc): 14.00 (22.00) Generation # 15. Train Loss: 2.11. Train Acc (Test Acc): 40.00 (33.40) Generation # 20. Train Loss: 2.05. Train Acc (Test Acc): 48.00 (50.00) Generation # 25. Train Loss: 1.93. Train Acc (Test Acc): 52.00 (57.00) Generation # 30. Train Loss: 1.69. Train Acc (Test Acc): 64.00 (62.60) Generation # 35. Train Loss: 1.43. Train Acc (Test Acc): 67.00 (64.40) Generation # 40. Train Loss: 1.22. Train Acc (Test Acc): 63.00 (70.80) Generation # 45. Train Loss: 0.87. Train Acc (Test Acc): 82.00 (76.80) Generation # 50. Train Loss: 0.76. Train Acc (Test Acc): 80.00 (77.20) Generation # 55. Train Loss: 0.66. Train Acc (Test Acc): 80.00 (75.40) Generation # 60. Train Loss: 0.59. Train Acc (Test Acc): 81.00 (80.80) Generation # 65. Train Loss: 0.55. Train Acc (Test Acc): 79.00 (85.60) Generation # 70. Train Loss: 0.41. Train Acc (Test Acc): 85.00 (81.80) Generation # 75. Train Loss: 0.57. Train Acc (Test Acc): 83.00 (85.20) Generation # 80. Train Loss: 0.39. Train Acc (Test Acc): 90.00 (86.00) Generation # 85. Train Loss: 0.39. Train Acc (Test Acc): 90.00 (86.00) Generation # 90. Train Loss: 0.26. Train Acc (Test Acc): 92.00 (90.60) Generation # 95. Train Loss: 0.32. Train Acc (Test Acc): 90.00 (87.60) Generation # 100. Train Loss: 0.39. Train Acc (Test Acc): 89.00 (89.80) Generation # 105. Train Loss: 0.49. Train Acc (Test Acc): 85.00 (90.00) Generation # 110. Train Loss: 0.34. Train Acc (Test Acc): 88.00 (90.00) Generation # 115. Train Loss: 0.24. Train Acc (Test Acc): 91.00 (89.20) Generation # 120. Train Loss: 0.30. Train Acc (Test Acc): 92.00 (91.40) Generation # 125. Train Loss: 0.29. Train Acc (Test Acc): 89.00 (91.60) Generation # 130. Train Loss: 0.31. Train Acc (Test Acc): 93.00 (90.20) Generation # 135. Train Loss: 0.41. Train Acc (Test Acc): 85.00 (91.40) Generation # 140. Train Loss: 0.22. Train Acc (Test Acc): 94.00 (91.40) Generation # 145. Train Loss: 0.39. Train Acc (Test Acc): 85.00 (92.60) Generation # 150. Train Loss: 0.38. Train Acc (Test Acc): 93.00 (90.00) Generation # 155. Train Loss: 0.17. Train Acc (Test Acc): 96.00 (91.60) Generation # 160. Train Loss: 0.22. Train Acc (Test Acc): 93.00 (93.20) Generation # 165. Train Loss: 0.15. Train Acc (Test Acc): 97.00 (92.00) Generation # 170. Train Loss: 0.24. Train Acc (Test Acc): 92.00 (93.40) Generation # 175. Train Loss: 0.21. Train Acc (Test Acc): 93.00 (92.40) Generation # 180. Train Loss: 0.35. Train Acc (Test Acc): 90.00 (91.80) Generation # 185. Train Loss: 0.15. Train Acc (Test Acc): 95.00 (93.80) Generation # 190. Train Loss: 0.17. Train Acc (Test Acc): 96.00 (91.60) Generation # 195. Train Loss: 0.26. Train Acc (Test Acc): 89.00 (92.20) Generation # 200. Train Loss: 0.32. Train Acc (Test Acc): 91.00 (91.40) Generation # 205. Train Loss: 0.20. Train Acc (Test Acc): 93.00 (93.60) Generation # 210. Train Loss: 0.16. Train Acc (Test Acc): 97.00 (93.80) Generation # 215. Train Loss: 0.18. Train Acc (Test Acc): 95.00 (91.60) Generation # 220. Train Loss: 0.21. Train Acc (Test Acc): 96.00 (92.40) Generation # 225. Train Loss: 0.23. Train Acc (Test Acc): 93.00 (94.80) Generation # 230. Train Loss: 0.16. Train Acc (Test Acc): 97.00 (96.60) Generation # 235. Train Loss: 0.19. Train Acc (Test Acc): 93.00 (94.80) Generation # 240. Train Loss: 0.12. Train Acc (Test Acc): 97.00 (95.20) Generation # 245. Train Loss: 0.16. Train Acc (Test Acc): 96.00 (92.20) Generation # 250. Train Loss: 0.22. Train Acc (Test Acc): 92.00 (93.80) Generation # 255. Train Loss: 0.22. Train Acc (Test Acc): 94.00 (95.00) Generation # 260. Train Loss: 0.22. Train Acc (Test Acc): 90.00 (93.40) Generation # 265. Train Loss: 0.23. Train Acc (Test Acc): 93.00 (94.40) Generation # 270. Train Loss: 0.11. Train Acc (Test Acc): 96.00 (92.00) Generation # 275. Train Loss: 0.15. Train Acc (Test Acc): 94.00 (93.20) Generation # 280. Train Loss: 0.17. Train Acc (Test Acc): 97.00 (95.60) Generation # 285. Train Loss: 0.25. Train Acc (Test Acc): 90.00 (95.20) Generation # 290. Train Loss: 0.17. Train Acc (Test Acc): 95.00 (95.80) Generation # 295. Train Loss: 0.20. Train Acc (Test Acc): 93.00 (96.40) Generation # 300. Train Loss: 0.12. Train Acc (Test Acc): 96.00 (93.60) Generation # 305. Train Loss: 0.15. Train Acc (Test Acc): 94.00 (94.20) Generation # 310. Train Loss: 0.37. Train Acc (Test Acc): 88.00 (94.80) Generation # 315. Train Loss: 0.19. Train Acc (Test Acc): 96.00 (93.40) Generation # 320. Train Loss: 0.17. Train Acc (Test Acc): 95.00 (96.20) Generation # 325. Train Loss: 0.16. Train Acc (Test Acc): 92.00 (93.80) Generation # 330. Train Loss: 0.17. Train Acc (Test Acc): 96.00 (94.00) Generation # 335. Train Loss: 0.14. Train Acc (Test Acc): 96.00 (95.20) Generation # 340. Train Loss: 0.15. Train Acc (Test Acc): 96.00 (96.60) Generation # 345. Train Loss: 0.15. Train Acc (Test Acc): 94.00 (95.60) Generation # 350. Train Loss: 0.27. Train Acc (Test Acc): 91.00 (97.00) Generation # 355. Train Loss: 0.11. Train Acc (Test Acc): 98.00 (94.60) Generation # 360. Train Loss: 0.15. Train Acc (Test Acc): 95.00 (95.20) Generation # 365. Train Loss: 0.08. Train Acc (Test Acc): 98.00 (96.40) Generation # 370. Train Loss: 0.15. Train Acc (Test Acc): 94.00 (93.80) Generation # 375. Train Loss: 0.21. Train Acc (Test Acc): 92.00 (96.60) Generation # 380. Train Loss: 0.21. Train Acc (Test Acc): 96.00 (94.40) Generation # 385. Train Loss: 0.07. Train Acc (Test Acc): 99.00 (95.40) Generation # 390. Train Loss: 0.19. Train Acc (Test Acc): 94.00 (95.40) Generation # 395. Train Loss: 0.12. Train Acc (Test Acc): 97.00 (94.40) Generation # 400. Train Loss: 0.14. Train Acc (Test Acc): 96.00 (96.60) Generation # 405. Train Loss: 0.17. Train Acc (Test Acc): 95.00 (96.60) Generation # 410. Train Loss: 0.16. Train Acc (Test Acc): 93.00 (96.40) Generation # 415. Train Loss: 0.18. Train Acc (Test Acc): 93.00 (95.60) Generation # 420. Train Loss: 0.11. Train Acc (Test Acc): 95.00 (94.80) Generation # 425. Train Loss: 0.22. Train Acc (Test Acc): 91.00 (95.20) Generation # 430. Train Loss: 0.07. Train Acc (Test Acc): 98.00 (96.20) Generation # 435. Train Loss: 0.11. Train Acc (Test Acc): 97.00 (95.80) Generation # 440. Train Loss: 0.07. Train Acc (Test Acc): 97.00 (95.20) Generation # 445. Train Loss: 0.15. Train Acc (Test Acc): 99.00 (97.80) Generation # 450. Train Loss: 0.09. Train Acc (Test Acc): 98.00 (95.00) Generation # 455. Train Loss: 0.07. Train Acc (Test Acc): 97.00 (95.80) Generation # 460. Train Loss: 0.08. Train Acc (Test Acc): 98.00 (94.60) Generation # 465. Train Loss: 0.07. Train Acc (Test Acc): 98.00 (95.40) Generation # 470. Train Loss: 0.14. Train Acc (Test Acc): 98.00 (94.40) Generation # 475. Train Loss: 0.24. Train Acc (Test Acc): 93.00 (96.40) Generation # 480. Train Loss: 0.08. Train Acc (Test Acc): 99.00 (94.40) Generation # 485. Train Loss: 0.16. Train Acc (Test Acc): 96.00 (96.40) Generation # 490. Train Loss: 0.09. Train Acc (Test Acc): 95.00 (96.40) Generation # 495. Train Loss: 0.13. Train Acc (Test Acc): 95.00 (96.20) Generation # 500. Train Loss: 0.09. Train Acc (Test Acc): 99.00 (95.80)