Created
January 13, 2016 22:38
-
-
Save igul222/802604105d1cebe9705c to your computer and use it in GitHub Desktop.
Big language model training without batchnorm
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Epoch 0 7132.9565351009s train cost 1.6981946635 correct 1.6981946635 dev cost 1.6462526276 correct 1.6462526276 | |
| Epoch 1 7147.1999368668s train cost 1.4829269145 correct 1.4829269145 dev cost 1.5761406715 correct 1.5761406715 | |
| Epoch 2 7138.0306470394s train cost 1.4255136971 correct 1.4255136971 dev cost 1.5523425980 correct 1.5523425980 | |
| Epoch 3 7127.6019258499s train cost 1.3985411839 correct 1.3985411839 dev cost 1.5382623590 correct 1.5382623590 | |
| Epoch 4 7125.7831079960s train cost 1.3843282114 correct 1.3843282114 dev cost 1.5298263626 correct 1.5298263626 | |
| Epoch 5 7124.6437451839s train cost 1.3768820110 correct 1.3768820110 dev cost 1.5249164810 correct 1.5249164810 | |
| Epoch 6 7126.9552760124s train cost 1.3730651317 correct 1.3730651317 dev cost 1.5251269255 correct 1.5251269255 | |
| Epoch 7 7125.7269859314s train cost 1.3717070357 correct 1.3717070357 dev cost 1.5228043980 correct 1.5228043980 | |
| Epoch 8 7125.5283191204s train cost 1.3718353560 correct 1.3718353560 dev cost 1.5230966063 correct 1.5230966063 | |
| Epoch 9 7124.8590068817s train cost 1.3727909879 correct 1.3727909879 dev cost 1.5228525606 correct 1.5228525606 | |
| Epoch 10 7123.0460829735s train cost 1.3744271708 correct 1.3744271708 dev cost 1.5212328154 correct 1.5212328154 | |
| Epoch 11 7122.6375958920s train cost 1.3767354105 correct 1.3767354105 dev cost 1.5235651334 correct 1.5235651334 | |
| Epoch 12 7121.9939122200s train cost 1.3791086994 correct 1.3791086994 dev cost 1.5239410223 correct 1.5239410223 | |
| Epoch 13 7124.7528128624s train cost 1.3819809975 correct 1.3819809975 dev cost 1.5270609958 correct 1.5270609958 | |
| Epoch 14 7121.4070930481s train cost 1.3856197961 correct 1.3856197961 dev cost 1.5284120491 correct 1.5284120491 | |
| Epoch 15 7118.6957230568s train cost 1.3886640499 correct 1.3886640499 dev cost 1.5282859357 correct 1.5282859357 | |
| Epoch 16 7120.0054581165s train cost 1.3920787908 correct 1.3920787908 dev cost 1.5325375332 correct 1.5325375332 | |
| Epoch 17 7121.4728350639s train cost 1.3956478143 correct 1.3956478143 dev cost 1.5342595201 correct 1.5342595201 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment