Created
January 13, 2016 22:39
-
-
Save igul222/9da6e9094b94e7db55c2 to your computer and use it in GitHub Desktop.
Language model training with batchnorm
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| train summary epoch:0 n_inputs:21888 cost:1.72562180904 | |
| dev summary epoch:0 n_inputs:1152 cost:1.67490259806 | |
| train summary epoch:1 n_inputs:21888 cost:1.49495576557 | |
| dev summary epoch:1 n_inputs:1152 cost:1.57830005222 | |
| train summary epoch:2 n_inputs:21888 cost:1.4162766306 | |
| dev summary epoch:2 n_inputs:1152 cost:1.52844831679 | |
| train summary epoch:3 n_inputs:21888 cost:1.36915802537 | |
| dev summary epoch:3 n_inputs:1152 cost:1.50779215495 | |
| train summary epoch:4 n_inputs:21888 cost:1.33636599535 | |
| dev summary epoch:4 n_inputs:1152 cost:1.4916501575 | |
| train summary epoch:5 n_inputs:21888 cost:1.31158313417 | |
| dev summary epoch:5 n_inputs:1152 cost:1.48242017958 | |
| train summary epoch:6 n_inputs:21888 cost:1.29232457925 | |
| dev summary epoch:6 n_inputs:1152 cost:1.47543260786 | |
| train summary epoch:7 n_inputs:21888 cost:1.27481034485 | |
| dev summary epoch:7 n_inputs:1152 cost:1.46982521481 | |
| train summary epoch:8 n_inputs:21888 cost:1.26230590106 | |
| dev summary epoch:8 n_inputs:1152 cost:1.4664961497 | |
| train summary epoch:9 n_inputs:21888 cost:1.25052370663 | |
| dev summary epoch:9 n_inputs:1152 cost:1.46141433716 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
how write rnn batch normalztion on tensorflow??https://arxiv.org/pdf/1512.02595.pdf