diff options
| author | Patrick Simianer <p@simianer.de> | 2017-08-04 16:18:12 +0200 |
|---|---|---|
| committer | Patrick Simianer <p@simianer.de> | 2017-08-04 16:18:12 +0200 |
| commit | 7ef9733c608889b99335cb9e7db86262a6e7e528 (patch) | |
| tree | f3be0dd62b176756bbb8809504685ac07043bc4e /nmt/notes.txt | |
| parent | 266b88a783d5af777fb54543851e5f50b89b3170 (diff) | |
Diffstat (limited to 'nmt/notes.txt')
| -rw-r--r-- | nmt/notes.txt | 19 |
1 files changed, 19 insertions, 0 deletions
diff --git a/nmt/notes.txt b/nmt/notes.txt new file mode 100644 index 0000000..0bc0b9c --- /dev/null +++ b/nmt/notes.txt @@ -0,0 +1,19 @@ +forward: + single tick + advance hidden state + add functions to G + +Graph + does backprop + sets .dw fields of matrices + +Solver + updates models + step cache doesn't matter + +input +forward +calc loss,set deriv in last layer +backward +solver + |