5One can provide g with other inputs such as the currently predicted word yj as in [Bahdanau et al. 2015].