4 For simplicity, we assume some random initial state vectors such as f C 0 and b C |w i |+1 when we describe LSTMs.
we also want access to reliable probability estimates instead of raw scores -we accomplish this by constructing a custom loss function.