For many sequence labeling tasks it is beneficial to have access to both past (left) and future (right) contexts.
the LSTM's hidden state h t takes information only from past, knowing nothing about the future.