On one hand, GIZA++ is offline trained on a large amount of bilingual sentences to compute the lexical and word alignment features.
the tree structural features, similar to word and phrase penalty features in phrase based SMT models, are computed online for both training and testing.