But if the direct object is understood as Hanako's child (or some other person's than Taroo's), the same sentence implies the adversity.
the indirect passives have the sense of adversity when the affected subject is not related with the object of the verb; in other words, when the affected subject is not involved in the event denoted by the active verb (Wierzbicka 1979, Kuno 1983.