To tackle to those touched and "complex" characters, it may be effective to apply some existing character recognition methods such as Rothacker et al.
most of them are ligatures of basic characters or less frequently appeared.