The new boundary is more specific then the previous boundary and it is closer to the ideal boundary.
we do not know how well it behaves on unseen examples and we are looking for a boundary that classifies with a high accuracy the unseen examples.