I think this is a good way of thinking...

Each part we make simpler, the easier it'll be to solve the entire problem.

This would make it easy to find the problems in it after simplifing it... and make it easier to find problems in other parts of the system since making one part simpler will decrease its effect on other parts.