Agreed. If you need to calculate rectangles ML is not the right tool. Now do the comparison for an image identifying program.
If anyone's looking for the magic dividing line, ML is a very inefficient way to do anything; but, it doesn't require us to actually solve the problem, just have a bunch of examples. For very hard but commonplace problems this is still revolutionary.