In the days when we had a cat, there was a catflap in the garage and a daily cleaned littertray. Even when she was inside, she'd miauw to go out to the garage and she was a great friend two of our immediate neighbours as she never did anything in their garden. It is just a matter of training from young and taking responsibility for your pet so it doesn't cause annoyance to others.
When I was young many moons ago, my parents had a sand tray covered against the weather outside the patio and never had a complaint about the cat. We then lived close the sea so daily fresh sand was used.
Over time we've gotten new direct neighbours (7) and as Mrs.WW is a keen gardener she been close to tears at what strange cats do to her garden, especiallt the young plants and seed rows. I can well sympathise with the attitude of some who advocate strong retribution to the cats, perhaps this should be more directed at the offending owners.