You need to make the canned responses use actual client data, have some variability and track what canned responses were used before for the client. We also allowed the human operator to customize the message and check if what the machine thinks is appropriate really is. We had more than 80% accuracy and we continuously measured that against the keywords found in the previous messages.
Doesn't help that precisely 0% of people appreciate getting an automatic form letter over a personal reply.