Seven Questions to Ask Before You Buy AI Customer Support

Most AI support demos show the easy case: a simple question, a fast correct answer. The questions worth asking are about everything else. Here are seven, and what a good answer to each looks like.

One. Does answering this need a real lookup? Order status, stock levels, a delivery date, a return window: if the answer depends on live data, the system has to actually read that data, not guess from a pattern in its training. A good answer names the platforms it connects to and shows you a real order, not a mockup.

Two. Is the customer asking for an exception? A discount, a return past the deadline, a rule bent once. That is a judgement call, not a lookup, and no vendor should claim their AI makes it. It should recognise the request and hand it to a person, every time.

Three. What does it do with tone? Somebody already angry is not really asking a question, they are telling you something. A system that answers the words but misses the mood escalates a bad moment. Ask how frustration gets detected and where it routes.

Four. Can it say no? Ask a vendor to show you their system refusing to answer, live. If they cannot demonstrate a refusal, the system probably does not have one, and something that never says “I can’t help with that” will confidently answer a question it was never equipped for.

Five. Does it know what it doesn’t know? A related but different question from four. Most systems are told what data exists and given nothing about what is missing. Ask what happens when a customer asks about something the store genuinely does not track.

Six. Is the thing being approved the same thing that gets executed? If there is a confirm-before-send step anywhere in the product, ask whether the preview and the actual action are reading from the same record. It is a fair question to ask any AI vendor with write access to your systems, including tools like our own Store Copilot, and few can answer it cleanly.

Seven. What happens in the share of conversations it cannot finish? No AI support tool resolves everything. Ask what the handover looks like for the rest: does the customer wait in a generic queue, or does the person picking it up see the full conversation and context already gathered?

A vendor who answers all seven without flinching, including us, has actually run this in production. The questions cost nothing to ask, and they surface more than a resolution-rate slide ever will. We wrote a companion piece on the pricing and setup side of this decision: how to choose AI support for your online store.