8 questions to ask before you buy a website chat tool
Buying a website chat or AI assistant? These eight questions cut through the demo and show whether the tool will turn visitors into leads you can act on.
Every chat tool demo looks good. The bot answers the sales engineer’s carefully chosen question, a lead appears in a tidy dashboard, and someone on your side says “that’s slick”. Then it goes live, and three months later you’re wondering why it mostly answers questions about opening hours.
The demo isn’t lying. It’s just answering a different question from the one you need answered. Whether a chat or AI assistant will make money for you depends on what happens before the conversation (what does it know?), during it (can it actually help?) and after it (where does the lead go?). These eight questions are the ones we’d ask before signing anything.
We make one of these tools, Serviceform, so take that into account. The questions apply whoever you buy from.
1. What will it actually know about my business?
A generic AI assistant knows a lot about the world and nothing about your pricing, your service area or which of your three offices handles commercial work. Ask exactly where the answers come from. Your website pages? Uploaded documents? Your product or listings feed? A database you’d have to maintain by hand?
Then ask how it stays current. If you change your prices on Monday, when does the assistant know? A tool that reads your live listings or catalogue will age better than one trained on a snapshot someone took during onboarding.
2. Does it know which page the visitor is on?
This one sounds minor and isn’t. Someone chatting from a specific product page, property listing or service page has already told you what they’re interested in. A tool that greets them with “How can I help you today?” throws that away and makes them type it out again.
Ask whether conversations can be page-aware: opening with something relevant to that page, answering questions about the thing in front of the visitor, and recording that context on the lead. We’ve written more on why this matters in page-aware conversations.
3. What happens when it doesn’t know the answer?
Every assistant will hit a question it can’t answer. What it does next tells you a lot. The bad options are inventing something plausible, or looping the visitor through “Sorry, I didn’t understand that” until they leave.
The good options are admitting it doesn’t know, offering a human, and capturing enough detail for someone to follow up. Ask the vendor to show you this live, with a question you make up on the spot. Ask too whether you can see the unanswered questions afterwards. They’re one of the most useful pieces of research your website will ever give you.
4. Can it hand over to a person, and to which person?
“Live chat handover” can mean anything from a real-time transfer to a named salesperson, to an email landing in a shared inbox tomorrow. Get specific:
- During opening hours, does a human get the conversation in real time, with the history?
- Out of hours, what does the visitor get offered instead? A booking? A callback?
- Can handover go to the right team based on location, product or language, rather than whoever happens to be logged in?
If your business has more than one office or team, this question matters more than any feature on the pricing page.
5. Can visitors book something without leaving the conversation?
A lead is a promise of a conversation later. A booked meeting, viewing or test drive is a commitment now. If the tool can show real availability and take a booking inside the chat, you skip the email ping-pong that loses so many warm enquiries.
Ask whose calendars it connects to, how it handles different people’s availability, and whether the booking lands in the CRM as well as the calendar.
6. Where does the lead go, and what comes with it?
Ask to see a lead arrive in your actual CRM, not the vendor’s dashboard. Then look at what’s on it:
- Contact details, obviously.
- The qualifying answers, as fields, not a transcript blob nobody reads.
- The page the conversation started on and the traffic source.
- Who it was assigned to.
If the integration is “we send an email and you copy it across”, be honest with yourselves about how often that copying will happen on a busy Friday. Our lead routing 101 piece covers what good assignment rules look like.
7. How will I know if it’s working?
“Conversations started” is a vanity number. A chat widget that pops up aggressively will start a lot of conversations and annoy a lot of people. Ask what the reporting shows beyond that:
- Leads captured and how many were qualified.
- Meetings or appointments booked.
- Which pages and sources produce the conversations that turn into something.
- Ideally, outcomes from the CRM fed back, so you can see revenue rather than activity.
Then ask the awkward follow-up: if the tool isn’t performing in month three, what will we be able to see that tells us why?
8. What does it take to run, and who does that work?
Somebody has to write the conversation flows, keep the knowledge current, review transcripts and tune the routing. Ask the vendor who that somebody is. Some tools are self-serve and assume you have the time. Others offer a managed setup. Neither is wrong, but the wrong match is how a tool ends up installed, unloved and quietly ignored.
If you have several brands, regions or offices, ask how rollout works. Starting with one use case on one site and expanding once it’s proven is usually saner than switching everything on at once. That’s how we approach multi-office rollouts at Uprealer for estate agencies, and it applies well beyond property.
Before you sign
A short checklist to take into the next demo:
- Bring three real questions your customers ask, including one awkward one.
- Ask to see a lead land in your CRM, with fields.
- Ask to see what happens out of hours.
- Ask who maintains it after launch.
If you’d like to see what a page-aware assistant looks like on a real catalogue before you talk to anyone, the Serviceform AgenticSearch demo dealership is a fair place to poke around. Try to break it. That’s what the demo is for.
The short version
The right chat tool isn’t the one with the cleverest bot. It’s the one that knows your business, knows where the visitor is, admits what it doesn’t know, gets the right person involved quickly and leaves a clean record in your CRM. Ask about all of that before you ask about price.