How to Choose an AI Consulting Firm: 10 Questions Every CEO Should Ask

Enterprise AI consulting has grown into a multibillion-dollar market in a handful of years. [1] Most of that money isn't buying results. It's buying presentations, methodology decks, and implementation timelines that slip while the scope creeps.

Here's the uncomfortable truth about the AI consulting market: most firms are paid for time and deliverables, not outcomes. A firm that solves your problem in three months makes less money than one that takes twelve. Think about that incentive structure for a moment. The system rewards slowness. Your results are a side effect, not the goal.

The good firms exist. They aren't always the biggest or the most famous. They're the ones that can answer these ten questions with specificity and without hesitation. If a firm hedges on more than two of them, walk away.

The 10 Questions

Question 1: Can You Show Me a Deployment You Built That Is Still Running Two Years Later?

Anyone can ship a pilot. The hard part is building something that survives contact with production, scales to real volume, and keeps running after your team leaves. Ask for references from clients where the deployment is live today, not from pilots that concluded six months ago.

Listen for specificity. Real answers include system names, production metrics, and the specific technical decisions that made it maintainable. If they can't name the system, the metric, and the team, they're reaching for a logo.

Question 2: What Does Your Governance Layer Look Like, and Who Owns It After You Leave?

AI without governance is liability without protection. Every serious AI consulting firm has a governance methodology. More importantly, they have a plan for transferring governance ownership to your team when the engagement ends.

If the answer involves a retainer to maintain the governance system, that's a dependency, not a solution. The governance layer should be yours to operate within 90 days of deployment.

Question 3: How Do You Measure ROI, and What Happens If You Miss It?

Any firm can promise ROI in a proposal. Ask what the measurement methodology is, what the specific metrics are, what timeline the ROI is expected by, and what the firm will do if those numbers aren't met. [2]

Firms that are confident in their work will negotiate outcome-linked fees or offer extensions at reduced rates if milestones are missed. Firms that insist on fixed-fee-regardless-of-outcome are telling you they don't believe their own forecast.

Question 4: Which Parts of This Will My Team Be Able to Run Without You in Six Months?

This is the dependency question, and it's the most revealing one. The answer tells you whether the firm is building toward your independence or against it.

Excellent firms answer with a specific capability transfer plan: which team members will be trained, on which systems, to what level of proficiency, by what date. They want you to be able to run it because that's what makes their deployment successful.

Firms that can't answer this question clearly are building a retainer, not a solution. Your dependency is their recurring revenue.

Question 5: What Is Your Position on Generative vs. Deterministic AI for Regulated Decisions?

This question tests technical depth. Any firm advising enterprises on AI should have a clear, defensible position on when to use generative AI and when to use deterministic AI. The EU AI Act makes this question regulatory, not just architectural.

If the firm advocates generative AI for high-risk decisions without a clear governance and auditability plan, either they haven't read the regulation or they're pitching what their team already knows how to build. Both become your problem, not theirs.

"The most expensive AI consulting mistake is hiring a firm that builds what they're best at rather than what you need. The diagnostic question is simple: do they ask about your workflows before they mention their platform?"

- SynthesisArc, Strategy practice

Question 6: What Is Your Firm's Relationship With the AI Vendors You Recommend?

Consulting firms earn referral fees, implementation partner bonuses, and co-marketing arrangements from AI vendors. These relationships aren't inherently corrupt, but they create conflicts of interest that should be disclosed.

Ask directly: do you receive any financial benefit from recommending specific AI platforms? A trustworthy firm will disclose this without being defensive. They should also be able to explain why the platform they're recommending is right for your specific situation, not just right for their partnership arrangement.

Question 7: How Do You Handle It When the Right Answer Is to Not Use AI?

The best AI consulting firms sometimes recommend not using AI. Some processes are better served by better software, better data, or better hiring. A firm that always recommends AI isn't advising you. They're selling you.

Ask for an example of a situation where they recommended against AI deployment, or recommended a smaller deployment than the client initially wanted, and what the outcome was. If they can't name one, they have never put a client's interest ahead of their revenue.

Question 8: What Is Your Methodology for Assessing Organizational Readiness Before Deployment?

MIT's 95% pilot failure rate isn't a technology problem. [3] It's a readiness problem. Firms that skip the readiness assessment to get to the billable implementation work are optimizing for their engagement revenue, not your outcomes.

Look for firms that have a formal readiness assessment methodology covering data infrastructure, process clarity, technical capability, governance posture, and change management capacity. If the readiness assessment is a two-hour workshop before the proposal, that isn't an assessment. That's a sales call with a different name.

Question 9: How Do You Ensure Our Data and Models Remain Ours?

AI sovereignty is a strategic business issue, not just a legal one. The consulting firm's answer to this question reveals their philosophy about client independence.

Look for: explicit contractual language vesting all AI artifacts, trained models, and derived data insights in your organization; architecture choices that enable vendor portability; and a clear position on data residency and model exportability.

Firms that build on proprietary platforms without portability provisions aren't acting in your long-term interest. The lock-in doesn't feel painful in year one. It bites in year three when the vendor raises prices or pivots the platform away from your use case, and you have nowhere to go.

Question 10: What Will This Engagement Cost, What Will It Deliver, and How Will I Know?

This sounds basic. Most AI consulting engagements can't answer it clearly at the proposal stage. The cost is clear. The deliverables are vague. The measurement criteria are absent.

Push for: a fixed or capped cost for a defined scope, specific deliverables with acceptance criteria, business metrics that will be tracked (not just deployment milestones), and a timeline with milestones, not just a start and end date.

What a Good Answer Looks Like

Real names. Real numbers. Real timelines. That's the only kind of answer worth trusting from a firm asking for six or seven figures of your budget.

Good answers to these ten questions share a few characteristics. They're specific where the firm could have hedged. They acknowledge tradeoffs rather than claiming pure upsides. They include examples of things that did not go as planned and what was learned from those engagements.

Good answers also reveal a consistent orientation: the firm is building toward your independence, period. They're measuring success by your business outcomes, not by their deployment milestones. They're advising you toward what's right, not toward what they're best positioned to build.

The Scorecard

After your conversations with candidate firms, score each one on the ten questions. Yes if the firm clearly meets the bar. No if the answer was vague, hand-wavy, or hedged. Honest scoring tells you whether to proceed.

How SynthesisArc Answers These Questions

We built this list because they're the questions we would want answered before hiring us. They're also the questions we ask ourselves before accepting an engagement, because we only take projects where we can deliver against them.

Our engagements are scoped to 90-day delivery cycles with defined business metrics. Our governance frameworks are designed to be operated by your team within that window. Our deployments run on architectures that you own, with models you can export, on infrastructure you control.

We sometimes recommend not using AI. We sometimes recommend smaller projects than clients initially want. That orientation is what makes our results trustworthy.

The Bottom Line

AI consulting is mature enough that the right firm exists for almost every enterprise use case. The challenge is distinguishing it from the dozens of firms that have added AI to their service menu without the depth to deliver.

These ten questions don't require technical expertise to evaluate. They require judgment about specificity and orientation. A firm that answers them confidently and specifically has done this before and has thought hard about what makes it work.

A firm that hedges or gets defensive hasn't. Trust that signal. [4]