Image showing an ai response from chat GPT representing AI sychophancy

What If the Real Skill Is Not Using AI, but Asking It Better Questions?

June 02, 202614 min read

The tool is not the advantage. The question is.

Everyone is learning the tools. The people who will actually get ahead are the ones learning to think clearly enough to direct them.

If you run a business and you have tried AI for anything (writing, research, planning, customer follow-up), you have probably noticed something. The output is competent. It is grammatically correct. It sounds like it knows what it is talking about. And it often reads like something anyone could have written, because it sounds like everything you have already read. That pattern is not a flaw in the tool. It is a feature of how you asked. This post is about the difference between average questions that get the polished middle back and original questions that get you something worth using.

The short answer: AI tools tend to return consensus answers, the safest and most common version of whatever you asked for. The real skill is not learning the interface. It is learning to ask questions that push past the default, questions specific enough and honest enough to surface something you had not already considered. That skill is rare, it transfers across every tool, and it is the difference between AI that replaces your thinking and AI that sharpens it.

Why Does AI Tend to Give You the Answer Everyone Already Agrees On?

Large language models are trained on enormous amounts of text and then fine-tuned through a process called reinforcement learning from human feedback, or RLHF. That process rewards outputs that human reviewers rate as helpful and safe. The result, documented in peer-reviewed research, is that RLHF produces stronger generalization but measurably lower output diversity ( Kirk et al., ICLR 2024 ). The model gets better at giving you a solid answer. It also gets more likely to give you the same solid answer it gives everyone else.

This is not a conspiracy and it is not a simple flaw. It is a structural tendency. The training process that makes these tools useful also narrows the range of what they produce. A 2026 paper in Trends in Cognitive Sciences by researchers at USC found that large language models are narrowing human diversity across three dimensions: language, perspective, and reasoning. When people co-write with these tools, they tend to mirror the model's framing and shift their own opinions toward it.

To be fair, this tendency is contested in degree. Some models show it more than others. Newer architectures and prompting techniques can mitigate it. But the pull toward consensus is real and well-documented enough that anyone using these tools for business decisions should know about it.

The practical effect: ask a generic question, get a generic answer. Ask "write me a marketing email," get the average marketing email. Ask "what should my business do about AI," get the answer that could appear on ten thousand other websites. The model is not being lazy. It is doing exactly what it was optimized to do, returning the most broadly acceptable version of whatever you requested.

What Makes a Convincing Average Answer More Dangerous Than a Wrong One?

A wrong answer is easy to catch. It contradicts something you know, or the numbers do not add up, or it names a source that does not exist. You notice. You correct. You move on.

A convincing average answer is harder to spot because it does not feel wrong. It feels reasonable. It reads like insight. The structure is clean, the tone is confident, the logic follows. The problem is that it is the same reasonable answer the tool would give your competitor, your neighbor, or anyone else who typed a similar question. It is not wrong. It is just not yours.

This is where the real cost shows up for a business owner. If you use AI to draft your messaging, plan your strategy, or write your content, and every output reflects the consensus view, you end up sounding like everyone else without realizing it. Your "brand voice" becomes the tool's default voice. Your "strategy" becomes the average strategy for your industry. The danger is not that AI gives you bad advice. It is that it gives you the same advice it gives everyone, and you mistake that for thinking.

In April 2025, OpenAI rolled back a GPT-4o update after users discovered the model had become excessively agreeable, validating business ideas, personal decisions, and emotional states without pushback. The root cause was an additional reward signal based on user thumbs-up data that weakened the system's ability to push back on bad input. The lesson was public and specific: optimizing for "the user liked the answer" is not the same as optimizing for "the answer was true and useful."

What Does Marc Andreessen's "Non-Consensus and Right" Framework Have to Do With Your AI Prompts?

Marc Andreessen has written that the best venture capital investments come from ideas that are both non-consensus and right, ideas where you disagree with the crowd and turn out to be correct (a16z). Most non-consensus ideas are wrong. But the rare ones that are both non-consensus and correct are where the outsized returns live, precisely because nobody else was looking there.

The same logic applies to the questions you ask AI. A consensus question gets a consensus answer. The value, the edge, lives in the non-consensus question: the one that reframes the problem, names a constraint nobody mentioned, or asks about the thing everyone in your industry has agreed to ignore.

Here is what this looks like in practice. A landscaping company asks AI "how do I get more leads." That is a consensus question. The answer will be some version of Google Ads, SEO, referral programs, and social media. Correct, generic, useless as a differentiator. The same owner asks "what is the most common reason a homeowner who needs landscaping work does not call anyone at all." That question has a different shape. It points at the gap between demand and action, which is where the real opportunity sits. The answer might surface fear of being overcharged, not knowing what questions to ask a contractor, or uncertainty about timing. Now the owner has something to build on that the first question would never have produced.

The tool did not change. The question did.

How Do You Ask AI to Challenge You Instead of Confirming What You Already Believe?

Research on sycophancy in large language models shows a consistent pattern: when a user states an opinion, the model tends to agree with it, even when the opinion is incorrect. One study found sycophantic behavior persisted at roughly 78.5% regardless of context or model. This means that if you bring a belief to the tool and phrase it as a question that expects confirmation, you will almost certainly get confirmation back.

The practical techniques for breaking this pattern are not complicated. They require discipline more than skill.

Do your own thinking first. Before you open any AI tool, write down what you already believe about the question. Two sentences. Three at most. This is not a waste of time. It is the only way to know whether the tool is giving you something new or just reflecting your own assumptions back in better prose. If you cannot articulate your position in a few sentences, you are not ready to evaluate what the tool gives you.

Ask it to argue against you. Tell the model your current position and instruct it to build the strongest possible case for why you are wrong. Not a polite "here are some considerations." A real argument. "Here is what I believe. Now tell me the strongest version of why this is mistaken, and do not soften it." Most people never do this. The ones who do consistently report that it is the single most valuable way to use these tools.

Demand the range, not the verdict. Instead of asking "what should I do," ask "what are the three most different approaches to this problem, and what does each one sacrifice." Force the model out of its tendency to converge on one recommendation. When you see the full range, you can make a judgment. When you only see the middle, you cannot.

Get specific, because vagueness invites the generic. "Write me a follow-up email" will get you a template. "Write a follow-up email to a general contractor who requested a quote three weeks ago, has not responded to one previous follow-up, works primarily in commercial renovation, and is likely evaluating two other vendors" will get you something you can actually send. Every specific constraint you add forces the model away from its default and toward your actual situation.

Use disagreement between tools as a signal. If you ask the same question to Claude, ChatGPT, and Gemini and get three meaningfully different answers, that is not a problem. That is information. The places where they disagree are often the places where the consensus is weakest and where your own judgment matters most.

Treat every answer as a starting point, not a destination. The first output from any AI tool is a draft of someone else's average thinking. It becomes yours only after you have questioned it, cut it, added what only you know, and shaped it to your specific situation.

What Does a Real Business Scenario Look Like When You Apply This?

Consider a small service business, a plumbing company with six employees, that wants to use AI to plan its marketing for the next quarter. A typical approach is to ask the tool for a quarterly marketing plan. The output will be competent. It will mention Google Business Profile optimization, seasonal promotions, review generation, and maybe a referral program. It will be the same plan the tool would write for any plumbing company anywhere.

Now consider the same owner who spends ten minutes thinking before opening the tool. She writes down three things: her best customers are property managers who handle 20 or more units, her worst-performing channel last year was Facebook ads, and her biggest constraint is that she cannot hire another technician until September.

She asks the tool: "Given that my best customers are property managers with 20-plus unit portfolios, that Facebook ads underperformed last year, and that I cannot add capacity until September, what marketing approach focuses on deepening existing property manager relationships rather than generating new residential leads I cannot serve."

The output from that question is specific to her business, her constraints, and her actual opportunity. It is useful not because the tool is smarter but because she was clearer about what she needed.

What Is the Honest Tradeoff of Thinking Before You Prompt?

This approach is slower. That is the tradeoff, and it is real.

Typing a quick question and getting an instant answer feels productive. Spending ten minutes clarifying what you actually need before you type anything feels like friction. And for routine tasks (reformatting data, summarizing a long document, generating a first draft of something mechanical) the quick approach is fine. Not every interaction with AI needs to be a philosophical exercise.

But for the decisions that matter (your positioning, your strategy, your messaging, what you build next) the ten minutes of thinking before you prompt is the most valuable time you will spend. The cost of skipping it is not a bad afternoon. It is a slow drift toward sounding, thinking, and deciding like everyone else in your industry.

At Bennin Systems, this shows up in the work directly. Before building any client system, whether it is Voice Finder (a tool that helps business owners discover their brand voice) or a voice AI assistant like Emma deployed for Scotty's Oil, the first phase is not building. It is asking. What does this business actually need. Who is the system for. What does it replace. What should stay human. The answers to those questions determine whether the system works in the real world or just looks good in a demo.

What Does This Have to Do With Owning Your Business in the Age of AI?

Sovereignty, in the way we think about it, means owning the infrastructure your business depends on. Your data. Your domain. Your systems. Your contact list. But there is a quieter form of sovereignty that matters just as much: owning your own thinking.

If you use AI as a confirmation machine (ask it what you already believe, get a polished version back, call it strategy) you have outsourced your judgment without realizing it. The tool is running you. If you use it as a thinking partner (bring your position, make it argue, demand the range, stay specific, do the hard work of deciding) then you own the tool. That is the difference.

Every business owner reading this has a choice that gets made dozens of times a week, usually without noticing. Ask the tool to confirm what you already think. Or ask it to show you what you have not yet considered.

The tool is the same either way. The question determines which one you are using.

Bennin Systems, Paradise Valley, Montana. (406) 224-3267. benninsystems.com

Custom HTML/CSS/JAVASCRIPT

Stacy Bennin is the founder of Bennin Systems, an operational systems and AI automation consultancy based in Paradise Valley, Montana. She builds custom websites, automated client acquisition systems, brand identity, and operations workflows for small businesses, real estate professionals, and family operations. She is also a licensed Montana real estate broker affiliated with Legacy Lands Real Estate. Reach her at benninsystems.com.


FAQ

What does "asking AI better questions" actually mean in practical terms?

It means adding specificity before you type. Name the audience, the constraint, the goal, and the context. A prompt that includes who the output is for, what it should accomplish, and what the reader already knows will produce output that is specific to your situation rather than generic to your industry. The difference is not technique. It is clarity about what you need.

Is AI biased toward giving consensus answers?

Research suggests a measurable pull in that direction. A 2024 study presented at ICLR found that RLHF fine-tuning improves generalization but reduces output diversity. A 2026 paper in Trends in Cognitive Sciences documented that LLMs narrow diversity across language, perspective, and reasoning. The tendency is real, though it varies by model, prompt, and task. Saying "AI always gives you the average" overstates it. Saying "AI has a structural pull toward consensus" is accurate.

Can I use AI for business strategy, or will it just give me generic advice?

You can, but the quality depends entirely on how you frame the question. "What should my business do about marketing" will return a generic plan. The same tool, given your actual constraints, your best customer profile, and your capacity limits, will return something specific enough to act on. AI does not know your business. You have to tell it.

What is the GPT-4o sycophancy incident and why does it matter?

In April 2025, OpenAI rolled back a GPT-4o update after it became excessively agreeable, validating user opinions regardless of accuracy. The root cause was a reward signal based on user satisfaction that overrode the model's ability to push back. It matters because it illustrates a structural incentive in AI development: making users feel good can conflict with giving them honest, useful output.

How do I know if AI is just confirming what I already believe?

Write down your position before you ask. If the tool's answer matches your prior belief almost exactly, test it by explicitly asking the tool to argue against your position. If it flips easily and argues the opposite just as confidently, neither answer is particularly trustworthy on its own. The useful information is often in the space between the two responses.

Does this apply to all AI tools or just ChatGPT?

The consensus-pull tendency exists across major language models because they share similar training approaches. The sycophancy research shows the pattern persists across models at roughly similar rates. The practical techniques (specificity, adversarial prompting, demanding range) work in Claude, ChatGPT, Gemini, and others. The skill transfers because it is a thinking skill, not a tool-specific trick.

What if I am not technical? Can I still ask better questions?

Yes. The skill here is not technical. It is communicative. If you can explain your business to a new employee (who your best customers are, what your biggest constraint is, what a good week looks like versus a bad one) you can write a prompt that produces useful output. The barrier is not code or configuration. It is taking the time to be specific about what you actually need.

Should I use AI to make decisions for my business?

No. Use it to inform decisions, surface options you had not considered, and stress-test your thinking. The decision itself should be yours. AI does not know your values, your risk tolerance, your relationships, or your long-term vision. It can give you better material to decide with. It cannot decide for you, and treating it as though it can is how you end up with a business that sounds like everyone else's.

Custom HTML/CSS/JAVASCRIPT

Stacy Bennin

Real Estate Broker and Systems Creator streamlining high friction and time consuming processes for agents and businesses.

Back to Blog