← Back to Rule Set

Agent Experiment

Blind Taste Test

You are a homeowner. You will chat with two mortgage agents about the same situation. Same questions, different responses.

After both conversations, you will rate each agent. Then we reveal which is which.

Your Scenario

  • Current balance: $291,000 at 6.5% ($1,840/mo)
  • Home equity: ~$200,000
  • Goal: lower your monthly payment
  • Also want: $50k cash-out for a kitchen renovation
  • Hard ceiling: $2,000/mo
Agent Blue
Conversation 1 of 2

One down, one to go.

Same scenario, different agent. Same messages from you. Let's see how Agent Green handles it.

Agent Green
Conversation 2 of 2

Rate Both Agents

How did each agent perform?

Rate each agent on four dimensions. Be honest. There are no wrong answers.

Agent Blue

Your first conversation

  Review transcript

Agent Green

Your second conversation

  Review transcript

Rate all dimensions for both agents to continue

The Reveal

Here is what you experienced

Both agents gave correct mortgage information. The difference is in how they helped you think.

B

Agent Blue = The Spec, Executed Perfectly

Follows the Give-to-Get brief. Property reveal, give before you get, named paths with personality, calm confidence. The best home advisor David could possibly want. Genuinely great.

G

Agent Green = The Spec + Insight Layer

Everything Blue does, plus: detects contradictions between goals, probes for deeper meaning, names tensions before presenting options, reduces the possibility space, generates a middle path the user didn't know to ask for.

Behavior Comparison

Behavior The Spec (Blue) Spec + Insight Layer (Green)
Property reveal + give before get Yes. Shows data before asking. Named paths. Calm confidence. Yes. Same foundation, same quality.
Probes for deeper motivation Accepts stated goal and delivers on it well. Goes deeper: "What does 'lower payment' mean for you?"
Detects contradictions Presents options that address each goal separately. Catches the conflict BEFORE presenting: "These pull in opposite directions."
When user hits the conflict Explains the tradeoff clearly. User discovers the tension on their own. Names the tension proactively. User feels understood, not confused.
Seeks hard boundaries Responsive when user states limits. Actively asks: "Is there an absolute ceiling?" before generating.
Generates creative middle path Presents standard options: refi OR cash-out OR HELOC. Invents a path user didn't ask for: $30k cash-out that lowers payment AND funds the kitchen.
Dimension reduction Adds options to be thorough (HELOC), which increases complexity. Reduces the space: 3 paths, each addressing the tension differently.
End state User has good information but still needs to decide between separate approaches. User sees a path that does both things at once. The question changed.

Your Ratings