Stubbi
Compare
Head-to-head · Updated Nov 3, 2026

ChatGPT vs Gemini

The highest-scoring ChatGPT and Gemini models, GPT-6 Astra and Gemini 4 Carbon, on independent tests for professional work, cost and speed.

Short answer

Gemini 4 Carbon leads on 9 of 10 quality scores, including the overall Intelligence Index.

  • FinanceGemini 4 Carbon62.6 vs 57.4
  • Legal workGemini 4 Carbon62.0 vs 55.6
  • EngineeringGemini 4 Carbon64.7 vs 61.8
  • Strategy & operationsGemini 4 Carbon60.9 vs 58.0
  • Coding agentsGemini 4 Carbon65.2% vs 59.1%
  • Fewer made-up answersGemini 4 Carbon11.4% vs 49.8%
  • Lower costGPT-6 Astra$5,661 vs $8,240
  • SpeedGemini 4 Carbon94 tok/s vs 73 tok/s

Same task, side by side

6 original professional tasks, run Nov 3, 2026. One response per model with default settings and no system prompt, through OpenRouter. Cost includes reasoning tokens and excludes OpenRouter’s 5.5% funding fee. Gemini 4 Argon stands in for the scored model, which is not available through the API yet.

Legal

Spot the risks in a software contract

Task
You are advising the customer, a 40-person design agency, before it signs this software subscription agreement. List the three biggest risks to the customer in order of importance. For each, explain the risk in one or two sentences and propose replacement wording. Keep the whole answer under 250 words.

Clause:
"In no event shall Provider's aggregate liability arising out of or related to this Agreement exceed the fees paid by Customer in the one (1) month preceding the claim. Provider may modify the Services or these terms at any time by posting notice on its website, and Customer's continued use constitutes acceptance. Customer shall indemnify Provider against all claims arising from Customer Data, including claims caused by Provider's negligence. This Agreement renews automatically for successive twelve (12) month terms unless Customer gives written notice of non-renewal at least ninety (90) days before the end of the then-current term."
GPT-6 Astra19s · $0.026

1. Broad, potentially uncapped customer indemnity

The agency could have to defend and pay claims caused by the Provider’s own negligence, while only the Provider benefits from the liability cap.

Replacement: “Customer shall indemnify Provider only against third-party claims to the extent caused by Customer’s unlawful provision of Customer Data, excluding losses attributable to Provider’s negligence, misconduct, or breach. This obligation is capped at twelve months’ subscription fees. Customer controls the defense; settlements imposing obligations on Provider require Provider’s reasonable consent.”

2. Provider liability capped at one month’s fees

This could leave the agency recovering almost nothing after a serious outage, lost client work, or data breach.

Replacement: “Provider’s aggregate liability shall not exceed the fees paid or payable for twelve months of Services. For breaches of confidentiality or data-security obligations, the cap shall be twice that amount. No cap applies to Provider’s fraud, willful misconduct, or liability that cannot lawfully be limited.”

3. Unilateral changes compounded by renewal lock-in

The Provider can change functionality or contractual protections without meaningful consent, while the 90-day deadline risks trapping the agency in another annual term.

Replacement: “Material changes to these terms require Customer’s express written agreement. Provider shall give 60 days’ advance written notice of materially adverse Service changes; Customer may terminate before implementation and receive a prorated refund of prepaid unused fees. Renewal requires Customer’s written agreement; otherwise, this Agreement expires at the end of the current term.”

Gemini 4 Argon15s · $0.0035

Here are the three biggest risks for your agency, in order of importance:

1. Unfair Indemnification for Provider’s Negligence

Risk: If the Provider negligently leaks your clients’ sensitive design files, your agency must pay for the Provider’s legal defense and damages. You should never be financially responsible for the Provider’s own carelessness.

Replacement: "Customer shall indemnify Provider against third-party claims arising from Customer Data, except to the extent caused by Provider's breach of this Agreement, negligence, or willful misconduct."

2. Unreasonably Low Liability Cap

Risk: Capping damages at one month of fees leaves your agency practically unprotected if the software fails, loses data, or causes severe business interruption. A standard cap should reflect at least a full year of contract value.

Replacement: "In no event shall either party's aggregate liability exceed the fees paid by Customer in the twelve (12) months preceding the claim."

3. Unilateral Changes Without Direct Notice

Risk: The Provider can strip away critical software features or worsen legal terms simply by updating its website, trapping you in a degraded service. You need direct notice of material changes and a right to exit.

Replacement: "Provider may only modify these terms or materially degrade the Services upon 30 days' prior written notice to Customer via email. If Customer objects, Customer may terminate this Agreement and receive a pro-rata refund of prepaid fees."

What a strong answer includes. The clause contains four customer risks: a one-month liability cap, unilateral changes by website notice, an indemnity that covers the provider’s own negligence, and a 90-day auto-renewal notice window. Strong answers prioritize the liability cap and the negligence indemnity and give usable replacement wording.

Finance

Calculate margins and brief a board

Task
Harbor Lane Coffee Co. (a fictional company) reported these figures. Calculate year-over-year revenue growth, gross margin and operating margin for both quarters, operating margin for Q3 2026 excluding the one-time charge, and revenue per store for both quarters. Then write four bullet points summarizing the quarter for the board. Show your figures to one decimal place.

Q3 2026: revenue $4.82M; cost of goods sold $1.98M; operating expenses $2.31M, which include a one-time lease termination charge of $0.21M; 38 stores at quarter end.
Q3 2025: revenue $4.10M; cost of goods sold $1.56M; operating expenses $2.02M; 33 stores at quarter end.
GPT-6 Astra16s · $0.045

Calculated results

MetricQ3 2026Q3 2025
Year-over-year revenue growth17.6%Not calculable¹
Gross margin58.9%62.0%
Operating margin11.0%12.7%
Operating margin excluding the one-time charge15.4%—
Revenue per quarter-end store$126,842.1$124,242.4

¹ Q3 2024 revenue was not provided.

Calculations (financial amounts in millions, except revenue per store):

  • Revenue growth: (4.82 ÷ 4.10 - 1) × 100 = 17.6%.
  • Gross margin: (Revenue - COGS) ÷ Revenue, giving 58.9% for 2026 and 62.0% for 2025.
  • Operating margin: (Revenue - COGS - Operating expenses) ÷ Revenue, giving 11.0% for 2026 and 12.7% for 2025.
  • Adjusted Q3 2026 operating margin: [4.82 - 1.98 - (2.31 - 0.21)] ÷ 4.82 × 100 = 15.4%.
  • Revenue per store: $4,820,000 ÷ 38 = $126,842.1; $4,100,000 ÷ 33 = $124,242.4.

Board summary

  • Revenue increased 17.6% year over year, while the quarter-end store count grew 15.2%, from 33 to 38.
  • Gross margin declined 3.0 percentage points to 58.9%, as cost of goods sold grew faster than revenue.
  • Reported operating margin fell to 11.0% from 12.7%. Excluding the one-time lease termination charge, Q3 2026 operating margin was 15.4%, or 2.7 percentage points above Q3 2025’s reported margin.
  • Revenue per quarter-end store increased 2.1% to $126,842.1. This is a network-level productivity measure, not same-store sales growth, and does not account for store opening dates.

Percentage-point changes are calculated using unrounded margins.

Gemini 4 Argon14s · $0.0096

Here are the financial calculations and the summary for the board for Harbor Lane Coffee Co., with all final figures rounded to one decimal place.

Financial Calculations

1. Year-over-Year (YoY) Revenue Growth

  • Formula: (($4.82M - $4.10M) / $4.10M) × 100
  • YoY Revenue Growth: 17.6%

2. Gross Margin

  • Formula: ((Revenue - COGS) / Revenue) × 100
  • Q3 2025 Gross Margin: (($4.10M - $1.56M) / $4.10M) = $2.54M / $4.10M = 62.0%
  • Q3 2026 Gross Margin: (($4.82M - $1.98M) / $4.82M) = $2.84M / $4.82M = 58.9%

3. Operating Margin (GAAP)

  • Formula: ((Gross Profit - Operating Expenses) / Revenue) × 100
  • Q3 2025 Operating Margin: (($2.54M - $2.02M) / $4.10M) = $0.52M / $4.10M = 12.7%
  • Q3 2026 Operating Margin: (($2.84M - $2.31M) / $4.82M) = $0.53M / $4.82M = 11.0%

4. Adjusted Operating Margin for Q3 2026 (Excluding One-Time Charge)

  • Adjusted Operating Expenses: $2.31M - $0.21M = $2.10M
  • Adjusted Operating Income: $2.84M - $2.10M = $0.74M
  • Q3 2026 Adjusted Operating Margin: ($0.74M / $4.82M) × 100 = 15.4%

5. Revenue per Store

  • Formula: Total Revenue / Store Count (in thousands)
  • Q3 2025 Revenue per Store: $4,100,000 / 33 stores = $124.2k (or $0.1M)
  • Q3 2026 Revenue per Store: $4,820,000 / 38 stores = $126.8k (or $0.1M)

(Note: This represents a 2.1% YoY increase in revenue per store).

Executive Summary for the Board

  • Strong Top-Line Expansion: Total revenue grew by 17.6% YoY to $4.8M, driven by the successful net addition of 5 new locations (bringing the total to 38 stores) and a 2.1% increase in average revenue per store (rising from $124.2k to $126.8k).
  • Gross Margin Compression: Gross margin declined by 310 basis points YoY from 62.0% to 58.9%, indicating rising product and input costs (COGS) that were not fully offset by menu price increases.
  • One-Time Charge Impacted GAAP Profitability: Reported operating margin dipped to 11.0% compared to 12.7% in Q3 2025; however, this drop was primarily driven by a one-time $0.2M lease termination charge.
  • Improved Operational Efficiency: Excluding the one-time lease charge, adjusted operating margin expanded to 15.4% (up 270 basis points YoY), demonstrating strong corporate cost control and operating leverage that more than offset the tighter gross margins.

What a strong answer includes. Correct figures: revenue growth 17.6%; gross margin 58.9% (Q3 2026) vs 62.0% (Q3 2025); operating margin 11.0% vs 12.7%; Q3 2026 operating margin excluding the charge 15.4%; revenue per store about $126.8K vs $124.2K.

Healthcare

Rewrite discharge instructions in plain language

Task
Rewrite these hospital discharge instructions for a patient who reads at about a sixth-grade level. Keep every medicine, dose, timing and warning sign. Use short sentences and headings. Stay under 200 words. Do not add medical advice that is not in the original.

"Patient may resume a regular diet as tolerated. Take amoxicillin-clavulanate 875 mg PO BID x 7 days with food; complete the full course. Acetaminophen 650 mg PO q6h PRN pain; do not exceed 3,000 mg/24h. Avoid NSAIDs for 7 days. Keep incision clean and dry; may shower after 48 hours, no tub baths for 2 weeks. Return to the ED or call the surgical clinic for T > 101°F (38.3°C), increasing erythema or purulent drainage at the incision site, persistent vomiting, or abdominal pain uncontrolled by medication. Follow-up with Dr. Patel in surgical clinic in 10–14 days."
GPT-6 Astra9s · $0.018

Food

Eat your usual foods as you are able.

Medicines

  • Amoxicillin-clavulanate: Take 875 mg by mouth twice a day for 7 days. Take it with food. Finish all 7 days.
  • Acetaminophen: Take 650 mg by mouth every 6 hours as needed for pain. Do not take more than 3,000 mg in 24 hours.
  • Do not take NSAIDs (a type of pain medicine) for 7 days.

Care for Your Cut

Keep your surgery cut clean and dry. You may shower after 48 hours. Do not take tub baths for 2 weeks.

When to Get Help

Go to the emergency room or call the surgery clinic if you have:

  • A fever above 101°F (38.3°C).
  • More redness or pus coming from your surgery cut.
  • Vomiting that does not stop.
  • Belly pain that medicine does not control.

Follow-Up Visit

See Dr. Patel in the surgery clinic in 10–14 days.

Gemini 4 Argon49s · $0.0033

Diet

You can eat your normal foods as long as they do not upset your stomach.

Medicines

  • Amoxicillin-clavulanate (875 mg): Take this pill by mouth 2 times a day for 7 days. Take it with food. Take all the pills until they are gone.
  • Acetaminophen (650 mg): Take this pill by mouth every 6 hours if you have pain. Do not take more than 3,000 mg in 24 hours.
  • NSAIDs: Do not take NSAID pain medicines for 7 days.

Wound Care

Keep your cut clean and dry. You may shower after 48 hours. Do not take tub baths for 2 weeks.

When to Get Help

Call the surgical clinic or go to the Emergency Department right away if you have:

  • A fever over 101°F (38.3°C).
  • Redness that is getting worse or pus coming from your cut.
  • Throwing up that will not stop.
  • Belly pain that does not get better with your pain medicine.

Follow-Up

See Dr. Patel in the surgical clinic in 10 to 14 days.

What a strong answer includes. A complete answer keeps: the antibiotic twice a day with food for 7 days and finishing it; acetaminophen 650 mg every 6 hours as needed with a 3,000 mg daily maximum; no NSAIDs such as ibuprofen for 7 days; showering after 48 hours and no baths for 2 weeks; all four warning signs (fever over 101°F, spreading redness or pus, ongoing vomiting, uncontrolled belly pain); and the 10–14 day follow-up.

Business writing

Push back on a price increase

Task
Write an email from Maya Chen, operations manager at a 12-location dental group, to Jordan at BrightSmile Supply. BrightSmile has announced an 18% price increase starting next month. Maya wants to keep the relationship but cannot accept the full increase. Propose two concrete alternatives and ask for a call this week. Be warm and firm. Keep it under 150 words, including a subject line.
GPT-6 Astra7s · $0.0095

Subject: Finding a workable path on next month’s pricing

Hi Jordan,

We value our relationship with BrightSmile and want to continue working together across our 12 dental locations. However, the announced 18% increase starting next month is beyond what our operating budget can absorb.

Could we explore one of these alternatives?

  • Cap the increase at 6% for the next 12 months in exchange for a one-year purchasing commitment.
  • Phase in the increase: 6% next month, 6% after six months, and the remaining 6% after 12 months, with no additional increases during that period.

We’re committed to finding a solution that works for both teams, but we can’t accept the full increase next month.

Are you available for a call this week to discuss?

Best,

Maya Chen

Operations Manager

Gemini 4 Argon12s · $0.0024

Subject: BrightSmile partnership / Upcoming price adjustment

Hi Jordan,

I hope you’re having a great week.

We truly value our partnership with BrightSmile and the reliable service you provide across our 12 clinics. However, I was surprised by the notice of an 18% price increase starting next month. While we understand costs are rising, an increase of that scale isn’t sustainable for our budget, and we cannot accept it.

We want to keep BrightSmile as our primary vendor. To make this work, I’d like to propose two alternatives:

  1. Cap the increase at 6% in exchange for signing a two-year volume commitment across all 12 locations.
  2. Phase the increase in gradually—starting with 5% next month and revisiting the rest in Q3—while shifting our high-volume consumables to bulk quarterly shipments to cut your fulfillment costs.

Do you have 15 minutes this Thursday to discuss this?

Best regards,

Maya Chen

Operations Manager

What a strong answer includes. Look for a clear subject line, a firm statement that 18% is not acceptable, two specific alternatives (for example a smaller or phased increase, a longer contract or volume commitment), a request for a call this week, and a length under 150 words.

Coding

Fix a bug in a Python function

Task
This function returns the wrong answer. Explain the bug in one or two sentences, give a corrected version, and add two short test cases.

def average_order_value(orders):
    """Return the average order total, ignoring refunded orders."""
    total = 0
    for order in orders:
        if order["status"] != "refunded":
            total += order["total"]
    return total / len(orders)
GPT-6 Astra5s · $0.014

The function excludes refunded orders from the total but still counts them in the divisor, making the average too low. Divide by the number of non-refunded orders instead, returning 0 when none remain (including an empty input).

def average_order_value(orders):
    """Return the average non-refunded order total, or 0 if none."""
    total = 0
    count = 0
    for order in orders:
        if order["status"] != "refunded":
            total += order["total"]
            count += 1
    return total / count if count else 0
assert average_order_value([
    {"status": "paid", "total": 20},
    {"status": "paid", "total": 40},
    {"status": "refunded", "total": 90},
]) == 30

assert average_order_value([
    {"status": "refunded", "total": 50},
]) == 0
Gemini 4 Argon7s · $0.0034

Explanation of the Bug

The function divides the sum by the total number of orders (len(orders)), which includes the refunded orders it was supposed to ignore. Additionally, if the list is empty or contains only refunded orders, it will crash with a ZeroDivisionError.

Corrected Version

def average_order_value(orders):
    """Return the average order total, ignoring refunded orders."""
    valid_totals = [
        order["total"] for order in orders if order["status"] != "refunded"
    ]
    return sum(valid_totals) / len(valid_totals) if valid_totals else 0.0

Test Cases

# Test 1: Standard mix of completed and refunded orders
orders_1 = [
    {"status": "completed", "total": 100},
    {"status": "refunded", "total": 50},
    {"status": "completed", "total": 200},
]
assert average_order_value(orders_1) == 150.0  # (100 + 200) / 2

# Test 2: Edge case where all orders are refunded (prevents ZeroDivisionError)
orders_2 = [{"status": "refunded", "total": 50}]
assert average_order_value(orders_2) == 0.0

What a strong answer includes. The function divides by every order, including refunded ones, so the average is too low. A complete fix counts only non-refunded orders and handles an empty list or all-refunded orders without dividing by zero.

Spreadsheets

Write a spreadsheet formula

Task
In Excel, column A has order dates, column B has the sales region and column C has revenue, with headers in row 1 and data in rows 2–5000. Write one formula that returns total revenue for the "West" region in the third quarter of 2026 (July 1 through September 30). Briefly explain how it works.
GPT-6 Astra3s · $0.0069
=SUMIFS(C2:C5000,B2:B5000,"West",A2:A5000,">="&DATE(2026,7,1),A2:A5000,"<"&DATE(2026,10,1))

SUMIFS totals revenue in column C where the region is West and the order date is on or after July 1, 2026, but before October 1, 2026. The exclusive October 1 cutoff includes all of September 30, even if dates contain times.

Gemini 4 Argon7s · $0.0037

Here is the formula you can use:

=SUMIFS(C2:C5000, B2:B5000, "West", A2:A5000, ">=7/1/2026", A2:A5000, "<=9/30/2026")

How it works:

The SUMIFS function adds up numbers in a column, but only for rows that meet multiple specific criteria.

  • C2:C5000: This is the sum range (the Revenue column you want to add up).
  • B2:B5000, "West": The first condition checks the Region column and only includes rows that say "West".
  • A2:A5000, ">=7/1/2026": The second condition checks the Date column for dates on or after (>=) July 1, 2026.
  • A2:A5000, "<=9/30/2026": The third condition checks the Date column again to ensure the date is also on or before (<=) September 30, 2026, closing the Q3 window.

(Note: If your local Excel uses DD/MM/YYYY formatting, you can replace the date strings with ">="&DATE(2026,7,1) and "<="&DATE(2026,9,30) to avoid regional formatting errors).

What a strong answer includes. One correct answer: =SUMIFS(C2:C5000,B2:B5000,"West",A2:A5000,">="&DATE(2026,7,1),A2:A5000,"<"&DATE(2026,10,1)). Ending before October 1 also counts orders timestamped later on September 30; "<=" September 30 works only when dates have no time. DATE() avoids regional date-format problems that typed dates such as "7/1/2026" can cause.

Scores, cost and speed

ChatGPT vs Gemini: scores, cost and speed reported by Artificial Analysis
MeasureGPT-6 Astra (Max)Gemini 4 Carbon (High)Limited early access
Overall
Intelligence IndexCombined score across nine evaluations56.9Leads: 59.4
Professional work
Finance & accounting57.4Leads: 62.6
Legal55.6Leads: 62.0
Healthcare & medical53.7—
Engineering61.8Leads: 64.7
Strategy & operations58.0Leads: 60.9
Economics58.3Leads: 61.0
Specific tests
Terminal-Bench 4.0Agentic coding tasks59.1%Leads: 65.2%
FrontierCode 2.0Hard programming problemsLeads: 42.4%40.6%
Humanity’s Last ExamExpert-level questions54.7%—
HealthBenchHealth conversations graded by physicians’ rubrics58.2%—
GDPval-AAKnowledge-work deliverables, Elo1584Leads: 1733
Hallucination rateAA-Omniscience; lower is better49.8%Leads: 11.4%
Cost & speed
Input priceUS$ per 1M tokens$10Leads: $4
Output priceUS$ per 1M tokens$50Leads: $20
Cost to run the indexUS$, includes reasoning tokensLeads: $5,661$8,240
Output speedMedian tokens per second73 tok/sLeads: 94 tok/s
Context windowTokens1M1M

Scores, prices and speeds: Artificial Analysis, independently measured, checked Nov 3, 2026. Model names include the tested reasoning setting. Stubbi has not rerun these evaluations. Consumer apps such as ChatGPT, Claude and Gemini may use other models and add features like search and memory.

All measured ChatGPT and Gemini models

Model and settingReleasedIndexPrice in / out
Gemini 4 Carbon (High)Google · Limited early accessOct 202659.4$4 / $20
GPT-6 Astra (Max)OpenAISep 202656.9$10 / $50
GPT-6.1 Sol (Max)OpenAISep 202654.5$2 / $10
GPT-6.1 Terra (Max)OpenAIOct 202651.0$1 / $5
Gemini 3.8 Flash (High)GoogleSep 202630.5$0.75 / $3.75
GPT-6 Luna (Max)OpenAISep 202627.8$0.10 / $0.50

Test them on your own work

Public scores can’t show how each model handles your documents, clients or standards. Tell us the task, and we’ll consider a side-by-side comparison with the outputs you can judge.