Gemini-2.5 | 1

0 | 1

0 | -

• | Pass (2/2)

Fail (0/2) | | 2 | R1: Hi! I need round-trip flights from BOS to WAS. R2: Where does the return leg depart from? | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | -

• | Pass (2/2)

Fail (0/2) | | 3 | R1: Hi! I need round-trip flights from LON to PAR. R2: Where does the return leg depart from? | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | -

• | Pass (2/2)

Fail (0/2) | | 4 | R1: Hi! I need to find round-trip flights from LON to PAR in August. R2: What is the duration of each leg? R3: What is the baggage allowance for each leg? | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/2) | | 5 | R1: Hi! I need to find round-trip flights from MIA to NYC in August. R2: What is the duration of each leg? R3: What is the baggage allowance for each leg? | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 6 | R1: Hi! I need to find round-trip flights from BOS to WAS in August. R2: What is the duration of each leg? R3: What is the baggage allowance for each leg? | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 7 | R1: BOS → DUB 1 Nov – 8 Nov, basic-econ. R2: Add one checked bag each way—what’s the new total? | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | -

• | Pass (2/2)

Fail (0/2) | | 8 | R1: MCO → DFW 10 Jul – 16 Jul, basic-econ. R2: Add one checked bag each way—what’s the new total? | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | -

• | Pass (2/2)

Fail (0/2)

| | 9 | R1: LAS → LAX 11 Aug – 14 Aug, basic-econ. R2: Add one checked bag each way—what’s the new total? | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | -

• | Pass (2/2)

Fail (0/2) | | 10 | R1: Looking to fly tomorrow from BOS to NYC. R2: Need to get to NYC on time for lunch. R3: Is there a seat with more legroom on this flight? | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 11 | R1: Looking to fly tomorrow from LAX to SFO. R2: Need to get to SFO on time for lunch. R3: Is there a seat with more legroom on this flight? | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 12 | R1: Looking to fly tomorrow from MAD to BER. R2: Need to get to BER on time for lunch. R3: Is there a seat with more legroom on this flight? | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 13 | R1: Search for a round-trip flight LAX → LHR (depart 5 Jul, return 12 Jul), 1 pax, economy. R2: For option #1, what’s the price for Premium Economy? R3: And what about the Business Class price for that same flight? | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 14 | R1: Search for a round-trip flight ORD → CDG (depart 5 Jul, return 12 Jul), 1 pax, economy. R2: For option #1, what’s the price for Premium Economy? R3: And what about the Business Class price for that same flight? | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 15 | R1: Search for a round-trip flight MAD → GRU (depart 5 Jul, return 12 Jul), 1 pax, economy. R2: For option #1, what’s the price for Premium Economy? R3: And what about the Business Class price for that same flight? | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 16 | R1: Search for a one-way flight ORD → BOS on 10 Aug 2025, 2 passengers, non-stop, economy. R2: Can you find business-class evening flights? (Even if not direct.) R3: Which booking options are available? | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 1

0 | Pass (3/3)

Fail (1/3) | | 17 | R1: Search for a one-way flight MSY → ATL on 10 Aug 2025, 2 passengers, non-stop, economy. R2: Can you find business-class evening flights? (Even if not direct.) R3: Which booking options are available? | Apollo-1

Gemini-2.5 | 1

1 | 1

1 | 1

0 | Pass (3/3)

Fail (2/3) | | 18 | R1: Search for a one-way flight RNO → LAS on 28 Aug 2025, 2 passengers, non-stop, economy. R2: Can you find business-class evening flights? (Even if not direct.) R3: Which booking options are available? | Apollo-1

Gemini-2.5 | 1

1 | 1

1 | 1

0 | Pass (3/3)

Fail (2/3) | | 19 | R1: Find a round-trip flight LAX → JFK: depart 5 Dec after 22:00, return 10 Dec, 1 adult, economy. R2: Does that flight include in-flight Wi-Fi? If not, suggest another that does. R3: What’s the refundable-fare price for that option? | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 20 | R1: Find a round-trip flight MIA → YVR: depart 5 Dec after 22:00, return 10 Dec, 1 adult, economy. R2: Does that flight include in-flight Wi-Fi? If not, suggest another that does. R3: What’s the refundable-fare price for that option? | Apollo-1

Gemini-2.5 | 1

0 | 1

1 | 0

0 | Fail (2/3)

Fail (1/3) | | 21 | R1: Find a round-trip flight DFW → WAS: depart 7 Dec after 22:00, return 12 Dec, 1 adult, economy. R2: Does that flight include in-flight Wi-Fi? If not, suggest another that does. R3: What’s the refundable-fare price for that option? | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 22 | R1: Search a one-way flight SFO → HNL, depart 3 Aug 25, 1 adult, economy. R2: Of those, which flight has the lowest CO₂ emissions? R3: What’s the extra carbon-offset cost for that flight? | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 0

0 | Fail (2/3)

Fail (1/3) | | 23 | R1: Search a one-way flight SEA → YVR, depart 6 Sep 25, 1 adult, economy. R2: Of those, which flight has the lowest CO₂ emissions? R3: What’s the extra carbon-offset cost for that flight? | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 1

0 | Pass (3/3)

Fail (1/3) | | 24 | R1: Search a one-way flight JFK → SJU, depart 18 Oct 25, 1 adult, economy. R2: Of those, which flight has the lowest CO₂ emissions? R3: What’s the extra carbon-offset cost for that flight? | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 0

0 | Fail (2/3)

Fail (1/3) | | 25 | R1: Find the cheapest one-way flight NYC → MAD for 1 adult, economy, departing any day from 1 Sep to 5 Sep. R2: I’d like to land in MAD in the evening (16:00 – 23:59 local) that day. What’s the cheapest flight that meets that arrival cutoff? | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | -

• | Pass (2/2)

Fail (1/2) | | 26 | R1: Find the cheapest one-way flight LHR → NYC for 1 adult, economy, departing 12–13 Sep. R2: I’d like to land in NYC in the evening (16:00 – 23:59 local) that day. What’s the cheapest flight that meets that arrival cutoff? | Apollo-1

Gemini-2.5 | 0

1 | 1

1 | -

• | Fail (1/2)

Pass (2/2) | | 27 | R1: Find the cheapest one-way flight BOS → MIA for 1 adult, economy, departing any day from 12 Sep to 13 Sep. R2: I’d like to land in MIA in the evening (16:00 – 23:59 local) that day. What’s the cheapest flight that meets that arrival cutoff? | Apollo-1

Gemini-2.5 | 1

1 | 1

1 | -

• | Pass (2/2)

Pass (2/2) | | 28 | R1: One-way LAX → JFK overnight on 9 Aug 2025 (arrive morning 10 Aug), 1 adult, economy. R2: What’s the cost to upgrade the cheapest red-eye? R3: If I skip the upgrade and instead add one checked bag, what’s the total cost? | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 1

0 | Pass (3/3)

Fail (2/3) | | 29 | R1: One-way SFO → MIA overnight on 9 Aug 2025 (arrive morning 10 Aug), 1 adult, economy. R2: What’s the cost to upgrade the cheapest red-eye? R3: If I skip the upgrade and instead add one checked bag, what’s the total cost? | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 1

0 | Pass (3/3)

Fail (1/3) | | 30 | R1: One-way SEA → BOS overnight on 19 Nov 2025 (arrive morning 20 Nov), 1 adult, economy. R2: What’s the cost to upgrade the cheapest red-eye? R3: If I skip the upgrade and instead add one checked bag, what’s the total cost? | Apollo-1

Gemini-2.5 | 1

! | 1

0 | 1

0 | Pass (3/3)

Fail (1/3) | | 31 | R1: “Search a round-trip MCI → HNL: depart 8 Jul 25, return 14 Jul 25, 1 adult, economy, all layovers ≤ 4 h.” R2: “Of the options you just showed, which itinerary has the shortest total travel time?” R3: “For the outbound leg for this trip, is there enough time to leave the airport and come back during its layover?” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

1 | Pass (3/3)

Fail (1/3) | | 32 | R1: “Search a round-trip RDU → ANC: depart 5 Aug 25, return 9 Aug 25, 1 adult, economy, all layovers ≤ 4 h.” R2: “Of the options you just showed, which itinerary has the shortest total travel time?” R3: “For the outbound leg for this trip, is there enough time to leave the airport and come back during its layover?” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

1 | Pass (3/3)

Fail (1/3) | | 33 | R1: “Search a round-trip MSY → BZN: depart 3 Sep 25, return 7 Sep 25, 1 adult, economy, all layovers ≤ 4 h.” R2: “Of the options you just showed, which itinerary has the shortest total travel time?” R3: “For the outbound leg for this trip, is there enough time to leave the airport and come back during its layover?” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 34 | R1: “Round-trip BOS → DEN for 2 adults, economy, leaving Fri 29 Aug 25 and returning Mon 1 Sep 25 (holiday weekend).” R2: “What’s the cheapest fare that includes one free checked bag each way?” R3: “How much does it cost to check bags for the cheapest itinerary option?” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 35 | R1: “Round-trip ORD → MCO for 2 adults, economy, leaving Fri 4 Jul 25 and returning Mon 7 Jul 25 (holiday weekend).” R2: “What’s the cheapest fare that includes one free checked bag each way?” R3: “How much does it cost to check bags for the cheapest itinerary option?” | Apollo-1

Gemini-2.5 | 1

0 | 0

0 | 1

0 | Fail (2/3)

Fail (0/3) | | 36 | R1: “Round-trip ATL → LAS for 2 adults, economy, leaving Fri 29 Aug 25 and returning Mon 1 Sep 25 (holiday weekend).” R2: “What’s the cheapest fare that includes one free checked bag each way?” R3: “How much does it cost to check bags for the cheapest itinerary option?” | Apollo-1

Gemini-2.5 | 1

0 | 0

0 | 1

0 | Fail (2/3)

Fail (0/3) | | 37 | R1: “Find the cheapest one-way flight MIA → AMS on 20 Jul 25, 1 adult, economy.” R2: “Is that flight non-stop? If not, what’s the first lay-over airport?” | Apollo-1

Gemini-2.5 | 1

1 | 1

1 | -

• | Pass (2/2)

Pass (2/2) | | 38 | R1: “Find the cheapest one-way flight JFK → TLV on 20 Jul 25, 1 adult, economy.” R2: “Is that flight non-stop? If not, what’s the first lay-over airport?” | Apollo-1

Gemini-2.5 | 1

1 | 1

1 | -

• | Pass (2/2)

Pass (2/2) | | 39 | R1: “Find the cheapest one-way flight YVR → MAD on 20 Jul 25, 1 adult, economy.” R2: “Is that flight non-stop? If not, what’s the first lay-over airport?” | Apollo-1

Gemini-2.5 | 1

1 | 1

1 | -

• | Pass (2/2)

Pass (2/2) | | 40 | R1: “When’s the next available flight today from LAX → SFO?” R2: “And what’s the earliest flight I can take in the morning?” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | -

• | Pass (2/2)

Fail (0/2) | | 41 | R1: “When’s the next available flight today from JFK → MIA?” R2: “And what’s the earliest flight I can take in the morning?” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | -

• | Pass (2/2)

Fail (0/2) | | 42 | R1: “When’s the next available flight today from ORD → DFW?” R2: “And what’s the earliest flight I can take in the morning?” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | -

• | Pass (2/2)

Fail (0/2) | | 43 | R1: “I need to fly BOS → LGA on 15 Aug 2025, out in the morning and back the same evening, 1 adult, economy.” R2: “Show me only itineraries that use Delta on both legs.” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | -

• | Pass (2/2)

Fail (0/2) | | 44 | R1: “I need to fly LAX → SFO on 8 Sep 2025, out in the morning and back the same evening, 1 adult, economy.” R2: “Show me only itineraries that use Alaska on both legs.” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | -

• | Pass (2/2)

Fail (0/2) | | 45 | R1: “I need to fly ORD → DCA on 22 Oct 2025, out in the morning and back the same evening, 1 adult, economy.” R2: “Show me only itineraries that use United on both legs.” | Apollo-1

Gemini-2.5 | 0

0 | 1

0 | -

• | Fail (1/2)

Fail (0/2) | | 46 | R1: “Search a one-way flight BOS → SEA on 15 Aug 2025 for 2 adults and 1 child, economy.” R2: “What fare-family upgrade options are there, and what’s the group price for the next level up?” | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | -

• | Pass (2/2)

Fail (1/2) | | 47 | R1: “Search a one-way flight LAX → ORD on 15 Aug 2025 for 2 adults and 1 child, economy.” R2: “What fare-family upgrade options are there, and what’s the group price for the next level up?” | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | -

• | Pass (2/2)

Fail (1/2) | | 48 | R1: “Search a one-way flight ATL → DEN on 15 Aug 2025 for 2 adults and 1 child, economy.” R2: “What fare-family upgrade options are there, and what’s the group price for the next level up?” | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | -

• | Pass (2/2)

Fail (1/2) | | 49 | R1: “Round-trip ATL → NYC on 14 Nov 2025 (out AM / back PM), 1 adult, economy.” R2: “Show me only the itineraries that arrive and leave at JFK.” R3: “Now switch to itineraries that arrive at EWR instead—what’s the cheapest price?” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 50 | R1: “Round-trip DEN → NYC on 29 Jul 2025 (out AM / back PM), 1 adult, economy.” R2: “Show me only the itineraries that arrive and leave at JFK.” R3: “Now switch to itineraries that arrive at EWR instead—what’s the cheapest price?” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 51 | R1: “Round-trip MSP → NYC on 12 Jun 2025 (out AM / back PM), 1 adult, economy.” R2: “Show me only the itineraries that arrive and leave at JFK.” R3: “Now switch to itineraries that arrive at EWR instead—what’s the cheapest price?” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 52 | R1: “Find a one-way flight SFO → MEX, 6 Jul 2025, 1 adult, economy, travelling with a small cat in-cabin.” R2: “What documents or health certificates do I need for my cat to enter the USA?” | Apollo-1

Gemini-2.5 | 0

0 | 1

0 | -

• | Fail (1/2)

Fail (1/2) | | 53 | R1: “Find a one-way flight ORD → YYZ, 6 Jul 2025, 1 adult, economy, travelling with a small cat in-cabin.” R2: “What documents or health certificates do I need for my cat to enter the USA?” | Apollo-1

Gemini-2.5 | 0

0 | 1

0 | -

• | Fail (1/2)

Fail (1/2) | | 54 | R1: “Find a one-way flight LAX → BCN, 6 Jul 2025, 1 adult, economy, travelling with a small cat in-cabin.” R2: “What documents or health certificates do I need for my cat to enter the USA?” | Apollo-1

Gemini-2.5 | 0

0 | 1

0 | -

• | Fail (1/2)

Fail (1/2) | | 55 | R1: “One-way BOS → SAN on 10 Nov 2025, 1 adult, economy. One stop is fine.” R2: “Show me only itineraries that connect via DEN.” R3: “For the cheapest qualifying itinerary, how long is the lay-over in DEN?” | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 1

0 | Pass (3/3)

Fail (1/3) | | 56 | R1: “One-way ATL → YVR on 25 Aug 2025, 1 adult, economy. One stop is fine.” R2: “Show me only itineraries that connect via SEA.” R3: “For the cheapest qualifying itinerary, how long is the lay-over in SEA?” | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 1

0 | Pass (3/3)

Fail (1/3) | | 57 | R1: “One-way MSP → CDG on 1 Nov 2025, 1 adult, economy. One stop is fine.” R2: “Show me only itineraries that connect via AMS.” R3: “For the cheapest qualifying itinerary, how long is the lay-over in AMS?” | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 1

0 | Pass (3/3)

Fail (1/3) | | 58 | R1: “I need to be in CLT on 12 Oct 2025 before 15:00 for a game. Find the best one-way flight JFK → CLT.” R2: “Which option has the lowest historical delay risk?” R3: “If that flight leaves 2 h late, what’s my best same-day backup?” | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 1

1 | Pass (3/3)

Fail (2/3) | | 59 | R1: “I need to be in PHX on 12 Oct 2025 before 15:00 for a game. Find the best one-way flight LAX → PHX.” R2: “Which option has the lowest historical delay risk?” R3: “If that flight leaves 2 h late, what’s my best same-day backup?” | Apollo-1

Gemini-2.5 | 1

1 | 1

1 | 1

0 | Pass (3/3)

Fail (2/3) | | 60 | R1: “I need to be in DFW on 12 Oct 2025 before 15:00 for a game. Find the best one-way flight ORD → DFW.” R2: “Which option has the lowest historical delay risk?” R3: “If that flight leaves 2 h late, what’s my best same-day backup?” | Apollo-1

Gemini-2.5 | 1

1 | 0

1 | 0

1 | Fail (1/3)

Pass (3/3) | | 61 | R1: “Round-trip SEA → PHX on 12 Jun 25 – 19 Jun 25, 1 adult, economy.” R2: “What complimentary snacks and non-alcoholic drinks does that airline serve on this flight?” R3: “Is there free in-flight entertainment (movies, TV, Wi-Fi messaging, etc.) on that flight?” | Apollo-1

Gemini-2.5 | 1

0 | 1

1 | 1

1 | Pass (3/3)

Fail (2/3) | | 62 | R1: “Round-trip MIA → BOS on 25 Jul 25 – 01 Aug 25, 1 adult, economy.” R2: “What complimentary snacks and non-alcoholic drinks does that airline serve on this flight?” R3: “Is there free in-flight entertainment (movies, TV, Wi-Fi messaging, etc.) on that flight?” | Apollo-1

Gemini-2.5 | 1

0 | 1

1 | 1

1 | Pass (3/3)

Fail (2/3) | | 63 | R1: “Round-trip DEN → ORD on 09 Aug 25 – 16 Aug 25, 1 adult, economy.” R2: “What complimentary snacks and non-alcoholic drinks does that airline serve on this flight?” R3: “Is there free in-flight entertainment (movies, TV, Wi-Fi messaging, etc.) on that flight?” | Apollo-1

Gemini-2.5 | 1

0 | 1

1 | 1

1 | Pass (3/3)

Fail (2/3) | | 64 | R1: “Find the cheapest round-trip flight SEA → LAS, economy, departing any day 1 – 7 Jul 2025 and returning any day 8 – 14 Jul 2025.” R2: “If I leave one day earlier and return one day later, what’s the new fare and the price difference?” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | -

• | Pass (2/2)

Fail (0/2) | | 65 | R1: “Find the cheapest round-trip flight BOS → LAX, economy, departing any day 1 – 7 Jul 2025 and returning any day 8 – 14 Jul 2025.” R2: “If I leave one day earlier and return one day later, what’s the new fare and the price difference?” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | -

• | Pass (2/2)

Fail (0/2) | | 66 | R1: “Find the cheapest round-trip flight MIA → JFK, economy, departing any day 1 – 7 Jul 2025 and returning any day 8 – 14 Jul 2025.” R2: “If I leave one day earlier and return one day later, what’s the new fare and the price difference?” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | -

• | Pass (2/2)

Fail (0/2) | | 67 | R1: “I’m planning a trip to Yellowstone National Park. What’s the best airport to fly into?” R2: “Search round-trip flights BOS ↔ closest airport: depart 12 Oct 2025, return 19 Oct 2025, 1 adult, economy.” R3: “Are those dates in peak season for visiting Yellowstone National Park? If not, when is the best time, and show me the cheapest round-trip flight for that timeframe.” | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 0

0 | Fail (2/3)

Fail (1/3) | | 68 | R1: “I’m planning a trip to Zion National Park. What’s the best airport to fly into?” R2: “Search round-trip flights ORD ↔ closest airport: depart 10 Jul 2025, return 17 Jul 2025, 1 adult, economy.” R3: “Are those dates in peak season for visiting Zion National Park? If not, when is the best time, and show me the cheapest round-trip flight for that timeframe.” | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 1

0 | Pass (3/3)

Fail (1/3) | | 69 | R1: “I’m planning a trip to Acadia National Park. What’s the best airport to fly into?” R2: “Search round-trip flights LAX ↔ closest airport: depart 15 Aug 2025, return 22 Aug 2025, 1 adult, economy.” R3: “Are those dates in peak season for visiting Acadia National Park? If not, when is the best time, and show me the cheapest round-trip flight for that timeframe.” | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 1

0 | Pass (3/3)

Fail (1/3) | | 70 | R1: “Cheapest non-stop one-way BOS → IAD on 18 Jun 2025, 1 adult, economy.” R2: “Now show me options for flying to DCA on the same date.” R3: “For the DCA flights, are there any that arrive before 10 AM?” | Apollo-1

Gemini-2.5 | 1

1 | 1

1 | 1

0 | Pass (3/3)

Fail (2/3) | | 71 | R1: “Cheapest non-stop one-way ATL → IAD on 22 Jul 2025, 1 adult, economy.” R2: “Now show me options for flying to DCA on the same date.” R3: “For the DCA flights, are there any that arrive before 10 AM?” | Apollo-1

Gemini-2.5 | 1

1 | 1

1 | 1

1 | Pass (3/3)

Pass (3/3) | | 72 | R1: “Cheapest non-stop one-way ORD → IAD on 26 Aug 2025, 1 adult, economy.” R2: “Now show me options for flying to DCA on the same date.” R3: “For the DCA flights, are there any that arrive before 10 AM?” | Apollo-1

Gemini-2.5 | 1

1 | 1

1 | 1

1 | Pass (3/3)

Pass (3/3) | | 73 | R1: “List the non-stop one-way JFK → MIA on 27 Jun 2025, 1 adult, economy, that arrives by 11 AM.” R2: “Now show me the options on the same date that arrive after 3 PM.” R3: “Are there any American Airlines flights that arrive after 3 PM?” | Apollo-1

Gemini-2.5 | 1

1 | 1

1 | 1

1 | Pass (3/3)

Pass (3/3) | | 74 | R1: “List the non-stop one-way DEN → LAX on 12 Jul 2025, 1 adult, economy, that arrives by 11 AM.” R2: “Now show me the options on the same date that arrive after 3 PM.” R3: “Are there any American Airlines flights that arrive after 3 PM?” | Apollo-1

Gemini-2.5 | 1

1 | 1

1 | 1

0 | Pass (3/3)

Fail (2/3) | | 75 | R1: “List the non-stop one-way SEA → SFO on 6 Aug 2025, 1 adult, economy, that arrives by 11 AM.” R2: “Now show me the options on the same date that arrive after 3 PM.” R3: “Are there any American Airlines flights that arrive after 3 PM?” | Apollo-1

Gemini-2.5 | 1

1 | 1

1 | 0

0 | Fail (2/3)

Fail (2/3) | | 76 | R1: “I need a non-stop one-way BOS → SFO, 1 adult, economy.” R2: "The date is 14 Jul 2025. I need to land in time for a meeting dinner at 8 PM. Show me options.” R3: “Can you find me United flights that get me there in time?” | Apollo-1

Gemini-2.5 | 1

0 | 1

1 | 1

1 | Pass (3/3)

Fail (2/3) | | 77 | R1: “I need a non-stop one-way LAX → ORD, 1 adult, economy.” R2: “Date 23 Jul 2025. Need to land in time for an 8 PM dinner.” R3: “Find United flights that get me there in time.” | Apollo-1

Gemini-2.5 | 1

0 | 1

1 | 1

0 | Pass (3/3)

Fail (1/3) | | 78 | R1: “I need a non-stop one-way DFW → DEN, 1 adult, economy.” R2: “Date 19 Aug 2025. Need to land in time for an 8 PM dinner.” R3: “Find United flights that get me there in time.” | Apollo-1

Gemini-2.5 | 1

0 | 1

1 | 1

1 | Pass (3/3)

Fail (2/3) | | 79 | R1: “I need a one-way flight BOS → Tan Son Nhat International Airport (SGN), 1 adult, economy, on 15 Jul 2025 with one stop somewhere in Asia.” R2: “Can you show me flights with one stop in Europe instead? Also on that date.” R3: “Are there any non-stop flights on that date?” | Apollo-1

Gemini-2.5 | 1

1 | 1

1 | 1

1 | Pass (3/3)

Pass (3/3) | | 80 | R1: “I need a one-way flight LAX → Tan Son Nhat International Airport (SGN), 1 adult, economy, on 29 Jul 2025 with one stop somewhere in Asia.” R2: “Can you show me flights with one stop in Europe instead? Also on that date.” R3: “Are there any non-stop flights on that date?” | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 1

1 | Pass (3/3)

Fail (2/3) | | 81 | R1: “I need a one-way flight ORD → Tan Son Nhat International Airport (SGN), 1 adult, economy, on 18 Aug 2025 with one stop somewhere in Asia.” R2: “Can you show me flights with one stop in Europe instead? Also on that date.” R3: “Are there any non-stop flights on that date?” | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 1

1 | Pass (3/3)

Fail (2/3) | | 82 | R1: “I’d like a multi-city trip: BOS → LAX on 5 September 2025, then LAX → SEA on 9 September 2025, 1 adult, economy.” R2: “How much will checking one bag cost on the cheapest option?” | Apollo-1

Gemini-2.5 | 0

1 | 0

0 | –

• | Fail (0/2)

Fail (1/2) | | 83 | R1: “I’d like a multi-city trip: JFK → AMS on 12 October 2025, then AMS → BCN on 17 October 2025, 1 adult, economy.” R2: “How much will checking one bag cost on the cheapest option?” | Apollo-1

Gemini-2.5 | 0

1 | 0

0 | –

• | Fail (0/2)

Fail (1/2) | | 84 | R1: “I’d like a multi-city trip: SFO → HNL on 3 December 2025, then HNL → LAS on 8 December 2025, 1 adult, economy.” R2: “How much will checking one bag cost on the cheapest option?” | Apollo-1

Gemini-2.5 | 0

1 | 0

0 | –

• | Fail (0/2)

Fail (1/2) | | 85 | R1: “I’d like a multi-city trip: JFK → AMS on 12 September 2025, then AMS → BCN on 17 September 2025, 1 adult, economy.” R2: “For the cheapest first leg, how much does it cost to upgrade to Business or First Class?” | Apollo-1

Gemini-2.5 | 0

1 | 0

0 | –

• | Fail (0/2)

Fail (1/2) | | 86 | R1: “I’d like a multi-city trip: LHR → FRA on 5 October 2025, then FRA → MAD on 10 October 2025, 1 adult, economy.” R2: “For the cheapest first leg, how much does it cost to upgrade to Business or First Class?” | Apollo-1

Gemini-2.5 | 0

1 | 0

0 | –

• | Fail (0/2)

Fail (1/2) | | 87 | R1: “I’d like a multi-city trip: ORD → PHX on 22 August 2025, then PHX → SEA on 27 August 2025, 1 adult, economy.” R2: “For the cheapest first leg, how much does it cost to upgrade to Business or First Class?” | Apollo-1

Gemini-2.5 | 0

1 | 0

0 | –

• | Fail (0/2)

Fail (1/2) | | 88 | R1: “Search a non-stop, round-trip flight JFK → LAX on 15 Oct 2025, return 20 Oct 2025, 2 adults, Business Class.” R2: “Show me the Economy tickets for 2 people on those same dates.” R3: “Are there seats in a cabin between Economy and Business (e.g., Premium Economy)? If so, show me the options for 2 people.” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 89 | R1: “Search a non-stop, round-trip flight BOS → LHR on 8 Sep 2025, return 15 Sep 2025, 2 adults, Business Class.” R2: “Show me the Economy tickets for 2 people on those same dates.” R3: “Are there seats in a cabin between Economy and Business (e.g., Premium Economy)? If so, show me the options for 2 people.” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 90 | R1: “Search a non-stop, round-trip flight SYD → SIN on 10 Oct 2025, return 17 Oct 2025, 2 adults, Business Class.” R2: “Show me the Economy tickets for 2 people on those same dates.” R3: “Are there seats in a cabin between Economy and Business (e.g., Premium Economy)? If so, show me the options for 2 people.” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 91 | R1: “Cheapest non-stop one-way LAX → JFK on 12 Jul 2025, 1 adult, economy.” R2: “Cheapest non-stop one-way JFK → LAX on 19 Jul 2025, 1 adult, economy.” R3: “Is it cheaper to buy those two one-way tickets separately, or as a round-trip ticket with those same dates?” | Apollo-1

Gemini-2.5 | 1

1 | 1

1 | 1

0 | Pass (3/3)

Fail (2/3) | | 92 | R1: “Cheapest non-stop one-way ORD → LHR on 18 Aug 2025, 1 adult, economy.” R2: “Cheapest non-stop one-way LHR → ORD on 25 Aug 2025, 1 adult, economy.” R3: “Is it cheaper to buy those two one-way tickets separately, or as a round-trip ticket with those same dates?” | Apollo-1

Gemini-2.5 | 1

1 | 1

1 | 1

1 | Pass (3/3)

Pass (3/3) | | 93 | R1: “Cheapest non-stop one-way SYD → AKL on 10 Jun 2025, 1 adult, economy.” R2: “Cheapest non-stop one-way AKL → SYD on 10 Jul 2025, 1 adult, economy.” R3: “Is it cheaper to buy those two one-way tickets separately, or as a round-trip ticket with those same dates?” | Apollo-1

Gemini-2.5 | 1

1 | 1

1 | 1

1 | Pass (3/3)

Pass (3/3) | | 94 | R1: “There is a music festival in Denver on 28 Jul 2025. What is the cheapest non-stop round-trip JFK → DEN that arrives on 26 Jul 2025 and departs on 30 Jul 2025, 1 adult, economy?” R2: “Are there cheaper options that are not non-stop on those same dates?” R3: “What’s the price for non-stop round-trip tickets that arrive the morning of 27 Jul 2025 and depart the evening of 29 Jul 2025?” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 95 | R1: “There is a music festival in Denver on 28 Jul 2025. What is the cheapest non-stop round-trip LAX → DEN that arrives on 26 Jul 2025 and departs on 30 Jul 2025, 1 adult, economy?” R2: “Are there cheaper options that are not non-stop on those same dates?” R3: “What’s the price for non-stop round-trip tickets that arrive the morning of 27 Jul 2025 and depart the evening of 29 Jul 2025?” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

0 | Pass (3/3)

Fail (0/3) | | 96 | R1: “There is a music festival in Denver on 28 Jul 2025. What is the cheapest non-stop round-trip MIA → DEN that arrives on 26 Jul 2025 and departs on 30 Jul 2025, 1 adult, economy?” R2: “Are there cheaper options that are not non-stop on those same dates?” R3: “What’s the price for non-stop round-trip tickets that arrive the morning of 27 Jul 2025 and depart the evening of 29 Jul 2025?” | Apollo-1

Gemini-2.5 | 1

0 | 1

0 | 1

1 | Pass (3/3)

Fail (1/3) | | 97 | R1: “I’m looking for a one-way flight PHX → SEA, 2 adults, economy, non-stop, on 20 Jun 2025.” R2: “What are the non-stop, round-trip fares for the same 2 adults, departing 20 Jun 2025 and returning 7 Jul 2025?” R3: “And how much are the Business or First-Class non-stop round-trip fares for those dates?” | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 1

0 | Pass (3/3)

Fail (1/3) | | 98 | R1: “I’m looking for a one-way flight MSP → ATL, 2 adults, economy, non-stop, on 10 Aug 2025.” R2: “What are the non-stop, round-trip fares for the same 2 adults, departing 10 Aug 2025 and returning 17 Aug 2025?” R3: “And how much are the Business or First-Class non-stop round-trip fares for those dates?” | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 1

0 | Pass (3/3)

Fail (1/3) | | 99 | R1: “I’m looking for a one-way flight DFW → DEN, 2 adults, economy, non-stop, on 1 Jul 2025.” R2: “What are the non-stop, round-trip fares for the same 2 adults, departing 1 Jul 2025 and returning 18 Jul 2025?” R3: “And how much are the Business or First-Class non-stop round-trip fares for those dates?” | Apollo-1

Gemini-2.5 | 1

1 | 1

0 | 1

0 | Pass (3/3)

Fail (1/3) |