Weather Report

Weather Report

What models we're running today, how they're configured, and what role each one plays in the factory.

Subscribe via RSS

Why do we publish The Weather Report? The Weather Report started out as a casual internal summary of how each provider and model was performing on our most important use cases. We update it frequently and have found it essential to our process.

As of April 21st, 2026

Switched UX Ideation from gemini-3-pro-image-preview (Nano Banana Pro) to gpt-image-2 (ChatGPT Images 2.0). Modified: UX Ideation.

UseModels (by preference)ParametersNotes
CS/Math Hard Problems
Feb 6
gpt-5.3-codexdefault
Image comprehension
Feb 6
gemini-3-flash-previewdefault
Frontend Aesthetics
Apr 20
opus-4.7maxSticking with max — adaptive thinking showing discrepancies
Frontend Architecture
Feb 6
gpt-5.3-codexdefault
Architectural Critique
Mar 12
gpt-5.4extra high
Sprint Planning
Apr 20
consensus(opus-4.7, gpt-5.4)max / extra highGemini can improve consensus in some cases
Devops Tasks
Apr 20
opus-4.7maxSticking with max — adaptive thinking showing discrepancies
QA Orchestration
Apr 20
opus-4.7maxSticking with max — adaptive thinking showing discrepancies
Security review
Feb 6
gpt-5.3-codexhigh
Bulk classification
Feb 6
AnydefaultGo up cost and strength as needed
Bulk MapReduce
Feb 6
AnydefaultGo up cost and strength as needed
UX Ideation
Apr 21
gpt-image-2defaultChatGPT Images 2.0
Agentic dialogues
Feb 13
gemini-3-flash-previewdefaultGeneral message handling loops with user interaction and limited tool calling
Voice (interactive)
Feb 23
gpt-realtime-1.5defaultInternal use; not yet an official default
Consensus operator refers to an LLM merge of the points from independent plans.

Log

April 21st, 2026

Switched UX Ideation from gemini-3-pro-image-preview (Nano Banana Pro) to gpt-image-2 (ChatGPT Images 2.0). Modified: UX Ideation.

April 20th, 2026

Bumped opus-4.6 → opus-4.7 across our Anthropic defaults. We're seeing discrepancies with opus-4.7's adaptive thinking, so we're sticking with max thinking for now. gpt-5.3-codex remains our default implementation model — we've evaluated alternatives but haven't found a reason to switch.

March 12th, 2026

gpt-5.4 has been formally adopted for planning and architectural critique. It replaces gpt-5.2 in our Sprint Planning consensus pair and Architectural Critique. Gemini can improve consensus in some cases for sprint planning. We're continuing to evaluate gpt-5.4 for implementation tasks but keeping gpt-5.3-codex as our default implementation model for now.

February 23rd, 2026

No specific changes in defaults, but please note for anyone evaluating Gemini 3.1, the gemini-3.1-pro-preview-customtools may significantly outperform gemini-3.1-pro-preview depending on your harness. We've switched to gpt-realtime-1.5 for our internal use cases but aren't officially defaulting to it yet. Very happy with Sonnet 4.6, it may overtake Opus for some of our everyday use cases.

February 13th, 2026

Happy with gpt-5.3-codex-spark. gpt-5.3-codex continues to be our preferred default implementation model with critiques and suggestions from Opus. Modified: Sprint Planning. Added: UX Ideation, Agentic dialogues, Voice (interactive).

February 6th, 2026

New models this week. We're very happy with gpt-5.3-codex. No problems with Opus 4.6 so far.