Last month, the AI startup Anthropic, valued at $61.5 billion, launched a unique gaming livestream featuring its AI model, Claude, as it attempts to beat Pokémon Red. While gaming livestreams are a common occurrence, this initiative stands out due to its AI focus.
After one month of ongoing livestreaming, Claude has shown limited progress, leading some to question whether it can truly become the best trainer, as the iconic theme suggests.
Initially, Anthropic revealed that earlier versions of Claude struggled with basic tasks. For instance, Claude 3.5 was notorious for attempting to flee from nearly every battle in June 2024.
However, following several updates to the Claude series, a significant improvement was noted. In February 2025, the introduction of Claude 3.7 Sonnet showcased a marked enhancement in gameplay. “Within hours, Claude defeated Brock, and days later, it overcame Misty,” noted Anthropic, highlighting progress that earlier models could only dream of achieving.
Claude 3.7 Sonnet demonstrated advanced capabilities such as planning, remembering objectives, and learning from mistakes—features not present in its predecessors. The model also developed a knowledge base, interpreted the screen, and simulated button presses.
Despite notable advancements, recent gameplay has seen Claude 3.7 Sonnet encounter challenges. For example, livestream spectators watched as it took 78 hours to navigate through Mt. Moon, a task estimated to take an average child just a few hours.
Viewers observed Claude struggling with navigation, frequently going in circles, stumbling over obstacles, and colliding with various walls while attempting to progress in the game. The livestream remains captivating as a text box displays Claude’s thought process while it strategizes its next moves.
Engineers from Anthropic explained that while Claude excels at text-driven elements like Pokémon battles, it continues to face difficulties with visual navigation between locations on the map.
Although Claude 3.7 Sonnet has advanced farther in the game than previous versions, it is a clear indicator that we are far from realizing the notion of AI dominance. With still 151 Pokémon left to capture, the journey ahead remains significant.
