Thyme: Think Beyond Images
Yi-Fan Zhang et al.
arXiv:2508.11630
In short
Thyme lets a multimodal model write and run code while reasoning about an image, cropping, rotating or enhancing it and doing calculations as needed. It is trained with supervised examples of code generation followed by RL that samples text and code at different temperatures.
Why it matters
An open take on “thinking with images”, a capability until now mainly seen in closed models.
Read first
The 3 Field Guide ideas this paper leans on.
Starting from scratch? The full route 22 ideas · basics first
- Machine Learning ✓ understood
Building systems that learn patterns from data instead of following hand-written rules, getting better at a task as they see more examples.
- Neural Network ✓ understood
A computational model inspired by biological neural networks, consisting of interconnected nodes (neurons) organized in layers that process information through weighted connections.
- Deep Learning ✓ understood
A subset of machine learning that uses neural networks with multiple layers (deep neural networks) to learn hierarchical representations of data.
- Computer Vision ✓ understood
The field of AI that gets computers to extract meaning from images and video: what is in them, where it is, and how it moves.
- Natural Language Processing ✓ understood
The field of AI that lets computers read, interpret, translate and generate human language, from spam filters and search to chatbots.
- Token ✓ understood
The basic unit of text that a language model processes, typically representing a word, subword, or character. Tokens are the fundamental building blocks for LLM input and output.
- Tokenization ✓ understood
Splitting text into tokens, usually subword pieces, and mapping each to an integer ID so a language model can process it.
- Language Modeling ✓ understood
Learning probability distributions over sequences of words to predict what comes next.
- Dataset ✓ understood
A collection of data examples used for training, validating, or testing machine learning models.
- Training ✓ understood
The process of fitting a model to data by repeatedly measuring how wrong its outputs are and adjusting its parameters to reduce that error.
- Unsupervised Learning ✓ understood
Learning from unlabeled data to discover hidden patterns, structures, or relationships without explicit target outputs.
- Self-Supervised Learning ✓ understood
Learning representations from unlabeled data by creating supervised tasks from the data itself (masked prediction, contrastive learning).
- Pre-training ✓ understood
Training a model on a large dataset (often self-supervised) before fine-tuning on specific tasks, enabling transfer learning.
- Feature ✓ understood
A single measurable property of an example, such as a house's floor area or how many links an email contains, used as an input to a model.
- Representation Learning ✓ understood
Learning useful features or representations of data automatically, rather than hand-crafting them.
- Embedding ✓ understood
A list of numbers (a vector) that represents a word, sentence, image or other item, learned so that similar items end up close together.
- Attention Mechanism ✓ understood
A technique that lets a neural network weigh every part of its input when producing each output, focusing on the parts most relevant at that step.
- Transformer ✓ understood
A neural network architecture, introduced in 2017, built from stacked self-attention and feed-forward layers; the basis of nearly every modern large language model.
- Large Language Model ✓ understood
A neural network, almost always a transformer, trained on vast amounts of text to predict the next token, which lets it write, answer, summarize and follow instructions.
- Multimodal Model · read first ✓ understood
Models processing multiple data types (text, images, audio) jointly, like GPT-4V, Gemini, or CLIP.
- Code Generation · read first ✓ understood
AI systems that write code from natural language descriptions, powered by models like Codex, GitHub Copilot, or Claude Code.
- Reinforcement Learning · read first ✓ understood
Learning through interaction with an environment, receiving rewards or penalties to learn optimal behavior policies.
In the frontier
- Rank
- #41 of 100
- Citations
- 119
- as of Aug 9, 2026
- Published
- Aug 2025
Topics: Vision-language models , Reasoning methods , RL for reasoning
Selection: 1kpapers.com by Together AI, most-cited as of Aug 9, 2026