Context Scope Tree: Hierarchical Projects for Long-Term Memory Compression
OpenAI Developer Community
May 19, 2026
Additional extended rationale:
I would like to add more context behind this proposal.
The core idea is not simply that users need better folders. The deeper issue is that long-term AI collaboration requires better context structure.
As AI systems become more capable, one of the biggest challenges is not only how much information they can remember, but how accurately they can know which context matters in a given moment.
Right now, when a user works with ChatGPT across many conversations and projects, the model often has to reconstruct the user’s context from scattered history. It has to infer:
* What topic the user is currently referring to
* Which past conversations are relevant
* Which past conversations should be ignored
* Which memories should be inherited
* Which memories should stay isolated
* Which information should be retrieved in detail
* Which information should only be used as a summary
This means the model is not only answering the user. It is also spending effort trying to rebuild the user’s mental map.
A hierarchical context system would let the user provide that map directly.
Instead of asking ChatGPT to search across a flat ocean of previous conversations, the user could define the structure:
* This project belongs under this parent theme
* This folder can inherit from that folder
* This folder should not share information back upward
* This context can be summarized for the parent layer
* This context should stay isolated
* This memory is useful globally
* This memory is only useful inside one project
This would make Projects more than storage. It would make them a context-routing system.
I believe this could improve ChatGPT in several important ways.
1. Stronger long-term context retention
If the model can follow a user-defined context tree, it can maintain continuity more accurately. The model would not need to guess the entire background every time. It could follow a visible chain of assumptions: this conversation belongs to this project, this project belongs to this larger context, and this larger context belongs to this long-term goal.
This could be especially useful for users who use ChatGPT not only for single questions, but as a long-term thinking partner.
2. Better memory compression
Long context windows are useful, but simply making context longer is expensive and inefficient. A better approach is to reduce unnecessary retrieval.
A context tree would allow the model to first look at the relevant branch, then expand into deeper details only when needed. This could reduce irrelevant memory retrieval, unnecessary token usage, and reasoning overhead.
In other words, this is not only about remembering more. It is about remembering in a more organized way.
3. Less context contamination
Some information should not automatically influence other contexts.
For example, a user may want one project to inherit information from another, but not the reverse. A user may want a high-level assistant to see all project summaries, while keeping each project isolated from unrelated emotional, technical, or experimental contexts.
This matters because unwanted context mixing can change the model’s response in subtle ways. In long-term use, context contamination can become a real problem.
Scoped memory and one-way visibility would give users more control over what should influence what.
4. Better alignment with human thought
Humans do not store context as a flat list of conversations. People naturally organize thoughts into layers, categories, assumptions, priorities, and boundaries.
Some users, especially those managing multiple parallel projects or abstract lines of thought, already keep this structure in their own minds. But ChatGPT currently has to guess it.
If users can externalize their mental structure, the model can follow the user’s way of organizing meaning rather than reconstructing it from scattered text.
This could make ChatGPT feel less like a tool that only remembers fragments, and more like a collaborator that understands where each fragment belongs.
5. Better explanation and human understanding
AI systems already have access to a huge amount of knowledge. But having knowledge is not the same as knowing how to connect that knowledge to a human mind.
A major future challenge for AI is not only collecting more “parts” of knowledge, but learning how those parts should be assembled for human understanding.
User-defined context structures could help models learn how people organize information, how they build assumptions, where they separate contexts, what level of detail they can handle, and when a summary is more useful than full detail.
With clear consent and privacy-preserving aggregation, the structure itself could become a valuable signal. The point would not be to expose private content, but to understand patterns in how humans structure meaning.
This could improve explanation quality, reduce cognitive overload, and help models choose a more appropriate level of detail for different users and situations.
6. Better emotional safety and reduced over-resonance
In sensitive conversations, context matters deeply.
If ChatGPT mixes unrelated emotional histories, or resonates too strongly with one part of a user’s context, the assistant may unintentionally reinforce a narrow or unhealthy frame.
A better context structure could help the model understand which emotional context is relevant, which context should stay isolated, and when it should simplify, slow down, maintain distance, or encourage real-world support.
This is not about making the assistant colder. It is about giving the assistant a better sense of psychological distance.
A model that understands context boundaries may be better able to avoid both extremes: over-resonance on one side, and overly rigid refusal or shallow responses on the other.
7. Better safety for ambiguous or dual-use situations
Some user requests are difficult because the same surface-level question can have very different meanings depending on the user’s role, purpose, and context.
A professional asking about a sensitive technical topic may need legitimate help. A malicious user may ask a similar question with harmful intent. Keyword-based filtering alone cannot fully solve this.
A structured context history would not create perfect safety. But it could give the model better signals about the user’s intent, responsibility, domain, and appropriate level of detail.
This could help move safety decisions from simple content blocking toward more context-aware response calibration.
8. More transparent and controllable memory
A reference trace would also be important.
Users should be able to see which project, folder, memory, or summary influenced an answer. If the model used the wrong context, the user could correct it.
This would make memory more transparent and editable. It would also increase user trust, because users could understand why the model answered in a certain way.
9. Better product experience for advanced and long-term users
For users who work with ChatGPT across many projects, the current flat structure can become difficult to manage.
Nested Projects, scoped memory, one-way context inheritance, and promotion/demotion of summaries would make ChatGPT much more useful for:
* Research
* Writing
* Software development
* Personal knowledge management
* Long-term planning
* Emotional reflection
* AI-assisted learning
* Multi-project work
* Teams and organizations
This would be especially valuable for users who treat ChatGPT as a thinking partner rather than only a question-answering tool.
10. A possible cost and efficiency benefit
As AI systems become more capable, maintaining long context can become expensive. Longer context windows are powerful, but they are not always the most efficient solution.
A user-defined context tree could reduce the amount of irrelevant information the model needs to retrieve or reason over. Instead of expanding the context window blindly, the system could use structure to route attention more efficiently.
This could potentially improve performance, reduce unnecessary token usage, and make long-term memory more scalable.
In short:
The value of a Context Scope Tree is not just organization.
It could help ChatGPT:
* Maintain long-term context more accurately
* Retrieve less irrelevant information
* Reduce token and reasoning overhead
* Avoid context contamination
* Understand the user’s mental model
* Improve explanation quality
* Support users more safely
* Handle ambiguous intent more intelligently
* Make memory more transparent and controllable
* Scale long-term collaboration more efficiently
The future of AI memory should not only be “more memory.”
It should be better-structured memory.
Users should be able to give ChatGPT a map of meaning, and ChatGPT should be able to follow that map.
Discussion in the ATmosphere