Why We Need to Capture Memories Now
A few months ago I was at a concert in Brooklyn. The music was incredible, but most of why the night was so important was everything around it. A friend of ours was the one performing, so the whole group was there for her, packed in together. It wasn’t a milestone, no birthday or big announcement, just everyone in the same room. I remember standing there knowing I’d want to save this as a memory.
So I tried to keep it: The set, the DJ between acts, the dumb jokes in the absurdly long Uber on the way over (the L train was down), how cold it was, and a friend of a friend I’d met only minutes before who lent me his beanie so I’d survive the twenty-minute walk through a blizzard to the next bar. I stood there typing quick notes into my phone so I could file them into this new thing I was hacking on I was calling the “second brain”
Months later the system surfaced that entry while I was paging back through that stretch of my life. It set the concert next to the handful of other nights I’d bothered to write up: a dinner that ran so long we never made it to the thing we’d actually planned, a cancelled flight that left a friend and me killing four hours in an airport. I hadn’t connected any of it on purpose, but there it was, a thread running through months, and that night was a knot in it. The pattern was almost embarrassing once I saw it. Nothing I’d marked as worth keeping was the headline event. What I’d captured was the in-between: the Uber, the freezing walk, the beanie, the jokes that didn’t survive the night.
My memory of that night has already gone blurry. The entry is still sharp, every detail where I left it. That gap, between what your brain keeps and what you wrote down, is about to matter a lot more than people think, because of where the technology is heading.
We’re in a strange window. AI systems can already reason over text and find patterns across thousands of entries. What they can’t do is reconstruct the moment itself. They can read that I was at a concert and felt a specific kind of longing. They can’t put me back in that Bushwick bar on that same night.
The research to watch is what the labs call World Models: systems that learn how reality behaves, the physics of it, the way light falls in a room. DeepMind’s Genie 3 generates playable 3D environments from a single text prompt. The frontier video models keep scenes coherent in ways that imply some internal model of the world. The outputs are short and the physics still glitches, but the trajectory is steep, and every six months these systems get noticeably better at knowing what a real place looks and feels like.
Apply that trajectory to personal memory. Some version of this is coming for the personal archive: a system that takes a richly captured moment and rebuilds it. Closer to a dream than a photograph, and close enough to walk through.
But the world model alone doesn’t get you there, and this is why the capture matters. Genie can already render a concert. It can’t render that concert. The generic physics comes from the model. Everything that made the night yours, the beanie, who was packed in next to you, has to come from somewhere, and the only place it can come from is what you recorded. Your notes are the conditioning. Without them, the system can build you a beautiful room with nobody you love in it. Bonus points if you captured pictures or videos as supplemental artifacts from your experience.
What makes the window urgent is a fact about memory that most people have backwards. Every time you remember something, you change it. Your brain rebuilds the scene from fragments and inference, and the rebuilt version can get stored over the original. Neuroscientists call it reconsolidation. The memory you have of a night at 25 is not the memory you’ll have of it at 45. Do that enough times and the original fades beneath the revisions.
That’s how meaning gets made, and I’m not against it. But it means the richest version of every experience you’ve ever had exists right now, and it’s degrading.
The lifeloggers saw part of this twenty years ago. Gordon Bell, a researcher at Microsoft, spent the 2000s digitizing his entire existence (emails, photos, phone calls, web pages) into a project called MyLifeBits: hundreds of thousands of artifacts from one life, in pursuit of what he called total recall. What I take from his experiment is that quantity isn’t the thing. A photo from my concert night would tell you where I stood and who was on stage. It wouldn’t tell you about the beanie, or what it felt like to be that cold with those people. “Dinner at 7pm” is worthless data. “Dinner ran four hours and we never made it to the plan” is a memory, and it’s the kind a future system can actually do something with.
I’m a big fan of journaling. The usual case for it is present-tense, and it’s a good one. You process the day, untangle what happened, plan tomorrow. But there’s a future-tense argument almost nobody speaks to which is that you’re essentially building a dataset of yourself.
Every captured moment is a data point in what amounts to a world model of you. Your patterns, the people you keep coming back to, how you respond to loss and to boredom. The richer that dataset, the more a future system can do with it.
With a physical notebook, it’s sometimes hard to find the exact note relevant to you on a day when you need, say inspiration. With an AI playing the role as the bookkeeper in the library that is your life, it makes retrieval easier than ever.
I had a session a few weeks ago where I sat down with my system to plan the week and close out a few open loops in my head, and it surfaced a moment from months earlier I’d completely forgotten, a dumb joke from the drive home from a ski trip, something about eating New England clam chowder in New York. Made me laugh out loud all over again. No magic to it, just enough context for the system to know which fragment was worth handing back, and when.
Now run that capability forward ten years, to a system that rebuilds the physical and metaphysical environment around a moment instead of quoting it back. Imperfect, but real enough to feel. Tools like that are coming in some form, and the bet costs almost nothing to make. If I’m wrong, I’m left with an absurdly detailed record of my life. If I’m right, I’ve banked training data my future self could never get back. You don’t feel the loss, because you can’t see what you’ve forgotten.
There’s a version of this idea that turns dark. A system that endlessly replays your best moments could trap you in the past, make you nostalgic instead of present, turn you into the curator of a museum about yourself.
The defense is a design principle, and it comes down to where the system aims your attention. You write up a long convo with your grandparent. A few weeks go by with no contact, and instead of resurfacing the chat, the system tells you to pick up the phone and call them. You save the night your whole college group was finally in one place. Months pass without it happening again, and the system tells you to be the one to plan the next trip. You capture a run where everything clicked. The system sees you’ve skipped a few days of training and, instead of replaying the high, tells you to lace up. Point the system outward, toward the people who made the memories worth having, and the days you have in front of you.
And none of it works without privacy. Nobody captures their real moments, the unfiltered stuff, if they suspect a company is reading along. Some of the most important memories are the ones you’d never post. They have to stay yours, which is its own essay.
I’m 25. Memories feel abundant at this age. The Knicks won the championship last weekend, the World Cup just kicked off, and there are more concerts ahead, more nights with the people I love. It never feels like it’s about to run out. The trap is the illusion of infinite supply.
But I already can’t remember a lot of college. I’ve lost the texture of entire experiences. I know certain things happened, but the way a particular night felt is gone. Things are too deep in the memory vault for them to be retrieved on demand. Snapchat memories and BeReals help but they fill in one snapshot of what exactly happened. Those experiences mattered, I just didn’t write them down.
Capture has an inverted cold start problem. Most technology needs data before it can be useful. Personal memory is the opposite, the data appreciates as the systems that can process it improve, which makes starting now, with imperfect tools, an investment in capabilities nobody can fully picture yet.
The raw material is your life, it’s happening right now, and most of it is evaporating. Future systems will be able to do extraordinary things with personal memory. Whether they can do them for you depends on what you wrote down.