Everything I've Said About AI Since 2016: A Retrospective
文章回顾了作者过去十年对AI的预测与分析,涵盖API化、数字助手、持续认证等核心领域的准确预测,以及增强现实覆盖、全面声誉基础设施等部分实现或未实现的内容。作者强调人类需求稳定而非技术发展决定了其预测的准确性,并展望了未来趋势。 2026-1-6 12:0:0 Author: danielmiessler.com(查看原文) 阅读量:0 收藏

AI Predictions Retrospective

I've been making AI noises for exactly a decade now, and last week someone claimed I said two things about AI in 2023 that I don't think I said (that we'd have AGI in 6 months and that AI was sentient).

I've never said anything like those things to my knowledge, and it made me want to prove him wrong...which would require that I could compile a list of all the stuff I have said over the decade. And of course since I was making a list, I was like,

"Well, let's see how accurate I've been..."

So I spun up some of my fancy new tooling (another "reason" to do this) and got after it. More on the tooling in the notes if you're into that.

So here's (mostly) everything I've said about AI since 2016, organized chronologically, and what I've learned from reviewing it.

  1. 2016
  2. Late 2022
  3. Early 2023
  4. Late 2023
  5. 2024
  6. 2025
  7. 2026
  8. Predictions Scorecard
  9. What I Got Right
  10. What I Got Wrong or (Charitably) Too Early?
  11. What I Learned From The Effort
  12. I Recommend Trying Something Similar

In late 2016 I published a short (somewhat shitty) book called The Real Internet of Things. I hate parts of the writing, just from a tone standpoint, and I really wish I'd said some things differently. But the core predictions (DAs, APIs, AR, etc.) are actually starting to happen!

Here they are.

Prediction: Universal Daemonization

One of the main concepts of the book is the idea that every object in the world would eventually have an API—a "daemon" that presents its state, capabilities, and allows interaction in a standardized way.

"All objects will have these daemons. Cars, houses, buildings, cities, businesses, etc. People will interact with objects through their daemons, which will be fully functioning interfaces that allow you to push and pull information as well as modify configurations and execute commands."

The Real Internet of Things, December 2016

I was describing what we'd now call the API-ification of everything, or more specifically, what MCP (Model Context Protocol) is becoming. At least for services infrastructure.

Analysis: This one feels pretty good, but API-ification is still just on certain kinds of digital things. The MCP ecosystem now has 10,000+ servers and 97 million monthly SDK downloads. Every major AI platform adopted it. The "everything gets an API" vision is genuinely happening, but I don't see many park benches or restaurants with APIs yet. Verdict: Core idea happening, but implementation still limited.

Prediction: Digital Assistants as Primary Interface

We'd stop interacting with technology directly and instead interact through AI assistants that handle everything on our behalf.

"Humans interact with DAs, and DAs interact with the world."

The Real Internet of Things, December 2016

I wrote about how DAs would "work to optimize the life of their principals continuously, without rest, 24/7/365, and in multiple threads."

Analysis: This is happening, though more slowly than I expected back then. Anthropic's computer use, OpenAI's Operator, and various agent frameworks are all moving in this direction. But we're still in early days. Most people still interact with technology directly. I've been working on building toward this vision ever since it became possible—first with my Personal AI Maturity Model which maps the path from chatbots to full DAs, and now with the PAI (Personal AI Infrastructure) project on GitHub. I still think of what I'm building as trying to get to the DA I described in the book. Verdict: Directionally accurate, timeline was optimistic.

Prediction: DAs Understanding Your Context

This is the one I'm most proud of from the book. I wrote that DAs would understand your preferences, mood, and intentions—and use all of that context to construct requests on your behalf.

"The preferences piece is essential, because the better your DA understands you the better it can represent you when making requests on your behalf. Your DA will be essentially bound to your own personal daemon, and it will have access to the most protected information within it. Most notably, your preferences and experiences, which will both be used to help construct the ideal contextual requests on your behalf."

The Real Internet of Things, December 2016

And in the AR section, I got even more specific about context:

"With context, DAs will understand the preferences, mood, and intentions of their principals, and they will use this to decide what should be presented to the user... Your DA knows your preferences, your current context (happy, lonely, angry, sad, etc.) and is parsing all those daemons."

The Real Internet of Things, December 2016

Analysis: This is essentially what we now call "context engineering" or sophisticated prompting. The entire premise of effective AI use in 2025 is giving the AI your preferences, your context, your goals—exactly what I described. System prompts, memory features, personalization—it's all "constructing ideal contextual requests." People are literally re-learning this lesson right now, and I wrote it in 2016. Verdict: Nailed it.

Prediction: Services Designed for DAs, Not Humans

I wrote that the entire paradigm would flip—businesses would design their services to be consumed by AI assistants, not humans directly.

"Services (which nearly everything will become) will be designed (and/or retrofitted) to be consumed by Digital Assistants, not by humans."

The Real Internet of Things, December 2016

And later:

"The function of the business changes fundamentally in this model. Instead of being in charge of the user's entire experience, businesses become part of an algorithm marketplace used by DAs to satisfy the requests of their principals. The DA is now the centerpiece of the user experience."

The Real Internet of Things, December 2016

Analysis: This is MCP. This is the entire API-first, AI-native design movement. When Anthropic launched MCP and suddenly every business is racing to create AI-consumable interfaces to their services—that's exactly what I described. Businesses becoming "algorithm marketplaces used by DAs." We're watching this prediction unfold in real-time. Verdict: Extremely accurate.

Prediction: The Tireless Advocate

DAs wouldn't just respond to requests—they'd proactively work for you 24/7, in parallel threads, finding ways to optimize your life.

"Your DA will work diligently, using all this context, without rest, in multiple concurrent threads, to find everything in the world that could help you in some way."

The Real Internet of Things, December 2016

And:

"While you are doing other things (or nothing) your DA will be scouring the world for ways to optimize your life based on your needs, desires, and goals."

The Real Internet of Things, December 2016

Analysis: This is emerging now with AI agents. Background agents running tasks, research assistants working in parallel, systems that monitor and act on your behalf. We're in early days, but the architecture I described is exactly what agent frameworks are building toward. Verdict: Accurate, implementation underway.

Prediction: Business Interaction via DAs

I wrote out a specific example of how you'd interact with businesses—not through their apps or websites, but through your DA talking to their daemon/API.

"Sarah will ask Jan [her DA] to see headphones from Sequoia... Jan will contact Sequoia's daemon and retrieve their product list... Sarah navigates Sequoia's content using voice commands and gestures... Sarah finally says, 'This one and this one. Ship to Abdul and Micah.'... The crucial point here is that Sarah spent no time interacting directly with Sequoia's systems. Jan acted as Sarah's advocate in all of these interactions."

The Real Internet of Things, December 2016

Analysis: This is what everyone is building toward with AI shopping assistants, autonomous purchasing agents, and voice-first commerce. The detail of "Jan contacts Sequoia's daemon" is literally MCP server architecture. We're not fully there yet, but this is the direction. Verdict: Prescient, still materializing.

Prediction: Augmented Reality Overlays

AR would layer contextual information onto the world—showing you ratings on restaurants, relationship compatibility with strangers, danger indicators, and more.

"As you're talking to people you'll have metadata about them displayed, such as humor scores, attractiveness ratings, favorite foods, favorite reading, and interesting connections to you."

The Real Internet of Things, December 2016

Analysis: Meta's Ray-Bans with AI are here. Apple Vision Pro exists. But the "metadata overlay on everyone you meet" thing? Not happening yet. The tech just isn't there—we need lighter glasses, better batteries, and more seamless integration before this becomes practical for everyday use. The direction is right, but we're still a few hardware generations away. Verdict: Directionally correct, waiting on hardware.

Prediction: Reputation as Infrastructure

People would have third-party-validated ratings displayed through their personal daemons—reliability scores, trustworthiness, expertise in various domains.

"Our daemons will host and present dozens of ratings (and thousands of subratings) about us. These scores will then be used by the world to make decisions about whether to interact with said person."

The Real Internet of Things, December 2016

Analysis: We sort of have this with LinkedIn endorsements, Uber ratings, and various reputation systems. But the comprehensive, integrated "social credit" style system I described? Not here, and probably for good reason. This is one where I was describing what's technically possible without fully grappling with whether it's desirable. Verdict: Partial implementation, significant pushback on full vision.

Prediction: Continuous Authentication

We'd move from passwords and periodic authentication to continuous streams of biometric and behavioral data that maintain identity confidence in real-time.

"People and things will constantly stream data points to the IVS [Identity Validation Service], and those markers will be used to maintain a real-time confidence rating that the person (or thing) is actually itself."

The Real Internet of Things, December 2016

Analysis: Behavioral biometrics are real now. Apple's Face ID is always-on. Some enterprise systems do continuous authentication. But the full vision of constant identity streaming? Not there yet. Verdict: Moving in this direction, slower than predicted.

Prediction: Businesses Become APIs

Companies would essentially reduce to their core algorithms, with the interface/experience layer being handled by intermediaries.

"Many businesses will become digital and service-oriented because many businesses can (and will) ultimately be reduced to their algorithms."

The Real Internet of Things, December 2016

Analysis: This is happening with AI companies. Crunchbase data shows companies like Cursor and Lovable are essentially algorithm-as-company. The API economy is massive. But most businesses still have significant non-algorithmic components. Verdict: Accurate for tech, less so for broader economy.

Prediction: Machine Learning + Evolutionary Algorithms

The combination of ML and evolutionary approaches would accelerate our ability to discover solutions humans couldn't conceive.

"Using this technique we can potentially outperform the creative capabilities of billions of the smartest humans, doing their best on a problem for hundreds of years, all in the span of a few hours."

The Real Internet of Things, December 2016

Analysis: AlphaFold, protein folding, drug discovery—yeah, this is happening. The Stanford 2025 AI Index documents AI matching or exceeding human expert performance across numerous domains. I'll take credit for the direction, but the specific technical approach (transformers, LLMs) was completely different from what I imagined. Verdict: Outcome accurate, mechanism different than expected.

Prediction: Desired Outcome Management (DOM)

This is the one that hasn't fully materialized yet, but it's the vision I care most about. I wrote about a framework for systematically improving human outcomes by defining goals and ratcheting up toward them.

"DOM provides a model for improving almost anything... Define your goals. Define your model. Capture data. Provide ratings. Recommend changes based on where you could improve. Adjust the approach based on new data."

The Real Internet of Things, December 2016

And the core insight about what this enables:

"This will culminate in a framework that allows humankind to systematically define its goals, study reality in realtime using AI, and then make optimizations to our behavior that best lead to our desired outcomes."

The Real Internet of Things, December 2016

Analysis: This is the part of the book I'm still actively building toward. The vision was: define goals, capture data, rate progress, get recommendations, adjust. It's essentially what I'm trying to create with TELOS (personal life optimization) and Substrate (human progress frameworks). The infrastructure is finally here—AI can now hold your goals, preferences, and metrics in context and help you optimize. But the full "DOM for humanity" vision? Still mostly aspirational. I think about this constantly. Verdict: The destination I'm still building toward.

2016 Examples → What People Are Building Now

What's wild about re-reading the 2016 book is how many specific examples I wrote are exactly what people are building right now. Not vague directional stuff—actual use cases.

Shopping via DA conversation:

"Sarah will ask Jan to see headphones from Sequoia... Jan will contact Sequoia's daemon and retrieve their product list... Sarah navigates Sequoia's content using voice commands and gestures... Sarah finally says, 'This one and this one. Ship to Abdul and Micah.' ... Jan acted as Sarah's advocate in all of these interactions."

The Real Internet of Things, December 2016

That's AI shopping agents, Perplexity Shopping, and the entire vision behind MCP-powered commerce. The "Jan contacts Sequoia's daemon" line is literally MCP server architecture.

Real-time research summaries:

"Any research topic you express interest in, or ask your DA to look into, will get a full parsing and summary treatment... Summaries will have depth levels, so you'll be able to say things like, 'less depth', or, 'more depth' as desired."

The Real Internet of Things, December 2016

That's exactly how Perplexity works. It's how Claude's research mode works. It's how everyone is building AI-assisted research—filtering relevance and controlling depth.

Household management:

"Instead of household items like food and dish soap and paper towels ordering replacements for themselves... every household item will register with the head-of-household's DA, and the DA will manage the household based on its knowledge of preferences, calendars, etc."

The Real Internet of Things, December 2016

Matter protocol, smart fridges, and the whole "connected home" push is heading there. Apple's HomeKit with AI integration is building toward this.

Gig work matching:

"Jason is rated highly in many local and global skills, and he sits relaxing at his favorite coffee shop... When a job passes the threshold, his DA (named Timmothy), will break in quietly in his earpiece. 'Legal contract review, 37 pages, due by tomorrow morning, are we interested?' Jason nods his head and the details are worked out between DAs transparently."

The Real Internet of Things, December 2016

That's Upwork, Fiverr, and all the AI-powered job matching platforms. The 70 million Americans now freelancing are essentially operating through API-like interfaces.

Safety summoning:

"If a woman is walking home, and she realizes it's later than she thought, her DA will summon local protection. People who are rated as safety qualified... will get summoned by their DAs to either accept or reject an urgent, local request. And within a few seconds one or more people will walk up, nod, smile, and walk with her to her destination."

The Real Internet of Things, December 2016

That's what Citizen, Noonlight, and personal safety apps are doing. Apple's crash detection and fall alerts are moving in this direction.

Venue personalization:

"Walking into a sports bar could see the content on the displays change, the music over the speakers change, etc... When you visit a hotel your DA will have everything configured for you according to the maximum capabilities of the property. This will include bed style, products in the bathroom, what's playing on the display, the temperature in the room, etc. These are not things that you ask for—they're all things that your DA knows best about you."

The Real Internet of Things, December 2016

Apple Continuity, cross-device preferences, and the "hand off your context" paradigm are the infrastructure for this. We're not fully there, but the plumbing exists.

Cross-device context handoff:

"As you move from place to place (say hotels or airplanes) your context will transfer with you through your DA. If you're halfway through watching a show on a plane when you land, your DA will ask if you want to pick it up where you left off when you get in bed at the hotel."

The Real Internet of Things, December 2016

This is Apple Handoff, Universal Control, and the entire continuity ecosystem. Start something on your phone, finish it on your laptop. Copy on one device, paste on another. We have this now.

Writing the perfect message:

"Write the perfect letter for this situation... I just got this text, how should I respond?"

The Real Internet of Things, December 2016

This is ChatGPT. This is Claude. This is every AI writing assistant. "Help me respond to this email" is one of the most common AI use cases in 2025.

Travel planning via DA:

"You ask your DA where to go for a weekend trip, and it calculates all the variables based on the best experience, price, and ratings by people in your network who have gone there. Your DA recommends the winner and then uses a separate daemon/business/API to build the travel plan and add it to the calendar."

The Real Internet of Things, December 2016

That's Perplexity for travel, ChatGPT trip planning, and all the AI travel agents emerging now. "Plan me a weekend in Portland" with AI doing the work.

Content recommendations:

"What should I watch right now? What should I listen to? Surprise me with an interesting music choice that I'll love but never would have picked myself."

The Real Internet of Things, December 2016

Netflix, Spotify, and every recommendation algorithm—but now with AI that actually understands context and mood. "I just had a hard day, what should I watch?" is a ChatGPT query.

Book summaries on demand:

"When I look at the cover of a book, give me a perfect summary that fills the cover, along with the rating."

The Real Internet of Things, December 2016

Blinkist, AI book summarizers, and "summarize this PDF" as a core AI use case. Point your camera at a book and get a summary—we're there.

Life optimization questions:

"Why am I not happy? What do I waste the most time on in my life? Build me a perfect daily routine based on my life goals."

The Real Internet of Things, December 2016

AI life coaches, Rosebud for journaling, and the entire "AI therapist" category. People ask these exact questions to Claude and ChatGPT daily.

Menu filtering by health goals:

"Only show me menu items that I should eat as part of my new health plan. I'm new to Sushi, what should I try on this menu?"

The Real Internet of Things, December 2016

Noom, AI nutrition apps, and "photograph your menu and get recommendations" features. ChatGPT can already analyze a menu photo and recommend based on your dietary needs.

Dating and matching:

"You'll hear a sound when a single person of the opposite sex nears you while you're not working, but only if they pass a few filters that are important to you. You might let your DA use a number of commercial algorithms to find matches for you that you wouldn't have thought to explore yourself. So you may put yourself in Cupid mode, or Spontaneity mode, where two DAs create pre-filtered but semi-chance meetings between two principals."

The Real Internet of Things, December 2016

That's Tinder, Hinge, and the entire AI dating scene. The "pre-filtered but semi-chance meetings" is exactly what matching algorithms do.

Proactive hobby planning:

"If someone mentions to you casually about a particular sport, your DA (knowing you like to immerse yourself in new hobbies) will find the nearest training locations, the best local trainers, the best and nearest places to play, and some top tips for getting into shape. So when you inevitably ask about it in the next day or so, your DA will have an entire plan sorted out for you."

The Real Internet of Things, December 2016

This is proactive AI assistance. Google does this poorly with ads. What I described is where AI assistants are heading—anticipating needs before you express them.

Family safety monitoring:

"You'll be notified by your DA if anyone in your family is in a dangerous situation that falls above a certain threshold. You'll be able to switch your visual point of view instantly to any camera you have access to, whether that's inside your house, through the eyes of someone you're sharing access with, drones hovering over your house, etc."

The Real Internet of Things, December 2016

Life360, Ring cameras, family tracking apps. The "switch your visual point of view to any camera" is exactly what Ring and Nest dashboards do.

Reputation monitoring:

"DAs will scour the world looking for negative information about you, news that could negatively affect you, etc., and will bring it to your attention if it finds something."

The Real Internet of Things, December 2016

Google Alerts, brand monitoring tools, social listening platforms. AI-powered reputation monitoring is now a category.

The point isn't that I'm some prophet. The point is that human needs are predictable. I didn't predict the technology; I predicted what people would want to do with technology that understood them. Those use cases don't change—only the implementation does.


This is when ChatGPT hit and everything went crazy. I wrote a "napkin ideas" post with my first reactions. Looking back at it now is... interesting.

Prediction: Massive Knowledge Work Replacement

80% of knowledge work would eventually be affected by AI automation.

"Let me start with the punchline: Something like 80% of most 'knowledge work' is about to get replaced by artificial intelligence."

Napkin Ideas Post, December 2022

Analysis: Was I being dramatic? Maybe. But the direction is right. McKinsey's 2025 report says 75% of knowledge workers already use AI tools, and 30% of current hours worked could be automated by 2030. DemandSage data shows creative execution roles already declining hard: graphic artists (-33%), photographers (-28%), writers (-28%). The 80% number might still be high, but it's not crazy anymore. Verdict: Directionally accurate, magnitude TBD.

Prediction: Non-Replacement vs. Massive Layoffs

The transition would be gradual attrition rather than sudden mass layoffs.

"I don't imagine this will result in some massive layoff. It'll be more like a steady trend towards non-replacement as people naturally leave companies."

Napkin Ideas Post, December 2022

Analysis: This seems to be playing out. We're not seeing "50% of accountants fired Tuesday" headlines. Instead we're seeing companies quietly not backfilling positions, reducing hiring, letting AI handle work that used to require new hires. The NPR "first-rung squeeze" report confirms entry-level positions are disappearing first. Verdict: Accurate so far.

Prediction: Talent Gap Explosion

AI would massively amplify the gap between talented and less talented people.

"AI will be like multiplying their brains and having them work continuously. The best engineers become better engineers. The best entrepreneurs move faster to market."

Napkin Ideas Post, December 2022

Analysis: Evidence is mixed. PwC's 2025 data shows AI-skilled positions command a 56% wage premium. But Harvard research found AI helps the bottom 50% of performers achieve the greatest productivity uplift. So within specific tasks, AI might be narrowing gaps. But between AI-adopters and non-adopters? That gap is widening fast. Verdict: Partially accurate—gap expanding between adopters and non-adopters.

Prediction: Solopreneurs Thrive

Small teams with AI would compete with much larger companies.

"It's getting a whole lot easier to be a business by yourself, or with 1-5 employees. If you pick your first couple of employees well, it could easily be the equivalent of having 10-20 people."

Napkin Ideas Post, December 2022

Analysis: Nailed this one. Sam Altman predicts the first one-person billion-dollar company is coming soon. Lovable became Europe's fastest unicorn in 8 months with 45 employees. Cursor hit $500M ARR with fewer than 50 workers. Gumloop raised $17M Series A with just 2 full-time staff. Solo-led exits now account for 52.3% of successes, up from 22.2% in 2015. Verdict: Accurate.

Prediction: Best AI Will Be Most Expensive

Premium AI would go to those who could afford it, amplifying inequality.

"This will magnify even further because the best AI will be the most expensive."

Napkin Ideas Post, December 2022

Analysis: This has held up. Open source models have improved, but the gap between paid and free remains significant for serious work. Claude Code is dramatically better than open source alternatives for real development tasks. The people paying for premium AI are getting meaningfully better results. Verdict: Mostly accurate.

Prediction: Dynamic Generalist Employees

The employees people hire would be generalists who are good with data and AI frameworks.

"The employees people do hire will be dynamic generalists who are also good with data and—you guessed it—using AI frameworks."

Napkin Ideas Post, December 2022

Analysis: This is happening. The most valuable hire now is often someone who can stitch together AI tools, not a deep specialist. Verdict: Accurate.

Prediction: Ideas Ascend, Implementation Becomes Less Important

Focus would shift from "how do we do the thing" to "what should we be doing."

"With AIs answering more and more of that question, the focus will shift to the new question of, 'What should we be doing?'. That's a colossal shift, and it's one that favors a different type of employee."

Napkin Ideas Post, December 2022

Analysis: Very early days, but directionally this seems right. Prompting/directing is becoming more valuable than pure execution in many domains. Verdict: Tracking—too early to call.

Prediction: Liberal Arts Renaissance

Broader education might help people become leaders rather than just executors.

"Maybe that generalist, liberal-arts education won't be as much of a waste anymore."

Napkin Ideas Post, December 2022

Analysis: I was trying to find a silver lining here. The reality is more complicated—we're seeing value in both technical and humanistic skills, but "liberal arts degree = success in AI era" is too simple. Verdict: Overstated.

Prediction: IP Battles Over AI-Generated Ideas

Fierce competition around what constitutes a human idea vs. AI-generated.

"Expect fierce IP battles around what constitutes a human idea vs. one generated by an AI."

Napkin Ideas Post, December 2022

Analysis: Getty vs. Stability AI, NYT vs. OpenAI, countless copyright cases. The legal battles are here. Verdict: Accurate.

Prediction: Multimodal Excitement

Images and video combined with text would be transformative.

"As exciting as this first version is, I'm 37x more excited about future versions—especially once they do images and video as well as text."

Napkin Ideas Post, December 2022

Analysis: Midjourney, DALL-E, Sora, GPT-4V—yeah. Multimodal is huge. This was an easy call in retrospect. Verdict: Accurate.

Prediction: SOC Analyst AI Assistance

AI would finally deliver on the broken promise of helping security analysts.

"The idea of helping a SOC analyst with AI was an empty promise and sad joke for a long time, and that seems about to end."

Napkin Ideas Post, December 2022

Analysis: This is happening. AI-powered security tools are actually useful now—not magic, but genuinely helpful. The "sad joke" phase is over. Verdict: Accurate.

Prediction: Hollywood in Trouble

AI creativity + animation would disrupt traditional content creation.

"Hollywood seems to be in significant trouble. Once we can combine this type of creativity with the ability to make animation and video, why would we wait multiple years and pay millions for mediocre stories?"

Napkin Ideas Post, December 2022

Analysis: Hollywood is struggling, but more from streaming fragmentation than AI disruption (so far). The AI video tools aren't quite there yet for feature-length content. This one's still playing out. Verdict: In progress—disruption coming but slower than expected.

Prediction: AI as Inspiration Muse

AI would function as a source of creative inspiration rather than replacement.

"Some part of [art] gets completely destroyed, but many elements of it get better because this tech will function as an inspiration muse."

Napkin Ideas Post, December 2022

Analysis: This is how most creative professionals I know use AI—brainstorming, ideation, getting unstuck. The Science Advances study confirms writers with AI access score higher for novelty and usefulness. Verdict: Accurate.

Prediction: A/B Testing Boon

AI would enable rapid idea generation for testing.

"This is going to be a massive boon for A/B testing scenarios. You can have AI generate a number of ideas and send them into a testing environment where they can be tested against reality."

Napkin Ideas Post, December 2022

Analysis: Yeah, this is standard practice now in marketing, product design, ad copy. Verdict: Accurate.

Prediction: Yoda vs. Einstein Framework

LLMs have wisdom, not mathematical precision. Don't ask Yoda to do your taxes.

"Imagine this thing like Yoda rather than Einstein. Einstein does math. Yoda has wisdom. Don't ask Yoda or GPT to do your taxes; they'll disappoint you."

Napkin Ideas Post, December 2022

Analysis: This framework has held up remarkably well. Nature's 2025 research confirms AI "can make only incremental discoveries but cannot achieve fundamental discoveries from scratch as humans can." LLMs are pattern recognizers with deep recall, not original thinkers. Verdict: Accurate—still use this framing constantly.

Prediction: Analytical Optimism

The transition would be traumatic but ultimately positive.

"It's going to be traumatic, and it's going to be wonderful."

Napkin Ideas Post, December 2022

Analysis: Stanford's 2025 AI Index shows optimism growing in previously skeptical countries. The "analytical optimism" framing has become pretty standard in enterprise AI discussions. Verdict: Accurate as a framework.


Prediction: GPTs Genuinely Understand

LLMs actually understand things—they don't just pattern match.

"The ability to apply knowledge in new situations and contexts."

Yes, GPTs Actually Understand, March 2023

I used a complex prompt—asking GPT to write a Faustian hero's journey with a Socratic sister, Machiavellian mother, shibboleth plot point, magical scarf, 3-legged dog, dystopian setting, and Ted Lasso ending. It nailed it.

Analysis: The philosophical debate continues, but practically speaking, LLMs do something that functions like understanding. Research from 2025 confirms they develop a "geometry-like" understanding adequate for many applications. They have limits—they lose track of chess positions after a few moves—but "mere pattern matching" doesn't capture what they do. Verdict: Functional understanding confirmed, philosophical debate ongoing.

Prediction: Substrate Doesn't Matter

Dismissing AI understanding because it's silicon instead of neurons is flawed.

Analysis: The AI field now operates as if substrate doesn't matter. OpenAI's o1 achieved 83.3% on competition math vs GPT-4o's 13.4%—reasoning capabilities emerging regardless of substrate. The consciousness question is philosophically interesting but practically irrelevant. Verdict: The field has moved on from this objection.

Prediction: SPQA Architecture

AI would transform software from circuit-based to understanding-based systems.

"Companies displaying their wares through websites and legacy software will be replaced by custom GPT models that ingest everything that makes up that business."

SPQA: The AI-based Architecture, March 2023

STATE, POLICY, QUESTIONS, ACTION—I predicted most legacy software would be replaced by LLM-based systems with this structure.

Analysis: System prompts with structured formats have become industry standard. OpenAI's best practices recommend exactly this kind of structured approach. Verdict: Directionally correct, but we've yet to see large-scale enterprise rollout.

Prediction: People Become APIs

Individuals would create AI models of themselves for interaction.

"Just as businesses have logs and docs, we'll upload all our journals, photos, social media, preferences, and everything else."

SPQA Architecture Post, March 2023

Analysis: The gig economy has restructured around API-like interfaces. 70 million Americans (36% of workforce) now freelance through platforms that essentially treat humans as callable services. But personal AI models for self-exploration? Not mainstream yet. Verdict: Structural shift happening; personal model aspect still emerging.

Prediction: The Creativity Explosion

AI would democratize creative output on a massive scale.

"We're about to multiply the creative output of planet Earth by hundreds of orders of magnitude."

6 Phases of the Post-GPT World, March 2023

Analysis: This is absolutely happening. The last month of 2025 went nuts—Claude Code enabled people to build and ship things that would have taken teams months to create. Solo developers launching full products in days. Non-programmers building functional apps. The creative output explosion isn't theoretical anymore; it's all over social media every day. Verdict: Accurate—this is happening right now.

Prediction: Inverse Order of AI Replacement

I initially thought blue-collar jobs would go first, but realized artists would be hit first instead.

This was actually a prediction I got wrong initially and then corrected. Worth noting.

Analysis: Artists, writers, designers—the creative class got hit first. DemandSage data shows graphic artists (-33%), photographers (-28%), writers (-28%). Physical labor jobs remain harder to automate. Verdict: Correction was accurate.


Prediction: Agents and Multi-modal Are Key

These two capabilities would be the most transformative areas of AI development.

"These days I get most AI-excited about Agents and Multi-modal, which is where AI can do its karate on more than just text."

— Newsletter, October 2023

Analysis: Every major AI lab is now building computer-use agents with visual understanding. Claude's computer use allows Claude to see screens, click buttons, type. GPT-4o integrates real-time audio, vision, and reasoning. This is exactly where AI development concentrated. Verdict: Accurate.

Prediction: AGI by 2025-2028

60% chance by 2025, 90% by 2028—through systems, not single models.

"An AI system capable of replacing a knowledge worker making the average salary in the United States."

Why We'll Have AGI by 2025-2028, November 2023

Analysis: This remains highly contested. Sam Altman (Jan 2025) said they "know how to build AGI." Andrej Karpathy says AGI is "around a decade away." The definition problem is real. I'll be honest—this is one where I was confident and the jury is very much still out. Verdict: Within the window; heavily definition-dependent.

Prediction: Prompt Injection Endemic

Agent-based systems would create massive new attack surfaces.

"The amount of prompt injection we're about to see propagate across the Internet is going to be staggering."

OpenAI's November 23' Releases, November 2023

Analysis: Prompt injection is now OWASP's #1 LLM vulnerability for 2025. OpenAI stated in December 2025: "Prompt injection is unlikely to ever be fully 'solved.'" 24 CVEs were assigned for AI tool vulnerabilities in December 2025 alone. Verdict: Accurate—endemic status confirmed.

Prediction: The 7 Components of AI's Future

A comprehensive framework: Digital Assistants, Everything Gets an API, DA Mediation, Active Protection, Module Ecosystem, AR Interfaces, Multiple Specialized DAs.

"Tech isn't predictable. But humans are."

AI's Predictable Path, December 2023

Analysis: The framework seems solid, but honestly this is a bit too nebulous to give myself a thumbs up on. The categories feel right, but it's hard to point to concrete evidence that says "yes, this specific framework was correct." Verdict: Too vague to score definitively.

Prediction: DA Hacks Will Be Catastrophic

Compromising someone's Digital Assistant would be devastating.

"Hacking someone's Digital Assistant will be like compromising their soul. Not their accounts. Not their tech. Their soul."

AI's Predictable Path, December 2023

Analysis: This is happening. Microsoft Copilot's "EchoLeak" vulnerability was the first documented zero-click attack on an AI agent. GitHub Copilot RCE enabled an "AI virus" that propagates as developers interact with infected files. Anthropic disclosed a Chinese state-sponsored group used Claude Code to attempt infiltration of 30+ global targets. Verdict: Accurate—catastrophic DA hacks are now documented.


Prediction: Prompting is Primary

The quality of prompts matters more than model choice, RAG, or fine-tuning.

"90% of AI's power is in prompting—NOT RAG, NOT fine-tuning, NOT even the models themselves."

AI is Mostly Prompting, May 2024

Analysis: I'll take a victory lap on this one. People spent 2024 chasing RAG and fine-tuning, and now in late 2025 everyone's re-discovering that prompting (now called "context engineering") is where the leverage actually is. IBM's 2025 guide states: "Prompt engineering is the new coding." I said this in May 2024 and got pushback. Now it's consensus. Verdict: Accurate—and people are finally catching up.

Prediction: Slack in the Rope

There's massive untapped potential in AI capabilities—not from bigger models or more compute, but from tricks, techniques, and optimizations we haven't discovered yet. I called this "slack in the rope."

"I've been shouting from the rooftops for nearly two years that there is likely massive slack in the rope, and that the stagnation we saw in 2023 and 2024 around model size will get massively leaped over by these tricks."

The 4 Components of Top AI Model Ecosystems, August 2024

I was specific about what this meant:

"I think of it as a set of highly proprietary tricks that magnify the overall quality of the raw model... Post-training is perhaps the most powerful category of those tricks. It's like teaching a giant alien brain how to be smart, when it had tremendous potential before but no direction."

The 4 Components of Top AI Model Ecosystems, August 2024

And by September 2025, I was able to point to specific examples:

"For example, 'chain of thought' reasoning. Having an AI talk through the various steps of a process and sort of self-observe turned out to have extraordinary gains. And there are many other such gains that had to do with simply reorganizing how data was taken in or the order in which data was taken in."

Our Constraints on Creativity, September 2025

The core insight: most people assumed AI progress would come primarily from scaling—bigger models, more GPUs, more energy. I argued that tricks like post-training, chain-of-thought, better prompting, and architectural innovations would deliver outsized returns compared to raw compute scaling.

Analysis: This one has proven extremely accurate. Chain-of-thought reasoning, RLHF, DPO, constitutional AI, prompt caching, structured outputs, tool use—the list of "tricks" that delivered massive capability gains keeps growing. Anthropic's research shows their constitutional AI approach dramatically improved model behavior without scaling. OpenAI's o1 and o3 models achieved reasoning breakthroughs through inference-time compute tricks, not just model scaling. The entire "post-training" category I identified has become the primary battleground for model differentiation. Much of the 2024-2025 progress came from exactly what I predicted: clever tricks, not just more parameters. Verdict: Accurate—the slack in the rope thesis was vindicated.

Prediction: 2025 = Year of Agents

Agent frameworks would mature enough for real-world use.

"I'm anticipating that in 2025 the biggest thing in AI will be the maturation of Agents."

— Newsletter, November 2024

Analysis: Claude Code is an agent. It reads files, writes code, runs commands, debugs errors, and iterates autonomously. That's what agents are. The prediction wasn't about enterprise adoption metrics—it was about agents maturing enough to be genuinely useful, and that absolutely happened in 2025. Claude Code changed how people build software. Verdict: Accurate—Claude Code is the proof.

Prediction: Ecosystem Over Models

Tooling and ecosystems would matter more than model improvements.

"The models will get smarter, but I think most of the benefit will be in the tooling and ecosystems around the models."

— Newsletter, November 2024

Analysis: MCP became industry standard within one year. 10,000+ servers, 97 million monthly SDK downloads. GitHub, VS Code, Cursor integrated natively. Anthropic donated MCP to the Agentic AI Foundation. Verdict: Accurate—ecosystem thesis completely validated.


Prediction: Apple's AI Turnaround

Apple would go from worst to best AI implementation through ecosystem integration.

"Apple's about to go from having the worst AI implementation to having the best."

— Newsletter, January 2025

Analysis: This is a major timeline miss. I expected this to happen quickly—within months. A year later, it still hasn't. Apple Intelligence adoption has been underwhelming. The Siri overhaul keeps getting pushed back. I still think Apple will eventually get this right—the ecosystem advantage is real—but my timing was way off. Verdict: Timeline miss—may still happen, but I was early by 1-2 years.

Prediction: Calibrated Disruption Timeline

Job displacement would be gradual, not sudden. 2025 sees adoption; 2026-2027 brings restructuring; 2028+ dramatic transformation.

"We're not going to suddenly in 2026 have 10 or 20% unemployment."

— Newsletter, May 2025

Analysis: Timeline appears mostly accurate with one exception: creative work disruption is ahead of schedule. Already seeing 28-33% declines in graphic artists, photographers, writers in 2025. Verdict: Mostly accurate—creative work faster than expected.

Prediction: Claude Code as Proto-AGI

Claude Code represented a ChatGPT-level leap for development.

"I think, looking back, we might say that the first week of July 2025 was the start of AGI. Like, proto-AGI."

— Newsletter, July 2025

Analysis: I don't even remember writing this in July, but holy crap has it proven true. Claude Code does 30+ hours of autonomous coding. It reads, writes, debugs, iterates, and ships. Anthropic scaled from 0 to $400M ARR in 5 months. The "proto-AGI" framing felt bold at the time—now it feels obvious. Verdict: Accurate—this aged extremely well.

Prediction: VCs in Trouble

The venture capital model would face disruption as solo developers reduce capital requirements.

"VCs, as a species, are in serious trouble right now."

— Newsletter, September 2025

Analysis: Axios reports VC faces disruption—"Capital intensive businesses don't exist anymore." Founders collecting enough in one round to achieve profitability. But also: Bloomberg reports $192.7B poured into AI startups, with AI capturing 52.5% of all VC dollars. Verdict: Structural disruption real, but elite AI VCs thriving—nuanced.

A framework for understanding why AI disruption is significant—AI combines all three.

"When companies pay ICs to do tasks they're actually paying for three different things: One or more tools, an operator, and an outcome."

— Newsletter, October 2025

Analysis: McKinsey's "Agentic Organization" describes exactly this hierarchy. Deloitte notes: "Agentic AI is about delegating outcomes, not just prompts." Verdict: Framework maps to industry analysis.

Prediction: Prompt Injection IS a Vulnerability

It should be classified as a vulnerability, not just a limitation.

"A vulnerability where an AI system or component is unable to distinguish between instructions and data."

Is Prompt Injection a Vulnerability?, November 2025

Analysis: The industry shifted. Prompt injection now receives CVE assignments. 24 CVEs in December 2025 alone. Microsoft formally documents their defenses. Debate settled. Verdict: Accurate—now a formal vulnerability class.

Prediction: Anthropic's Apple Moment

Anthropic's ecosystem advantage mirrors Apple's iPhone dominance.

"Anthropic right now feels like Apple in the 2010s with the iPhone."

— Newsletter, December 2025

Analysis: The Apple comparison became literally true. Bloomberg reported Apple partnered with Anthropic on a coding platform. Anthropic captured 32% enterprise market share (vs OpenAI's 25%). Verdict: Accurate—partnership validated the ecosystem thesis.


Prediction: AI Zombie Apps

Abandoned AI projects would create security and financial problems.

"Significant technical debt from abandoned AI projects—security problems from misconfigurations, keys, API tokens."

AI Changes I Expect in 2026, January 2026

Analysis: Margin compression is crushing wrapper startups. DeepSeek R1 operates at ~5% of OpenAI o1's costs. TechCrunch reports Cursor may be running negative margins. 60-70% of AI wrappers generate zero revenue. Verdict: Tracking—prediction made recently, evidence accumulating.


StatusCountDescription
ACCURATE16Definitively happened
TRACKING16Directionally correct, still playing out
IN PROGRESS2Too early to call
PARTIAL2Partly right, partly wrong
FRAMING2Useful model, not verifiable
OPINION2Characterization, not prediction
BUILDING1Actively working toward
NUANCED1More complex than predicted
OVERSTATED1Overshot the reality
TIMELINE MISS1Right idea, wrong timing
PredictionMadeStatusHonest Assessment
Universal Daemonization/APIs2016ACCURATECore idea right, implementation different
Digital Assistants as interface2016TRACKINGHappening, slower than expected
DAs Understanding Context2016ACCURATE"Context engineering" before it existed
Services Designed for DAs2016TRACKINGMCP is building toward this
Tireless Advocate2016TRACKINGAgent frameworks implementing this
Business Interaction via DAs2016TRACKINGStill materializing
AR Overlays2016TRACKINGDirectionally correct, hardware pending
Reputation as Infrastructure2016PARTIALExists in fragments, pushback on vision
Continuous Authentication2016TRACKINGMoving in this direction
Businesses Become APIs2016ACCURATETrue for tech, less for broader economy
ML + Evolutionary Algorithms2016ACCURATEAlphaFold proves it
Desired Outcome Management2016BUILDINGStill working toward this vision
Knowledge work replacementDec 2022ACCURATE75% using AI, 30% hours automatable
Non-replacement vs. layoffsDec 2022ACCURATEGradual attrition playing out
Talent gap expandingDec 2022PARTIALGap is adopters vs non-adopters
Solopreneurs thriveDec 2022TRACKINGOne-person unicorn imminent but not yet
Best AI = most expensiveDec 2022ACCURATEPremium AI still meaningfully better
Dynamic generalist employeesDec 2022TRACKINGTrending this direction
Ideas over implementationDec 2022TRACKINGEarly days but directional
Liberal arts renaissanceDec 2022OVERSTATEDReality more nuanced
IP battlesDec 2022ACCURATEGetty, NYT, countless cases
Multimodal excitementDec 2022ACCURATEEasy call in retrospect
SOC analyst AIDec 2022ACCURATEActually useful now
Hollywood troubleDec 2022IN PROGRESSDisruption slower than expected
AI as museDec 2022ACCURATEHow most creatives use it
A/B testing boonDec 2022ACCURATEStandard practice now
Yoda vs EinsteinDec 2022FRAMINGUseful mental model, not verifiable
GPTs understandMar 2023TRACKINGFunctional understanding, debate ongoing
SPQA architectureMar 2023TRACKINGDirectionally correct, enterprise rollout pending
Creativity explosionMar 2023TRACKINGClaude Code explosion suggests it
Agents + Multimodal keyOct 2023ACCURATECentral to AI development
AGI by 2025-2028Nov 2023IN PROGRESSWithin window, definition-dependent
Prompt injection endemicNov 2023ACCURATEOWASP #1, CVEs assigned
DA hacks catastrophicDec 2023TRACKINGAttacks documented, catastrophe pending
Prompting is primaryMay 2024ACCURATESaid it early, people finally catching up
Slack in the ropeAug 2024TRACKINGStrong evidence, thesis holding
2025 = Year of AgentsNov 2024ACCURATEClaude Code is the proof
Ecosystem > modelsNov 2024TRACKINGMCP strong evidence
Apple turnaroundJan 2025TIMELINE MISSStill waiting, 1-2 years off
Claude Code proto-AGIJul 2025OPINIONCharacterization, not verifiable
VCs disruptedSep 2025NUANCEDStructural change real, AI VCs thriving
Tools/Operators/OutcomesOct 2025FRAMINGUseful taxonomy, maps to McKinsey
Prompt injection = vulnerabilityNov 2025TRACKINGStrong consensus forming
Anthropic = Apple momentDec 2025OPINIONFraming, not verifiable

  • Predicting humans, not technology. One of my meta-predictions was that predictions are even possible in the first place—because human desires and behaviors are fairly stable, even if specific technologies are not. I think this is the biggest reason I've been right about so much: I wasn't predicting which tech would win, I was predicting what people would want to do once tech got good enough. Those use cases don't change.
  • High accuracy on systemic/architectural changes. The predictions about how AI would change software architecture, business structure, and creative work have largely materialized.
  • The prompting thesis held up. Context and good prompts continue to matter more than fine-tuning for most use cases.
  • Security concerns were prescient. Prompt injection is endemic, DA hacks are happening, and the vulnerability framing won.
  • Ecosystem over models was spot-on. MCP, tool calling, agent frameworks—the tooling explosion has been bigger than model improvements.
  • Slack in the rope thesis vindicated. I argued in 2023-2024 that tricks and post-training would deliver more progress than raw scaling. Chain-of-thought, RLHF, inference-time compute—the "tricks" delivered exactly the outsized gains I predicted.
  • Agents and Multimodal called early. These became the central focus of AI development exactly as predicted.

  • Apple's AI turnaround. Major timeline miss. I thought this would happen over a year ago. Still think it'll happen eventually, but I was way early.
  • Liberal arts renaissance. Overstated the case. Reality is more nuanced—both technical and humanistic skills matter.
  • Hollywood disruption timeline. Slower than expected. The tools aren't quite there for feature-length content yet.
  • AR overlays everywhere. The direction is right but the hardware isn't there yet. We need lighter, cheaper, longer-lasting AR glasses before this goes mainstream.
  • Full reputation-as-infrastructure. This exists in fragments but the comprehensive vision faces real pushback.

  1. Technology predictions are easier than people predictions. My track record on how AI would change systems is much better than predictions involving human behavior and adoption.

  2. Existence and adoption are very different things. A technology can exist and be obviously useful, but that doesn't mean companies will adopt it—especially ancient company structures run by Game of Thrones politics. The people with the power to bring in new technology are often the ones who'd be threatened by it. I significantly underestimated natural human friction to progress. I knew it would exist, but I didn't weigh it heavily enough.

  3. Frameworks age better than specific predictions. "Yoda vs. Einstein" and "Tools/Operators/Outcomes" have been more useful than specific timeline predictions.

  4. Being honest about uncertainty is valuable. The predictions I hedged appropriately have held up better than the ones where I was overconfident.

  5. Never bet against manic visionaries. One of my biggest blind spots over the years has been underestimating leaders like Jensen Huang, Elon Musk, and Steve Jobs. There's something extraordinary about someone who is slightly crazy, deeply passionate, and simply never stops. This manic energy—the relentless drive that makes others uncomfortable—is far more important than it appears. These people warp reality around them. I've consistently underweighted this factor when making predictions about companies and technologies.


If you haven't done a prediction retrospective on yourself, I highly recommend it. You can get all sorts of stuff from it. An ego boost. A desire to delete things from the Wayback Machine. Lots of fun.

I puff out my chest when it comes to AI predictions —especially after this exercise—because I've done really well there. But in other areas of prediction, I look fairly stupid. My Predictions page includes plenty of misses that keep me asking how the hell I could be that stupid (see Ukraine).

The goal isn't to be right all the time, in every given moment, but to be able to adjust your model of the world when you're wrong. You can't do that without documenting what you actually said, comparing it to what actually happened, and being honest about the delta.

It's a fun ego boost when you have solid calls that few people had, especially going back a long ways. But the true opportunity for wins comes from looking at the failures and asking,

What about my world model made me think that?

And even more importantly...

Given those numerous mistakes, and my current beliefs, which are most likely to be flawed right now?


文章来源: https://danielmiessler.com/blog/my-ai-predictions-retrospective?utm_source=rss&utm_medium=feed&utm_campaign=website
如有侵权请联系:admin#unsafe.sh