If there is one thing we can say for sure, it’s that humans are terrible at analyzing trade-offs. We are terrible at envisioning them before they occur, and we often fail to recognize them after they arrive. This is what Marshall McLuhan meant when he said that self-amputation forbids self-recognition. Yet every time we apply technology to a task or problem, trade-offs occur and unexpected consequences follow.
I remember when people thought social media was just a silly platform for sharing pictures of their dinner. This perspective seems downright naive in hindsight. Yet this pattern repeats itself again and again.
In my previous article on why augmentation is amputation, I introduced a process called ARM (Awareness, Recognition, and Mitigation). This process helps identify and defend the skills you care about. In this article, I’m releasing something to help you understand the trade-offs involved in applying technology to tasks so you can identify negative impacts and account for them.
Even though we know trade-offs happen, we still do nothing about them. There is no attempt at analysis, only adoption. This is why I created The Technology Impact Bowtie.
The Technology Impact Bowtie
Whenever you ask people what skills they need for the future, analyzing trade-offs is noticeably absent. However, I believe analyzing trade-offs is one of the most important skills people can develop in our chaotic, uncertain times. We often rush to push technology as fast as we can, everywhere we can, without ever considering the negative impacts.
During my keynote at Black Hat India, I introduced what I call The Technology Impact Bowtie (TIB) as a way to surface impacts when applying technology to tasks or problems. It makes potential negative impacts visible when other factors often obscure them.
Every time we apply technology to a task or skill area, something is amplified, devalued, and lost, creating impacts. It’s key to surface these impacts so we can account for them.
Often, when applying technology, most of the focus is on what it amplifies and any positive impacts this creates. This amplification obscures other factors, since the amplification is visual and often the reason technology is applied in the first place.
The Technology Impact Bowtie is inspired by the McLuhan Tetrad of Media Effects. However, the McLuhan Tetrad focuses on a specific medium and its overall effects on society, whereas the TIB is a practical approach used when applying technology to a given task or skill. This practicality makes the TIB much more actionable for people and organizations.
Applying the TIB doesn’t have to be some large formal exercise. The TIB is a model, and you can potentially do it entirely in your head, depending on the situation. It can be as simple or as complex as you like.
AI Coding Example
Let’s look at an AI coding example. What follows are just a few simple values for demonstration. For each category, you’d want something a bit more comprehensive to ensure you are capturing the scope of negative effects.
What’s Amplified
The ability to automatically generate code and entire programs, including program testing.
What’s Devalued
Human coding abilities.
What’s Lost
Code comprehension and understanding. Foundational technology skills.
What’s the Impact
Bugs and security issues make it into applications. Failures more difficult to troubleshoot. Technical debt continues to add up.
You can expand on each category of the bowtie by adding more data. This is especially true in the impacts section. For example, losing a skill can create many different impacts that you’d want to account for, which is the whole goal of the process.
Conclusion
As humans are increasingly devalued in technological processes, it’s important that we keep the skills that matter to us. We can’t keep our systems in check if we lose the ability to do so. A big part of retaining these skills is the ability to identify trade-offs. Using the Technology Impact Bowtie and ARM together can be a powerful way to curb the negative impacts of technology adoption, stave off negative consequences, and protect what we care about.
Read it for me, write it for me, think it for me, do it for me. These are the essential commands of the AI era. By thinking we are freeing ourselves, even if we’re only freeing our time, we create more dependence and become further removed from problems. Instead of freedom, we get confinement, locked into doing things because of technique, not excellence, and inevitably dooming us to doing things because we can, not because we should.
We become almost giddy with excitement as we give up our skills and control, content with the illusion of competence, convinced we are the puppet master pulling all the strings, not realizing we’re the ones being pulled, shoved into tiny boxes and constrained in ways we don’t recognize. Novelty and ingenuity are replaced with mechanization and automation, creating conditions where we are far removed from the tasks and problems being solved, leading us to miss the point and build solutions not to the problems themselves, but to problems created by our previous solutions.
This is the world we accelerate into, our destiny. But we must recognize that we are not heading into a solved world. Far from it. We are headed into a world where problems persist, yet we lose the skills necessary to address them directly. Humans are shifting roles from operators to monitors and finally to spectators, creating a world not of abundance but dependence and leaving us vulnerable to a wide range of unintended consequences.
Note: Since people will get the wrong idea, this article isn’t telling people not to use AI. This article is about making purposeful choices, understanding the trade-offs, and deciding what’s best for you and your tasks. Use AI where it benefits you most and employ strategies to protect the skills you care about.
Table of Contents
So What?
As I returned from the annual pilgrimage to Las Vegas for Black Hat and DEF CON, I scribbled my thoughts in a notebook while I waited for my plane’s mechanical issue to be resolved. Needless to say, I didn’t make it home that day.
Fresh on my mind was the apparent nonchalance about the impending death of skills and the changing role of humans in processes. Various people I spoke with throughout the week expressed these views. If you are familiar with my writing, you’ll know this is a topic I spend an inordinate amount of time thinking about. So, before we begin, let’s address the inevitable response: “So what?”
Some may respond that AI and associated tooling let people do more with less, and do it even faster. AI also offers other advantages, like making some processes less error-prone or letting someone with little experience perform a complex task. So, who cares if people lose their skills, or never develop them in the first place? Although this perspective has some substance, it’s hardly universal or evenly distributed across industries and roles, but fair enough. Let’s roll with this.
The thing to consider is that we are not entering a solved world or even a world with a solved industry. This means the problems we face will persist long after we lose our skills. We may gain more tools and more abstraction, but not more insight or knowledge into the problems we need to solve. We are actually getting less. In essence, we create new vulnerabilities and dependencies, but we don’t give them a second thought as we trade them away.
Here are two points to consider about current-state and near-future AI solutions.
AI doesn’t solve all of the problems of any given industry.
AI creates new problems of its own.
Technology is always about trade-offs. Maybe a world with few skills is the world we want, but that’s not a consideration today. Nobody is asking if what we are getting is worth what we are losing. Or even if we can adjust our approach to offset what we are losing, either within the technology or through other methods and controls. Current AI technology is being treated as a total and complete solution without trade-offs, but that isn’t the case. Maybe this is because people think we are building a machine god. However, this thinking leads us to ignore the unintended consequences looming on the horizon.
This article isn’t meant to propose a universal solution to the issues emerging from trade-offs. In many cases, especially when transforming entire industries, there isn’t much we can do. In a way, it reminds me of Jacques Ellul writing an entire book on what he called “technique.” His book is filled with observations of decline and negative impacts on humans but not a single solution. He presented the information to surface the issues, making them visible to readers. Individuals were left to ponder and potentially mitigate how/if they pleased.
My hope is that at least some people will become more sensitive to what they may be losing so they can shore up gaps, either in their own knowledge or in the processes they employ. We as individuals need to protect what we care about, because other people won’t.
The Changing Role of the Human
What’s the human role in our newly developed technological systems? We’ve become so caught up in using tools that we become blind to their true impacts.
Instead of being operators, hands-on with the environment and problems we are trying to solve, we’re becoming monitors, hands-off, happy to observe, setting the process in motion but taking no part in it. Jacques Ellul noticed this shift back in the 1950s, and it’s gotten far worse since then.
This means that man participates less and less actively in technical creation, which, by the automatic combination of prior elements, becomes a kind of fate. Man is reduced to the level of a catalyst. Better still, he resembles a slug inserted into a slot machine: he starts the operation without participating in it. -Jacques Ellul, The Technological Society (1954)
Modern slot machines are a great example because they often give us the impression of winning even as we lose. In her excellent article on “dark flow,” Rachel Thomas said this:
On a traditional slot machine, you either win or lose. In contrast, multiline slot machines have 20 rows going at once and reward partial “credits” that create a false sense of winning even as you lose. For example, you can gamble 20 cents and receive a 15 cent “credit”. This is actually a 5 cent loss, yet the slot machine plays celebratory noises that trigger a positive dopamine reaction. -Rachel Thomas
We certainly don’t see ourselves as merely slugs in a machine. We see ourselves as winners, even as we lose, and don’t recognize the difference between AI doing something and us doing something. We see it as one and the same. However, even though AI is a tool, it’s also our competition, stealing opportunities and experience and robbing us of knowledge and understanding.
These issues are not new. In the “Monitoring” section of her 1983 paper called Ironies of Automation, Lisanne Bainbridge makes the following observation about the human capability to take over from an automated system:
“One complexity which it does raise of course is that the supervisor too will not be able to take-over if he has not been reviewing his relevant knowledge, or practising a crucial manual skill.” Lisanne Bainbridge, Ironies of Automation (1983)
Granted, it’s not always extreme, and we may not care about some skills. Fair enough. However, we aren’t recognizing the condition at all today and making conscious decisions about which skills to protect and which we are comfortable losing. We are setting the stage for the emergence of unintended consequences, including the death of skills and the persistence of problems.
The Death of Skills
So, we are confronted with a core question:
What does the death of skills and the changing role of humans mean as we face an unsolved world?
I’ve been warning about what I call cognitive atrophy, or what some call cognitive surrender, for years now. I’ve mapped out what I call the personas of personal AI. These are the personas users want AI to embody for them as they over-rely on the technology. I’ve also called out some impacts, which I refer to as the four D’s of personal AI risk. These are just a taste, but augmentation with technology has many consequences people don’t recognize.
Augmentation is Amputation
Marshall McLuhan observed that every augmentation is also an amputation, one that forbids self-recognition. That lack of self-recognition is why we often don’t notice the negative impacts of augmenting ourselves with technology. Although we will eventually notice muscle atrophy in our legs when we augment them with something like a robotic exoskeleton, atrophy in cognitive tasks can be much harder to confront.
Self-amputation forbids self-recognition. -Marshall McLuhan, Understanding Media (1964)
This lack of self-recognition means we won’t even recognize the condition as skills atrophy and wither.
The number of people who seem perfectly fine being replaced, outsourcing all of their tasks and reducing their relevance, is puzzling. As Marcus Hutchins recently put it, “Being promoted to the world’s saddest project manager.”
I believe people aren’t concerned for several reasons, one of which is that playing with tech can be fun. But I think this mostly comes from the impression of being an all-powerful puppet master, completely in control, commanding a fleet of agents doing your bidding. But that’s not how it works in practice.
Humans evolved to be cognitively lazy and, like water, we take the path of least resistance. The call of cognitive offloading is too powerful, and the allure of an oracle is too enticing for many to resist.
Take the case of Josh Autenrieth. In 2020, an explosion at Watson Grinding triggered a lawsuit that included the company 3M. 3M engaged Autenrieth, who works for Nighthawk Engineering, to prepare an expert report. When one of the plaintiff’s attorneys noticed that the report appeared to have been generated by ChatGPT, the attorney requested all the prompts, a precedent that will no doubt be utilized far more in the future.
The details are egregious, and the full story, detailed by 404 Media, can be read here. Let’s just say this wasn’t someone using ChatGPT to write a report for them. Autenrieth also used ChatGPT to do the analysis and thinking for him, basically doing the job he was hired to do. Let’s keep in mind that he’s supposed to be an expert, but the 404 Media article had examples like this:
Although it’s easy to roll your eyes and call this an exception, it’s not the exception people think it is. We are creating an entire society of Autenrieths. They are out there, doing work every day. Not at some distant point on the horizon, but today. The only difference is they don’t have a court of law to scrutinize their work product. They may be in different industries with different stakes, but they are out there nonetheless.
We all know someone, or work with someone, who was barely competent at their job in the first place, but now, with ChatGPT, Copilot, or whatever, they project themselves as rock stars, flexing the epitome of competence but creating a slop-filled swamp, leaving more competent people to take on the role of slop janitor.
As a critic, I find the stories people tell me both comical and terrifying. For example, the developers who are told that they care too much and that their job isn’t to write code anymore, but to be QA. Meanwhile, their co-workers hurriedly push code into production without understanding it. Others don’t realize their builds are failing and struggle with foundational technologies like Terraform. Today’s foundational skills will confound tomorrow’s workers.
The sad part is that this is exactly the situation AI companies want. A society of Autenrieths with degraded skills and high tool dependence. Ah, I can smell the utopia now.
Losing skills has a blast radius we often don’t recognize. Most people don’t give using GPS a second thought compared with using maps or landmarks, but it’s been linked to a loss of spatial memory. What else might we be giving up that we don’t realize until it’s too late?
Trading Strong Skills for Weak Skills
People who lose skills can struggle to recognize the loss. This is especially true when a role or industry has already shifted, and new people enter the workforce. You are unlikely to identify missing skills you never developed. Even worse, when shown these foundational skills, newcomers to a field may find practicing them painful.
However, during the shift, this lack of identification is further obscured when exchanging strong skills for weak ones, because weak skills can masquerade as strong skills. Basically, the person with the traded skills still feels like they are accomplishing the same tasks, even though they’re not exercising the same skills. In many cases, this may even be true, but only up to a point.
For example, monitoring a dashboard or configuring a UI is a weak skill because it completely obscures the underlying activities and their complexity. It’s both a bug and a feature. In many cases, the user knows there’s a configuration option or checkbox, but has no idea what actually happens when they select it. This is what I mean when I say we are transitioning to being more “hands-off” with processes.
Imagine an analyst who used to reverse engineer malware to understand how it works, now merely uploading it to an AI tool and getting a high-level report. Or a penetration tester who previously used a variety of techniques and tools to identify weaknesses in a system, now merely pointing an AI-powered scanner at an environment and reading the results.
We are replacing discovery through exploration and the direct application of skills and knowledge with automated responses curated through dashboards and user interfaces. This is further fueled by people’s preference for being told things rather than discovering them, which also negatively impacts satisfaction. Of course, only one of these scenarios allows technical knowledge to grow and new discoveries to emerge.
“One result of skill is that the operator knows he can take-over adequately if required. Otherwise the job is one of the worst types, it is very boring but very responsible, yet there is no opportunity to aquire or maintain the qualities required to handle the responsibility.” -Lisanne Bainbridge, Ironies of Automation (1983)
In many ways, this aligns with our innate human need for shortcuts and an organization’s desire for optimization. We’d rather be told answers than discover them. But nobody thinks about the current situation this way. This skill trading is a byproduct of a role change or a new tool that reshapes the landscape, so it can “feel” as though we’ve gained something even though we’ve lost it.
Death of Future Skills
Humans aren’t being replaced en masse by AI in the workforce yet, although they are being replaced by high hopes. Actually, this isn’t entirely true. AI is affecting some industries more than others, mainly jobs in media and arts. However, where AI is deployed and how it’s used can have a cascading effect.
AI can become a self-fulfilling prophecy for the extinction of skills, creating conditions for skill degradation in the present and guaranteeing their extinction in the future. This happens as junior roles are eliminated, change completely, or lose chances to flex real skills. This condition isn’t obvious or a concern for a CEO focused on quarterly numbers, but it should matter to us and society at large. A lack of skills creates vulnerabilities.
There is some concern that the present generation of automated systems, which are monitored by former manual operators, are riding on their skills, which later generations of operators cannot be expected to have. -Lisanne Bainbridge, Ironies of Automation (1983)
Fragility
Our technologically advanced world seems all-powerful, as though we can accomplish anything, but this perception masks a dark truth. Our modern, advanced world is incredibly fragile. We see it every time a natural disaster, power outage, war, or other unexpected event occurs. Although unexpected events on this scale seem rare, they are far more common in everyday life and business.
When people lose or fail to develop skills, the world becomes even more fragile because dependency skyrockets. Small issues can balloon into major problems. People fail to understand not only how the systems they interact with work, but also how the whole world works. We are left with a world where technology-created problems can only be solved by piling on even more technology because we lack insight into the true nature of problems. Human ingenuity is no longer a factor because we’re too far removed.
AI Is Not Just Any Tool
Part of the nonchalance about AI stems from the perception that AI is just a tool like any other. Although I agree that (today) AI is just a tool, it’s not just any tool. It’s a cognitive tool that can plan and take action. A tool that abstracts us from the problems we are trying to solve, adding complexity in the process. Only the complexity is completely obscured behind a simple-looking response.
Many now believe what we are going through is like other technological revolutions, and that we’ll just adapt to this new way of doing things. One example is the shift from programming in assembly language to a higher-level language like C or Python, and now we are programming in “natural language,” but this isn’t remotely the same.
With a high-level programming language, you’re still confronted with a representation of the problem space. You subsequently need to perform actions such as setting and reading variables, performing iterations, and debugging and troubleshooting. What changes is syntax. Sure, the developer becomes abstracted from opcodes, registers, and other platform specifics, but the shape of the problem remains.
Sure, the generated code can still be reviewed and debugged by a human. This is true. But those skills degrade when you don’t write code manually at least some of the time. The human simply becomes a meat sack button pusher, approving every change and often not realizing something isn’t working as expected.
In addition, when performing the task yourself, you’re forced to reason about the situation and problems you face. There’s less cognitive laziness in writing code by hand. Well, for those who don’t simply copy/paste everything from Stack Overflow anyway. In many cases, you need to reason about what you are doing and why. This is not the case with AI.
Developers are now told their job isn’t to write and understand code or to understand architecture, but to push more code. This is like telling a carpenter their job isn’t to understand construction or architectural plans, but to use more lumber. The negative consequences of both scenarios should be obvious.
As I mentioned, AI use doesn’t represent a problem space. It’s more like an amorphous blob giving no indication of shape or form. Requests are issued, output is spit out, and decisions are made. We are no longer hands-on with problems. We are miles away munching on a cheeseburger, waiting for a notification of a result.
Each AI advancement is dehumanizing and removes agency. This isn’t always bad. For example, we may decide that self-driving cars are preferable to human-driven cars, so we give up some agency and the human aspects of driving. But we should recognize that this dehumanization and removal of agency happens to whatever activity AI is applied to.
Losing the shape and form of problems creates many unintended consequences. In the self-driving car example, humans are asked to take control in the most challenging of situations. The very situations they are now unprepared for due to the dehumanization of driving.
Ultimately, we lose our understanding of both the domain the problem exists in and our ability to recognize true problems. The human is abstracted from both, further distancing us from the problems we are trying to solve.
Problem Proximity
Proximity to a problem is essential to understanding it. Being close and understanding the mechanics involved is essential for creating solutions. A layperson isn’t going to point ChatGPT at cancer and command it to provide a cure. This may seem like a silly example, but it is exactly how many people try to solve problems with AI today.
Removing yourself from a problem obscures all the surrounding complexity. It’s one of the reasons people thought the vulnpocalypse would happen. With AI identifying so many vulnerabilities, how could it not? But real-world attacks and scenarios require far more than vulnerabilities, and attackers have monetary constraints too.
Cybersecurity vendors are now working to completely remove analysts from the security operations center (SOC) and replace them with AI agents. What happens when attackers keep their skills but defenders either lose theirs or their jobs disappear completely? That’s not a good scenario. Companies will be constantly surprised by successful attacks.
What happens when attackers keep their skills but defenders either lose theirs or their jobs disappear completely?
Sometimes people are too close to problems, and a bit of distance helps them find solutions. This is true. However, in this scenario, people still need the perspective gained from being close to the problem in the first place.
We are moving to a distance-only future. We will no longer have close proximity to techniques and problems. We are approaching the world as though we already have AGI and are headed for a life of leisure, but we doom ourselves to a future of constant problems and unknowns.
Domain Expertise
Domain expertise requires depth and experience, two things that run counter to what AI promotes. Thankfully, we still have a wealth of domain expertise today. However, this domain expertise creates a blind spot when it comes to AI.
When a domain expert experiments with AI, they tend to overlook the issues. They can spot the problems and make corrections. They end up “filling in the blanks,” both physically and mentally. This is partly how smart people can get captured by AI hype.
Although AI seems to reward domain expertise today, it also atrophies it, as we have seen in the previous sections. As people are further abstracted away from performing direct tasks, domain expertise weakens.
Technique
We are searching for the one best way, the ultimate optimization, the final optimization, if you will. Previously, I mentioned Jacques Ellul and his concept of “technique.” In the foreword section of The Technological Society, Robert K. Merton summarized Ellul’s term “technique” as “Far more than machine technology. Technique refers to any complex of standardized means for attaining a predetermined result.”
AI represents the ultimate attempt at technique. It’s the attempt to build a universal technique machine, to step aside, and let the machine continue the path itself, with humans no longer even catalysts but passive observers, reduced to cheering fans in front of television screens. This represents the ultimate transformation of the human role in processes: from operator to monitor to spectator. Proponents believe that this technique will conquer space and time. It’s easy to lose sight of the fact that this is all purely speculative.
We forget that the world is complex, often confounding our assumptions, and the implementation of “technique” has an odd way of opening us up to new attacks and failures. These are not unlike the Air France flight 447 incident, in which deskilled pilots couldn’t manually fly the plane after the autopilot disengaged and an unexpected situation arose.
ARM Yourself
All of these conditions beg the question: what can we do? In many cases, individuals can’t do much to drive broader change, especially when industry roles are changing, or your boss tells you your job is simply to commit more code. Society and industries seem to accept these changes as destiny. After all, AI and related AI-powered tooling are a form of “technique,” as Ellul elucidated. Still, that doesn’t mean we are completely helpless.
As individuals, we should enact mitigations to protect what we care about. What we care about shouldn’t be limited to applied skills or technical applications. We should also consider scenarios involving human communication and interaction, given their dehumanizing effects.
Look for conditions where a tool performs the analysis or “thinking” for you, performs a critical skill necessary for your job, or even communicates with a human on your behalf. These are ripe areas for protection.
To support this analysis, I suggest a three-step process I call ARM.
Awareness
Recognition
Mitigation
The first step is simply to be aware that conditions of cognitive degradation and decay exist. Hopefully, my work and the work of others help with this.
Second, recognize when these conditions show up in your daily life. This isn’t as easy as it seems. Remember McLuhan’s quote about self-augmentation forbidding self-recognition. This requires purposeful analysis. Periodically perform a skills audit to examine your tasks and how you accomplish them. Identify conditions that may be affecting the skills you care about.
To support the recognition step, you can also build a habit of occasionally forming a hypothesis and then checking your work against AI output. Basically, you perform the task, then have the AI perform it. If the outputs match, that’s a positive sign that you maintain at least some of the core skills you’re trying to protect. If they don’t, then you need to implement some mitigations.
Finally, implement mitigations to protect the skill or scenario. This step can also be difficult because humans are cognitively lazy, and once something feels “optimized,” it’s hard to go back. Mitigation doesn’t necessarily mean abstinence. However, you may choose to have a no-AI rule for specific activities or communication methods.
Choose an approach that you feel protects what you care about. For example, you can exercise some tool-free practice days to keep your skills sharp. Or you could implement a human first-pass rule and only add AI after you’ve done a first pass yourself. Use the strategy that works for you.
By now you are probably thinking, “Wow, that seems like a lot of work.” It certainly can be. That’s why you are only implementing these strategies for skills you care about protecting. These strategies can also be critical for workers new to a job or industry, allowing them to practice foundational skills before AI tooling abstracts them away. Something to think about whether you are the new employee or a people manager.
Let me throw out a few examples.
Examples
I don’t use AI to write anything for me. Writing is thinking. I painstakingly write every word either by putting pen to paper or in an editor like Ulysses. This is because I’ve seen how it sharpens my thinking and lets new insights emerge. Insights that wouldn’t have come about otherwise.
The response may be, “But isn’t that time-consuming?” Yes! It absolutely is, and that’s the point. As for the inevitable question about time, it’s simple. Don’t spend time on things you don’t care about. Life is too short.
In another example, maybe you have a repetitive task, like searching through a group of files for certain conditions and extracting them. In many cases, this isn’t a skill you want to protect, and you’re happy handing it off to a tool and making better use of your time.
Finally, what about reporting? On the surface, reporting may seem similar to the file search case, but it really depends. You want to ensure the analysis and insights are coming from you and your expertise. Don’t pull an Autenrieth. If the tool is simply taking care of the formatting and other miscellaneous wrapper content and the analysis and insights are yours, then this may be fine. Obviously, as long as you check the work product.
However, if additional insights emerge while you write the report yourself, you may want to keep the task rather than outsource it. It depends on what the report is for, who will consume it, and how valuable it is to you.
It Doesn’t Have To Be
The sad part is that systems don’t have to be designed like this, to devalue the human and degrade their skills. It’s possible to design systems that augment and strengthen the human involved in the process. And yes, using AI. It’s just that no one has the appetite to address this. The whole emphasis of AI investment is on removing humans from various processes completely.
However, if we look closer, the benefit is obvious. The approach leaves room for new discoveries, new innovation, and the opportunity to be far more robust when unexpected situations arise, creating a best-of-both-worlds scenario. But I wouldn’t hold my breath that this will happen on purpose.
You can also use AI tools without experiencing cognitive degradation. People do it every day. However, this isn’t how most people use the AI tools at their disposal. They may not have gone full Autenrieth yet, but they are on the path. In the immortal words of the great American philosopher Ice Cube, “You better check yo self before you wreck yo self.”
Conclusion
In a recent article, Minh-Hoang Nguyen argues that a new kind of brain rot is “intellectual cowardice.” This is useful framing. We’ve gotten away from using language like this. We need to elevate the concept of “honorable” activities and call out the dishonorable or cowardly ones. This framing mirrors my conversations. I often describe activities as “honorable” or “dishonorable.” For example, spending twelve hours a day on social media and ignoring your family is not an honorable activity. We should be elevating more honorable activities.
People often talk about the utopian freedom that AI can bring, but in many cases they describe a life of dependence and confinement. We are offered the illusion of choice when the path has already been chosen, and we remain vulnerable to every unknown thrown across our path. Ellul was right: technique is coming for us all. We must protect what we care about, because nobody else will.
Note About McLuhan and Amputation
Some who have never read Understanding Media may nitpick that McLuhan never actually uttered the words “every augmentation is an amputation.” Although this is true, it’s also certainly what he meant. McLuhan mentions “amputation” or “amputated” seventeen times alone in his chapter called “The Gadget Lover.” Below is the closest line to this:
Any invention or technology is an extension or self-amputation of our physical bodies, and such extension also demands new ratios or new equilibriums among the other organs and extensions of the body. -Marshall McLuhan, Understanding Media (1964)
So, yes. Although he never said the exact phrase, anyone who has spent time reading Understanding Media knows that’s certainly what he meant.
It says much about our current moment that “slop” is Merriam-Webster’s 2025 word of the year. Seems mediocrity is having a moment. In this moment, a delusion has taken hold, centered on AI and the future of work: the AI creativity delusion. For the past couple of years, companies and influencers have told us the world is our slop oyster. If we can imagine it, we can slop it. Ideas and creativity are what matter, and everything else should be automated. We are told that, despite the goal of replacing humans in the workplace, the near-term future of work is humans, still in the loop, doing what they do best, flexing their creativity and letting AI do the rest. Although conceptually sound, this vision falls apart under even the slightest analysis, and it will hit younger generations the hardest.
The AI Creativity Delusion and the Expertise Loophole
Let me address the AI creativity delusion fueling the push for AI-powered coworkers. The premise goes that humans at work will flex their creativity by delegating their AIs to handle other tasks. This way, the human does what they are good at (creativity and ideas), and the AI does what it’s good at (everything else). Many may nod in agreement. However, this premise falls apart under scrutiny. We’ll get to this in a moment, but first, a loophole.
I should note a loophole in AI tool productivity: the expertise loophole. This loophole applies only under specific circumstances, namely when the user already has domain expertise. A user with domain expertise and an understanding of how AI tools fail can provide corrections or put the tool back on track. You need to understand the task, what the correct outputs are, and have enough experience to know when you aren’t getting the right answers.
Expertise also informs when to use AI tools and when not to, because an expert understands what needs to be done and which tasks AI can assist with in delivering the best results. I believe it’s this expertise loophole that blinds people to the real issues we are about to face.
Given the conditions of the expertise loophole, any productivity gains are temporary and apply only to specific job tasks for a limited time. As experienced people leave, less experienced AI-powered coworkers cannot fill the gaps. Mainly because they never have an opportunity to gain experience, the very experience they need to develop creativity in the domain. Secondarily, they outsource the social aspects of their jobs, further isolating themselves from their co-workers. It’s a one-two punch that’s hard to recover from.
A significant flaw in the creativity argument is the misconception that ideas are unique, precious resources that must be protected and fostered. I’ve written about this before, explaining that ideas are common, run-of-the-mill daily occurrences for everyone on the planet. Most ideas are ill-thought-out, half-baked, or just plain stupid. This is our reality.
The Younger Generation as AI-Powered Coworkers
I read an article recently, where a Gen Z founder claims that the younger generation will have an advantage in the workplace because they are growing up fluent in AIand this is helping them stand apart from their older peers. This is the sort of unadulterated, bubble-living bullshit we’ve come to expect these days. Younger generations may be growing up in the flatulence of AI, but that’s something else entirely.
Prolific AI use will ultimately make the younger generation worse off, as they are not set up for success in key areas that align with their value as employees.
I’ll make a claim of my own, and it’s the exact opposite. Prolific AI use will ultimately make the younger generation worse off, as they are not set up for success in key areas that align with their value as employees. This would be true even in a reality where generative AI is near-perfect, and we all know we are far from that.
I’m not attempting to beat up on younger generations. I feel for them, and I want to help. There have been so many ways they haven’t been positioned for success, and now generative AI comes along, putting more nails in the coffin.
These companies want to make you less capable and more dependent.
These companies want to make you less capable and more dependent. If you are dependent, you’ll not only need to use their tools to do your job but also in your day-to-day life. This is not a great option.
Marshall McLuhan said that every augmentation is an amputation. Framing technology in this way opens the door to unforeseen circumstances. In the case of younger generations, the amputation happens before the limb even has a chance to develop. In our case, rather than a physical limb, we are referring to cognitive and social abilities.
When we peer beneath the paint, we find that the very skills needed to make someone valuable at work are precisely those not being developed by overly ambitious AI-powered coworkers. The ones not communicating with their coworkers because their bots attend their meetings and respond to email and text communication.
Revisiting Creativity In Younger Generations
How does someone develop their creativity in the first place without experience? They don’t. Generative AI today can assist people with experience in specific tasks and under certain conditions. It helps with some tasks better than others. This is because someone with experience, especially domain experience, knows how to approach certain solutions, identify the right conditions, and know when the system is malfunctioning. An experienced professional can flex their creativity in this environment. The same cannot be said of the effectiveness of younger generations in the same jobs, despite having access to the same tools. Effectiveness will decline sharply across multiple dimensions.
First, they’ll never develop the social and communication skills necessary to be effective members of an organization. Second, they’ll not gain the experience needed in a given domain. Finally, they’ll never develop the mythical creativity discussed in AI circles due to a lack of expertise and social skills. All of this will be due to the overreliance on generative AI tools.
Let us examine some aspects of AI-powered coworkers. AI-powered coworkers using generative AI tools to attend meetings, take notes, and create action items. They use generative AI tools to communicate with co-workers. Using generative AI tools summarize documentation, books, and countless other sources of knowledge. Using pre-made generative AI tools to perform the job tasks. And the list goes on. This may look productive, but it’s not effective, and that’s a critical difference. There is a subtle deception at work here because AI tools can make people feel more productive and even powerful, even when they are not.
You can’t summarize your way to expertise, you can’t build relationships by outsourcing communication, and you can’t get experience by not doing things. Does this sound like a successful future workforce? Yet this is exactly the vision on offer, and this fuels the AI creativity delusion.
We have a distorted view of creativity, perceiving it as exercised by lone geniuses, but the reality is that most of the creativity needed for success in a business context is exercised in groups through relationships and collaboration. The same relationships and collaboration that aren’t developing in the AI-powered coworker scenario. When people start treating their coworkers like apps, nothing good happens.
The reality is that most of the creativity needed for success in a business context is exercised in groups through relationships and collaboration.
This should all make sense. When has anyone ever admired someone’s creativity when they didn’t actually know anything? It even seems silly to say out loud. To break the rules, you must know where the rules are and what hard constraints exist, and that requires awareness and expertise.
Knowing a tool doesn’t make you an expert; it makes you a tool. But let’s dig a bit deeper with a specific example.
We are told that meeting recording and transcription services free us from taking notes, allowing us to focus on what’s happening. However, this couldn’t be further from the truth. People pay LESS attention when they think a meeting is recorded, especially when they think it’s going to be summarized and bulleted for them. The reality is, taking notes IS paying attention.
When the human brain summarizes, it stores and reinforces. In a learning scenario, when people began taking notes on a computer, they could record everything the teacher said. But, this isn’t the benefit people thought it was. It seems that the act of taking notes with pen and paper forces us to distill what’s being said down to its essence, which is much better for learning and retention. I know it’s hard to believe, but pen and paper are technology too.
Not only that, but if we view this from a social context, there is a courtesy and respect that occurs when people see you taking notes, rather than simply grinning like a dipshit, or when people see you performing background tasks while they are talking. But, oh no. My AI has got this covered.
So you’re going to have a hard time convincing me that people who use LLMs to summarize and respond to their emails and text messages, attend meetings on their behalf, and have no domain experience or developed any workplace social skills are going to have a leg up on the competition.
What’s Old Is New Again
Some things never change. I’ve been on this tools impacting humans beat for quite some time. Back in 2010, I gave a series of talks at security conferences titled “Your Tools Are Killing You.” The premise was that people were completely reliant on their tools and couldn’t perform the task otherwise. If the tool was blind to an issue, the human was likewise blind to it. Newer people to cybersecurity learned the tool, not the task. These conditions ultimately reduced people’s effectiveness at their jobs. Sound familiar? However, the generalized nature of generative AI makes this far worse.
Mediocrity Is The Future Of Work
In September, Harvard Business Review published an article on how AI-generated “workslop” was destroying productivity. In essence, workers using AI tools were passing low-quality content to co-workers, which required them to do more work. This is a sort of productivity shell game where a speedup in one area causes a slowdown in another, pretty far from AGI if you ask me.
When everything is slop, everything is mediocre. We’ve allowed companies to reframe what’s acceptable into mediocrity. We don’t hire employees to give the bare minimums. Nobody responds to a job interview with, “If you hire me, I promise to do just enough.” This is hardly a selling point. When you hire someone to paint your house, you don’t think a mediocre job is acceptable, but if you receive a mediocre report, somehow it’s now fine if it is labeled as “AI-powered.” All the mistakes and inaccuracies are just how things are now.
AIs don’t care about quality; that’s a human’s job. Yet quality is on a steep decline. Some are making low-quality work product acceptable because AI is in the loop. But what happens when people forced to use AI tools in the workplace stop caring about the quality of the work they produce? Nothing good.
Encouraged or forced to use AI for everything, humans will be nothing more than meat-sack automatons providing the embodiment for AI. Most jobs don’t consist of a single task, which is why AIs still need humans in the loop for the current and near future. This vision is hardly motivating or inspirational.
Conclusion
We’ve built our AI temple atop fissures, allowing escaping gases to induce hallucinations, fooling us into thinking we are predicting the future. We remain blinded to the real issues confronting us and their negative impacts. We cling to the AI creativity delusion. Which, ironically, prevents us from using AI tools to their full potential.
Creativity doesn’t come without experience, and most of the creativity needed for success in a business context isn’t the work of lone geniuses, but through collaboration. If we don’t identify and correct these issues soon, we are all but dooming younger generations. We are currently in the f—k around stage, but the find out stage is on the horizon.
2023 is going to be an interesting year for generative AI. Past the demos of the previous year, there’s going to be a big push on monetization. This application and integration into products will have a displacing effect and this effect will have a disproportionate impact on certain areas, mainly in the creative arts.
Note: All images in this post were generated with the prompt, “generate a stock photo image that is just okay and mildly pleasing to a human“
Perspective Mismatch
I see quite a few people making statements like, “AI isn’t going to replace people. People who use AI will replace people who don’t.” Or some form of this statement. This is usually followed by a hearty high-five at their insight. The problem with this statement is it just doesn’t reflect reality for certain types of jobs. To put this in another context, this is like saying, “Food service robots won’t replace food service workers. Food service workers who don’t use robots will be replaced.”
These comments are often made by people in positions that have no visibility into impacted areas. If you are a developer who finds a productivity boost from CoPilot or ChatGPT, you have a much different perspective than the millions of independent artists, creatives, and copyrighters across the globe. The warning signs are here. This isn’t AI hate or denialism. This is reality.
2023 will be the year where you start seeing freelance creatives losing opportunities as the impact of generative AI hits freelancers and the gig economy. Jobs will be eliminated or devalued to the point where it isn’t worth it.
From Demo to Application
Last year was the year of the demo, the time to showcase the novelty. Demos like Dall-E, Stable Diffusion, and ChatGPT were everywhere. To quote the philosopher Steven Pearcy, “Nobody rides for free.” In 2023 the novelty is wearing off and the check comes due. These systems cost money, and the need to monetize is here.
This year will witness a rapid expansion of generative AI in all areas with a low cost of failure. Everything gets an AI assistant. This assistant mindset will put the tools much closer to everyone. You won’t need to go to a website or use an API to use the tools. They’ll be built into the things you use on a daily basis. Microsoft is investing billions of dollars into OpenAI, and comments from Yann LeCun from Meta about generative models being built directly into Facebook for creative activities. Notion is beta testing a generative writing assistant integrated into the tool. And the list goes on and on.
ChatGPT was a great demo, but not really overly unique. Other large tech companies have similar tools but are more conservative about how they use and release them. Well, the floodgates are open.
Good Enough is Fine
Creative arts are an area ripe for disruption and democratization, aka devaluation and elimination. In the areas of creative arts, the impact of failure for an AI system is low, making it a great target for AI, which tends to have high rates of failure. This is much different than, say, a self-driving car not recognizing a red light or a pedestrian in a crosswalk. In creative areas, If you don’t like something, just generate another one, or ten, or a hundred.
Human novelty won’t cut it for most regular creative tasks. Sure, some creatives will continue to find work, but the work won’t be the same and there’ll be far less to go around. Even though humans have the potential to bring something unique and ultimately deliver a better product, with the devaluation of artistic endeavors, good enough will be just fine.
This technology will most likely be justified under the heading of “advanced customization.” Being able to take something like an advertisement and custom tailor the content to specific groups or even possibly down to individuals. Today, you can target ads at specific groups of people, but in the future, you may not need to. By having some form of adaptive ad with adaptive content, the ad can tailor itself to the individual. Don’t get me wrong, this is an interesting technical problem but it creates a human problem. Once again, my tech friends are reducing everything down to the process of doing something and not the human aspect of the task. Whenever you have extreme customization and add scale, you always create a process with too much friction for human effort.
This is about the time that I hear the groaning about these creatives having the same access to tools that everyone else has. This is certainly true, but it’s not an equalizer at all. Even if creatives were able to keep pace, there’s a monumental satisfaction drop. If you are an artist who enjoys putting together graphics, having an AI generate a bunch of them isn’t the same as creating your own. If you are a VoiceOver artist, having an AI generate a voice isn’t the same as using your own voice. This isn’t the “eliminate the mundane work so humans can focus on more interesting things” promise from AI being fulfilled here.
I get the feeling in discussions on this topic that technologists equate creative writing to writing code.
I get the feeling in discussions on this topic that technologists equate creative writing to writing code. This is incredibly disconnected. Creative endeavors aren’t some problem to be solved or some slog that needs to be eliminated. In many cases, the slog is kind of the point. As someone who does both, I totally get it. It’s completely inefficient and hard to understand, but it’s the reality.
But this is irrelevant because creatives won’t be able to keep up, especially with these tools at everyone’s fingertips, tempting people to do it themselves. Many just trying to get tasks done will use the tools provided to them in the interface. They’ll wonder why they are paying someone to push the same buttons they can push right in front of them.
Why am I so confident? We have similar evidence for this trend in camera phones. Look at what camera phones and photo filters did to the photography industry. In the past, people would hire a photographer or have a lab touch up photos, but now people use an iPhone and smear a filter on it. This is true even for events as meaningful as their wedding. Sure, we still have photographers today, but the industry is pretty decimated. Many who could have made a living can’t even eke out a meager side hustle with this.
When I was growing up, I used to hear the term “starving artists.” I guess it’s time for creatives to realize that existence again. Even Fiverr will have to rebrand to Freeverr.
Near Future
They’ll notice their work first change, reduce in value, and then drop off.
Most immediately impacted will be freelance artists, graphic designers, writers, and copyrighters. They’ll notice their work first change, reduce in value, and then drop off. Below are a few examples of what I see happening very soon.
Freelance copyrighters, instead of being asked to write the copy themselves, will be asked to tweak and make adjustments copy generated from a tool. They’ll be asked to do this work for far less than they’d be paid to write the copy. In many cases, the copy will be tweaked in-house and the external copyrighter won’t be contacted.
Say you are part of some group that wants to have some t-shirts made. Instead of having an artist design the image and graphics for the shirt, you now use the web interface of the t-shirt company’s website to automatically generate unique artwork for you, bypassing the need for a freelance artist.
Artists are asked to become part of a working group where they receive a gift card for providing feedback on a swath of images generated by an AI for a stock photo site. The mechanical mashing of thumbs up and thumbs down is a stark contrast to the artistic activities to which they are accustomed. Less pay and less fulfillment.
What Do We Do?
So, what can be done about this? Nothing. It’s beautiful in its simplicity. There’s literally nothing we can do. Genies don’t fit back into bottles. I could say that companies should put an emphasis on hiring people to continue doing this work, but it’s not going to happen. And, maybe there’s nothing we should do. This may just be the natural part of human evolution toward becoming machines ourselves. If you look at some of the jobs impacted, these are uniquely human jobs.
If I have hope here, it’s that we begin to tire of everything being automatically generated and tailored specifically for us.
So, let’s pour one out for some of the jobs impacted in the near future. Here are a few off the top of my head, artists, graphic designers, stock photography, VoiceOver and voice actors, copyrighters, proofreaders, and a whole lot more. Coming soon to this space actors and actresses.
A couple of years ago, I said that the people who should really be worried about deepfakes are actors and actresses. Interesting thought, since many of these generative AI systems have NSFW protections built into them, pornography will continue to be made by humans. The future prospects of human actors and actresses look quite a bit different through this lens.
Who Really Loses?
Is humanity destined for a future where “creativity” is defined by just smashing the like button on the output of AI?
My biggest concern here isn’t the job loss, it’s what we are losing as humans. As I mentioned, these are jobs that were previously uniquely human. 65,000 years ago, our ancestors showcased their creative talents by painting on cave walls. They may have been memorializing events, but it’s a sure thing that some of them liked the activity and it gave them a sense of fulfillment.
Is humanity destined for a future where “creativity” is defined by just smashing the like button on the output of AI? Only time will tell.