Listen. I’m no expert, but since 99% of the models that are currently active in the world were trained on the general output of most of humanity.. and even then it had trouble attempting to output usable items..
What happens when AI is the only output.. for all of time? Do the models swap from being pure GPT LLMS, and work as LRM’s or a combination of models? (An ensemble, if you will), or do these models no longer require public data, and instead need private data (I’m looking at you OpenAI, with your “Github replacement”, just wanna steal more stuff) in order to push models farther? It’s clear that at some point, entropy for a model increases, the long context degradation occurs, and then llms can no longer output the probably best token.. because the inference data matches their training data (because they made the training data?) and then it’s just overfitting and underfitting all the way down.
I hope that LLM usage allows for more people to create, build, and imagine all of the same things they imagine, but I also hope there will be the die hards. The never GPTer’s, writing code from their brain, and by hand, and selling it on Etsy for a premium. There has to be some way we can make original code non-replicated or non-fungible (blockchain, heres your shot!). I imagine there must be a way to protect or encrypt your code, allow it to be visible only to an actual human being so that it can’t be scanned or inserted into training data, to make another model slightly better.
I like the idea of turning coding into a comodity, but I don’t like the idea of completely removing humans from the loop. Not only is it economically not viable for the rest of us, it sort of breaks down the whole system doesn’t it? If humans aren’t working in intelligence work, then they won’t need tools to make them more productive, faster, more connected.. which means less frameworks, less new languages, more agentic code. Which means less humans working, less humans making money.. less things being invested in and build, less innovation etc etc.
At what point is there no economy? Who’s going to need agentic ai agents if the whole reason we write software is to speed up manual tasks? Who’s going to consume scientific research that isn’t funded, because an AI does it? At what point does a recursive loop occur, and AI companies don’t have any customers to consume their product or use their product, and then they run out of business and we have no new companies, no entry level employees to replace them etc etc.
It all just doesn’t seem to make sense? What’s the economical principle/structure? Who pays for what and who spends what?
I’d really like to know. Thanks for reading my rant. I’ll catch you on the flip side 🙂
– IAmHaxk
Slop in.. slop out?
Do we just… sit down?
I’ve seen so many amazing things being created and generated by the use of AI Agentic agents, open source LLM’s, and especially some of the amazing “Deep Research” models that have been launched as of late. While I haven’t seen anything novel (as in.. new stuff? Not the parroting of something some only already came up with) it’s making everyone fast.. quicker, but I’m not sure it’s making anyone actually learn new things?
As I have started to think about how I will move past the Agentic era, and find a stable and worthwhile job (What happens when we don’t need to prompt, or orchestrate, or review?) I had a simple thought:
Where does all of the human brain potential go? If agents are doing all of the thinking, and the writing, and the coding, and the building, and the integrating.. what will humans do? Will they still be the glue that finds the connections between things in which to integrate? Will we have anything to even focus on (besides finding economic abilities to feed, house, and clothes ourselves)? Where does all the intellectual ability get distilled to? What do we focus on? It’s just an insane thought to have, the idea that all of this human brain potential just sits, while some form of AI works its way through solving our problems? It reminds me of a story that I can’t quite remember the title on, but it involves AI that becomes so awesome (with robots doing labor etc) to the point where there is no need for money, or the idea of wealth, and instead people spend their time writing poetry, performing scientific experimentation and breakthroughs, and everything else is performed by robots/ai. I wish this was the case, but it ignores a very common problem: Humans can be evil. I’m no sociologist, so I’m not sure what the world would look like if there was no way to separate humans into non-caste or class based systems (which shouldn’t be the case anyways. We are human. We all share the same world, and use the same resources. The fact that billionaires have an excess at the same time people are starving, just never sat right with me.)
I just can’t seem to comprehend a world in which humans are not attempting to pursue some form of economic utility, and finding an ability to survive and thrive. Is this some Americanized propaganda I’ve been living that I’m just not aware of society in which abundance and resources is distributed evenly/properly?
Just food for thought, and something I wonder about. What do the humans do, when the AI runs the world?
Always,
IAmHaxk
Is it here yet?
One of the funnier aspects of all of the rapid change that has been occurring within Software Engineering, Technology, etc is the multi-split brain syndrome that seems to be rampant. On twitter (No one calls it X, Elon, you troglodyte) , I could swear I’ll never have a job again, and I should just stop trying to learn anything new, and just focus on babysitting agents, while never using my brain again. You then shift over and scroll on Facebook, and it’s like it’s the early 2000’s and grandmas are sharing recipes, AI videos are everywhere, the ads are absolutely endless, and no one has any idea about anything. Pop open youtube? It’s still amazing developers and creators outputting shorts and long form videos on “Here’s my setup” or “Here’s my every day carry, as a software engineer in NYC” etc, etc.
Meanwhile, at work, I’ve only become more productive, only learned more things, and only had more fun learning new things.
So my question is… is it here yet? Has the world ended? Will we be absolutely broke, with no jobs, and start trading bottlecaps like it’s Fallout? I really just want to know, so I can be ready.
But honestly, it’s hard to state that everything will be ruined.. instead the only assumption I can make with the limited understanding I have of this kind of seismic shift is.. change. Change will happen. Things will go away, others will appear (BTW whats a deployed engineer actually do, and how do I become one, because I like the way that sounds!). Industries will shift. Adapt or die is all we can do. I wish there was some easy fix, some government overreach that will swoop in and collectively ensure that the everything will be ok. Instead it’s just us. It’s people, versus whatever the hell is here. So remember: Be Kind. Be curious. Change the world the way that you want to change it. Focus on your bubble, your people, and your peace. Build cool shit. Tear down bad shit. Learn a new skill, or abandon a bad one. Focus on being positive, as much as you possibly can. I’m assuming we’ll need our best mental state to deal with the turbulence and avalanches that will inevitably occur.
Just remember, you are important. You are valid. You are beautiful. I’m glad you are here, and I get to share the same universe with you, at the same time.
Always,
Haxk
AI Overlords
I’m sure you’ve seen this sentiment all over the internet. Twitter, facebooke, youtube… every scrolling addiction pointing to the same thing: The AI Overlords are here, and the world has been changed. As a software engineer (Most recently a reliability engineer) I’ve spent the last 15 years of my life chasing the job title of Software Engineer. Moving from Senior Technical Support to Product Ownership, back to Senior Technical Support, all the way to Software engineering. I remember when I wrote my first production code, and I also remember the first time I broke production code!
I didn’t take the traditional route, and instead started a family, then went to college. It was the best experience of my life. I got to grow intellectually, while at the same time growing as a human being. Becoming a father, and a husband was the hardest and most rewarding accomplishment, but I also had the ability (thanks to the amazing support system in my life A.K.A mrs.haxk) to continue my education, obtaining my masters. I wrote my thesis on reinforcement learning utilization for training FPS bots. It was such a rewarding experience, and I won’t ever take it for granted. But as of late, the world has become blurry. My future is no longer laid out, in an easy form, and instead appears to be disappearing from my fingertips. I had ideas of maybe one day buying a house, with a yard, and a garage. A place where my 4 kids could grow up, and live, and come back to once they ventured out into the real world. As far fetched as that sounds (as a millennial, my life has been nothing but wars, political anger, and constant economic turmoil) I still though that if I worked hard, and if I constantly learned and adapted.. at some point I would get there.
I can’t say I’ve made all the right decisions, or did all the current fads or jumped on all the bandwagons (man did I mess up the chance to win big with bitcoin!) but I never thought I’d be less than 40 years old, worrying about if there would be space or ability to continue to work in tech now that LLMs have become more prevalent. As some would like to say, it used to be that the separation between people who succeeded in software engineering, and those who didn’t, was primarily focused on how quickly you could output the correct algorithm, or burn the midnight oil to build the next big “copy of some current thing, but make it suck less”. I don’t think I ever bought that as the “moat” or separation between a basic engineer, and 10x engineer, or whatever buzz word fits the most. To me, it was the idea makers. The dreamers. The people who said “I want the world to look like this, so I’ll make it look like this”. I always wanted to be that, but I sort of got caught up.. in the things. The doing. The waking up, and clocking in. The enterprise systems, and startup fever. I forgot the purpose. I forgot what made this fun. What made this all exciting.
And then ChatGPT came. And then llama, and Gemini, and Claude (God I love Claude, they are actually fun to just chat with, and talk things over with). And suddenly, what I used to struggle with (what a lot of engineers used to struggle with, actually) became easy. It was more about how well you could communicate what you wanted, how it should look, and what it should do. Once it finished (and messed up a ton in the middle) you still felt that feeling.. you know the one. The one where you finally debug the auth function you wrote it pyotp, or the feeling you get when the last integration test finishes, and you get to cut a release. It doesn’t change what happened. It doesn’t change the feeling, it just feels… less. And as time goes on, and the more you vibe code your night away, the less and less it becomes.
But.. it’s still there. In fact, its now more spread out. Think about your friends. The ones who sat around you as you regaled about another long night in front of your screen, banging through some DSA problems, or building the next… twitter or whatever. In some people, you can see the want. The look in their eyes that tells you they wish they could make something as substantial. That they wanted so badly to will something into existence, with just a computer and a keyboard. LLMs, clawdbots, and the base44 crew give them this ability. And I think that’s beautiful. I think being able to share the thing I enjoy almost as much as my family with the rest of the world is exciting. Think of all the problems we may solve, or the things that could be made, and all of it was because people couldn’t find the time or the ability to figure it out. Now its just… there.. on the computer, phone, or tablet.
So now, code has become a commodity. There is no longer a moat. And soon.. most of the other things that would be a secondary moat will be automated as well.
I’m sure others will tell you “It just means system design will become more important” or “Its another layer of abstraction, one that tech has already been through before” and what not. Which is true.
But that doesn’t mean things haven’t changed. That the world of development is now smaller.. while being also immensely big.
I wish I had a plan. Some philosophical response I could provide, or “Just do this and everything will be good”.
But I can’t. I don’t have an answer. I also don’t want to feed into negativity, or doomsay everything, or tell everyone it’s all going to be fine. No one has any idea. Not the CEOS, or the 100x engineers, or the influencers on the internet telling you to buy a mac mini and let clawdbot run your life (while also leaking your credentials, and saying naughty things about you on an agentic AI social network).
What I can share is.. it’s never the right decision to be under-prepared, but it’s also never the right decision to always formulate the negative. I love engineering. I like making things with my brain and a keyboard. I like impossible problems. I like to plan and design and execute. I like the action of it, the feeling of it, and the way it makes me feel like I can actually contribute to the world.
Don’t forget the kid in you who thought they could change the world and make it better than it was before they left it.
Don’t forget this is fun, and also rewarding.
You can just do stuff.
Until next time,
Haxk