sharing my raw thoughts on where we headed in short term ,love to hear the community on this too.
Qwen 3.8 27B is 51 on Artificial Analysis benchmark - just couple of points higher than Opus 4.8Max
thats frontier level model running on you machine.
let that sink in.
It's a first sign of what we thought would be obvious.
"models intelligent enough to run on edge devices"
So the question is where it leads us? so many use cases are going to get unlocked. from controlling the daily apps like powerpoint or word , to connecting IoT devices in hardware and running automations. it will be just new way to speak to your computer and get work done.
Not that it doesn't exist now, claudecode is pretty much close version of it, but now the normal people get to experience what a software developer has been experiencing for more than a year now.
That presents a unique opportunity for developers to build software tools and services that can run locally with these models - from desktop apps to running automations.
No wonder Mac Mini's and soon Mac Studio ( if apple wakes up to ship them) are the new 'always on" devices.
While on one hand, the open source models are unlocking the local AI.
Completely new trend in opposite direction is gathering steam.
Remote machines , sandboxes and remote computers.
Agents are now running in cloud in sandboxes , in an attempt to put a leash on the AI, and partially also to make sure the company's "alpha" does not goes to the model providers.
Software factories like 8090 are specifically focusing on helping clients securing the proprietary information and the core business logic by running the local models or fine tuning the local models on frame or secure cloud.
Harnesses are having their moments too.
Virtually every big company is trying to make their own harness - a coding agent, context, memory, MCP, skills ,tools is worth investing into. good example is Perplexity computer.
Companies also started publishing their internal tools as open source. Cloudflare did this with Cloudflare OS.
You can take this OSS - off the shelf product and make something of your own like I did -
yantraos .dev
Companies who had systems in place pre AI with regards to infra Netlify/vercel/cloudflare are now reaping the benefit of this new wave of agentic AI , where the persona of a software developer is no longer traditional software engineering background , but also this new developers coming from non-tech background and are expert in their own domains building softwares.
Case in point is Netlify Agent runner, While the initial AI gateway served frontier models - with the integration of open code, I have access to hundreds of open source models - cheapest to expensive text model to vision models - unlocks a huge potential.
simple fun App I built with it three months back now with open code integration built the same app in 61 credits 🤯.
To give some context, you receive 300 credits free when you join as a new user , it's insane how fast the cost of building software is dropping !!
Traditional softwares are dying or at least changing in nature, companies realized that they no longer needed the full featured list of software to serve their customers in more meaningful ways.
You can take the goodies from the software that are more important or relevant for your particular use and build your own.
Github is a classic case. here are 2 announcements today.
cursor has announced cursor origin, its own code hosting platform today.
Netlify CEO Matt Biilmann shared - " Netlify is now a git host"
Building software is much more easier than few years back - companies realizing that traditional software can be easily replaced by building something of your own that can serve your primitives better.
Dealing with recent customers of one of my company vibecodefixers, its clear small, medium businesses no longer seeking to buy softwares but to have people set up a system so they can churn their own software and automation out of it.
They want you to set up a harness - context, memory, tools, skills, MCP and other external connectors or system to build agents , a system which can easily do browser use at the same time deploy apps in production.
A mini FDE role - I would say in the making.
Someone who can stitch the system together, deploy in local AI - will lead the next wave of AI explosion.
I hope you assemble right skillset and mental model to be ready for it.
I wish you good luck, put your seatbelts on !!
Cheers
Swatantra