I agree that that's what it would take, but compute would need to get very cheap for it to be feasible to keep models running locally. That's an awful lot of memory to have just sitting with the model running in it.
True. I was thinking more of power users. Do you think Opus level capabilities will run on your average laptop in a year? I think that's pretty far away if ever.
You can demonstrate "running" the latest open Kimi or GLM model on a top-of-the-line laptop at very low throughput (Kimi at 2 tok/s, which is slow when you account for thinking time) today, courtesy of Flash-MoE with SSD weights offload. That's not Opus-like, it's not an "average" laptop and it's not really usable for non-niche purposes due to the low throughput. But it's impressive in a way, and it does give a nice idea of what might be feasible down the line.
Sure, but compare this to "turn[ing] off" combustion engines a mere four years after commercial adoption rather than 162 years later (now). Back then, going back to horses wouldn't have been as big of a deal as it would be now.
Sounds a lot like "self-driving" cars - "they are good enough 95%+ of the time, you’re not going to pay as much attention as you should".
Same thing happens here, you get complacent and miss critical failures or problems.
It's also similar in that it "take[s away] many of the fun parts". When I can focus on simply driving it can be engaging and enjoyable - no matter the road or traffic or whatever.
>Sounds a lot like "self-driving" cars - "they are good enough 95%+ of the time, you’re not going to pay as much attention as you should".
That might be an issue for supervised "self-driving" cars (eg. tesla FSD), but not really applicable to self driving cars as a whole. Waymo seems to be doing just fine for instance.
>Aren’t Waymo‘s 5% covered by some people in the Philippines? [1]
If you look at waymo's prior blog posts, you'll realize that the people in Philippines aren't making split second decisions that was implied by "you’re not going to pay as much attention as you should".
Exactly why I put "self-driving" in quotes. Right now AI assisted coding might generally be at the equivalent of Level-2 or -3 self-driving. Getting to autonomous coding agents will be like the step change that is Level-4 or -5 driving.
You can experience all of those ecosystems - and more - just in Columbia if you choose to.
We did a lot of bussing around there couple years ago - none of them or as nice as these motor coaches! (We were generally not taking the longer routes though.)
Good call. The system does try to match to official reporting and update when it finds one, but the working names in the meantime could definitely cause confusion.
Probably another case where that should be deterministic instead of model-generated. Thanks.
There's "Bluetooth Media Button Remote Control" on Amazon, the wrist style is nice if you're in a workout or something but probably too nerdy for sitting on the couch :)
There's also something similar, 'puck' designed to mount to your car steering wheel.
I generally think that as well and so was surprised to read that they're planning to not label CRISPER fruits as such.
"European Union’s Parliament and Council, the bloc’s governing body, reached a provisional deal in December to “simplify” the process for marketing plants bred through new genomic techniques, such as by scrapping the need to label them any differently from conventional ones."
reply