If you’ve got at least 8 gigs of VRAM and at least 32 gigs of RAM you can run some pretty beefy Qwen models using Strata, far more than you normally could. Upgrade that to 12 or 16 and 64 gigs respectively and you can run a pretty decent quant of Qwen 3.8 flash next. It’s a LOT bigger than the usual 27 and 35 billion models people run locally that themselves require pretty beefy hardware. Strata is doing some magic by deciding which experts stay in VRAM vs which ones are in RAM vs which ones are so rarely used that they can just be read from the SSD as needed (though it’s best if you don’t have to result to the SSD as a backup option at all)

You’d have to start soldering the HBM and the GPU chips off the boards they’re on. Those aren’t PCI-E boards much of the time. Also, they don’t have display outputs.

I’d absolutely buy one of those servers to run open-weight models locally, but let’s not kid ourselves here: We’re talking about an ungodly amount of power for a single machine, think it was a few megawatts for a rack, or at least hundreds of kilowatts. A single server luckily should still be in two digit kilowatts. Could realistically only use it in the winter though.

crowd sourced AI

So the problem here is that every machine would have to run an instance of some model, you can’t spread the model over all the machines. It’d be too slow. Reading from NVMe on your very own machine is already pretty slow as it is. Kinda limits the model size.

For that use case a picture would be good enough tbh. Still not going to buy a smart fridge because it sounds stupid to me, but it’s gotta cost less than 20 bucks per fridge at scale for the hardware to do it, so it’s pretty trivial.

The people who work on-site can handle that

That’s… not necessarily true. It’s entirely possible that nobody wants to touch the freezer’s temperature controls because “I might mess something up” or “I don’t know how to do that”. It’s not unusual for a smallish grocery store to have a single employee with a functioning brain and that person isn’t always at work. Hell, sometimes there’s two and one’s on vacation in another country and the other one has a day off and can’t be reached by phone. And I’m not saying this to single out grocery store workers as dumb or anything like that, the same holds for pretty much every profession: Most people just switch off their brains at work, they do the exact tasks they’re supposed to do every day, and if they need to do something new, that’s an impossibility without serious hand-holding. Seen it in grocery store employees as well as software engineers and doctors.

But it’s true that the remote control itself doesn’t have to be available online, only monitoring does, you can always just send a technician to push the button and change the temperature. But then wouldn’t it be nice if you didn’t have to send out a technician in the first place?

Uhhh… which country exactly is the sun part of?

Estonia here, electric bill ~300 EUR in the winter here, once I get the entire house heated using a heat pump and get an electric car, it might be more like 600-700 EUR. But solar panels are useless in the winter here.

Meanwhile in the season where I could have solar panels produce all of my electricity, my bill is well under 100€ and I couldn’t sell the electricity to the grid either unless I have a big ass battery to sell only at night when the price is actually a positive number lol

My diesel wagon cost me under 2k EUR. Point me to a similarly useful (no i-miev or leaf!) EV for under 10k?

I don’t know about the rest of those, but the Hyundai Ioniq 5’s solar roof takes over a decade to pay off at average electricity prices. But if you keep your car parked in the sun for 2 or 3 months, you could get a full battery!

What about EV’s? Is it a range issue? Makes me think why dont EV’s have solar panels slapped on them?

Someone did the math on the Hyundai Ioniq 5’s solar roof when it came out and I think it was found that best case scenario you get like 5 km of range a day with good weather and the panels will pay off in 10 or 15 years.

That community doesn’t actually have conservatives in it, it makes fun of them. Lemmy doesn’t have enough of those

The reddit one would ban you in a microsecond though

Nvidia did a massive share buyback with a portion of the ridiculous profits they made last year. That serves to temper expectations, as they’re signaling that they’re not going to be investing all their profit in yet more production (which is difficult anyway given they don’t have their own fabs and TSMC seems to be running at full capacity).

Likely they’ll be doing another one next year and shareholders will be happy.

As I understand, only 27B is known to come out as open weight, Max and Plus are API-only anyway and it’s suspected that so is Flash. Makes sense tbh, they’ve established their position in the market, now it’s time to stop giving people better and better models they can run locally. It eats into their profits.

Non-player character. Normally a completely reasonable term from video games where, depending on the game, most characters you encounter might not be players.

Then it started being used by the alt-right to refer to people who disagree with them and therefore aren’t people who actually think for themselves but rather following a script, so using it to describe real people is kinda gross. The reasoning being “they believe what everyone else does so they’re sheeple/NPCs”. Because only controversial beliefs are an indication of being capable of thought.

See there’s a difference here:

Buffalo don’t have wings, one can reasonably expect wings to be made of a creature that has wings. Also did you know that they’re named after Buffalo, the city where they were first made?

Pigs do have rib meat, so one can reasonably expect a rib sandwich to be made of primarily rib meat, not tripe and stomach. And unless the first place to make such sandwiches was a city called Rib, I’d say McRib is named after ribs or rib meat.

As someone who last touched any C++ books when C++11 was very new and has only written like 20-30 lines of non-tutorial C++ since then, what are some significant changes to the language that I should be aware of if I wanted to give it a try now?

There are 3 or 4 billionaires in my country. Founders of Wise and Bolt. None of them own farms or grocery stores.

Matter of fact, the most popular grocery store chain is coop so most of the “owners” (members) of your local cooperative aren’t even millionaires.

trying to code

copy pasting to and from duck

That’s, uh… The worst way to do any of this. And GPT-6 Luna is the weakest GPT-6, if you’re going to run something that’s on someone else’s hardware anyway, you can just use openrouter and choose ZDR hosters of open-weight models that are somewhere between GPT-6.1 Sol and Terra in accuracy.

without supporting the data centers

online host of choice

That might’ve been the joke, Altman’s issue was people having a ton of RAM sitting around doing nothing 99% of the time. Which is technically true and a real example of resource allocation inefficiency, but doesn’t mean we should cede all our RAM to capitalist ghouls.