Running AI is so expensive that Amazon will probably charge you to use Alexa in future, says outgoing exec::In an interview with Bloomberg, Dave Limp said that he “absolutely” believes that Amazon will soon start charging a subscription fee for Alexa
We need to move AI from the cloud to our own hardware running in our homes. Free, open source, privacy focused hardware. It’ll eventually be very affordable.
deleted by creator
Yes, and you can run a language model like Pygmalion Al locally on koboldcpp and have a naughty AI chat as well. Or non sexual roleplay
deleted by creator
Never underestimate human ingenuity
When they’re horny
And where would one look for these sexy sexy AI models, so I can avoid them, of course…
deleted by creator
Which models do you think beat Pygmalion for erotic roleplay? Curious for research haha
deleted by creator
Oh I see, sorry for the repeat question. Thanks!
deleted by creator
GPT4All is a neat way to run an AI chat bot on your local hardware.
deleted by creator
it does have a very funny name though
Don’t these models require rather a lot of storage?
Storage is getting cheaper every day and the models are getting smaller with the same amount of data.
I’m just curious - do you know what kind of storage is required?
deleted by creator
Yeah that’s not a lot. I mean… the average consumer probably has 10GB free on their boot volume.
It is a lot to download. If we’re talking about ordinary consumers. Not unheard of though - some games on Steam are 50GB+
So okay, storage is not prohibitive.
In five to ten years, imo, AI will be everywhere and may even replace the need for mobile Internet connections in terms of looking up information.
You’re probably right, but I kinda hope you’re wrong.
deleted by creator
Call it paranoia if you want. Mainly I don’t have faith in our economic system to deploy the technology in a way that doesn’t eviscerate the working class.
deleted by creator
God I wish, I would just love local voice control to turn my lights and such on and off… but noooooooooooo
I have home assistant, but have not heard anything good about rhasspy. Just want to control lights and be able to use it to play music and set timers. That being said I run home assistant right now and can control it with Alexa and Siri but… I would like local only
I have that with just my phone, using Wiz lights and ITEEE. It’s the only home automation I even have because it’s the only one I found that doesn’t necessarily need a special base station like an Alexa or Google Home.
But you want a local base station, else there’s no local control. You want to use local-only networks like z-wave, zigbee, Thread, Bluetooth, etc, even though they require a base station because that’s what gives you a local-only way of controlling things.
Matter promises a base station may no longer be necessary for smart devices to control each other, but it is rolling out very slowly
I also wonder what I’ll be able to do with the Thread radio in the iPhone 15 Pro
The base stations are what uses the cloud/AI shit. The setup I have doesn’t even require an Internet connection or wifi; it’s entirely bluetooth. Why in the hell would I want a base station that costs money, is controlled by Amazon or Google, and requires an Internet connection for my local shit?
I don’t want a piece of hardware that does nothing but act like a fucking middleman for no good reason.
I’m a huge fan of Home Assistant. You might look into it
deleted by creator
That is not necessarily true. Some base stations use the internet, yes, but not all. For example a Philips hue does not require internet access, nor does Lutron Caseta. As the other person posted, Home Assistant is the absolute best (IMO) way to do everything locally without the internet.
Your system, while it might work for you, does not scale well due to the limited range and reliability of Bluetooth. You’d likely be better off to adopt a more robust protocol like Z-wave, or ZigBee and get a hub that you have full control over.
It’s the year of the voice for Home Assistant. Given their current trajectory, I’m hopeful they’ll have a pretty darn good replacement for the most common use cases of Google Home/Alexa/Siri in another year. Setting timers, shopping list management, music streaming, doorbell/intercom management. If you’re on the fence about a Nabu Casa subscription, pull the trigger as it helps them stay independent and not get bought out or destroyed by commercial interests.
Thumbs up for Nabu Casa and Home Assistant!
I haven’t yet played with the local voice stuff but have been following it with interest. Actually, now that Taspberry Piis are starting to become available again, I’m on the fence between buying a few more, vs finding something with a little more power, specifically for voice processing
Get something with a little more power. Pi’s are reaching outside the price where they make sense these days. You can get an Intel N100 system on AliExpress/Amazon for pretty cheap now and I’ve got mine running ProxMox hosting all kinds of stuff.
I do wonder how much of those voice assistants could run on-device. Most of what I use Bixby for (I know. I KNOW.) is setting timers. I think simple things like that can run entirely on the phone. It’s got a shocking amount of processing in it.
While you may have points against Apple and how effective Siri may be, with this latest version kind of products, even the watch has enough processing power to do voice processing on device. No ads. No cloud services
Pretty much. If you want a voice assistant right now, Siri is probably the best in terms of privacy. I bought a bunch of echos early, then they got a little shitty but I was in, and now I just want them out of my house except for one thing - music. Spotify integration makes for easy multi-room audio in a way that doesn’t really work as well on the other platform that I’ll consider (Apple/Siri) and basically adds sonos-like functionality for a tiny fraction of the price. The Siri balls and airplay are just not as good, and of course, don’t work as well with Spotify.
But alexa is so fucking annoying that at this point I mostly just carry my phone (iPhone) and talk to that even though it’s a little less convenient because I’m really goddamned tired of hearing “by the way…”
deleted by creator
Alexa is so bad though. Who’s going to pay for that?
Guess we’ll find out when they finally pull the trigger
Mine can’t ever seem to tell the difference between on and off if there is any sound in my house
I use “turn on ___” and “kill ___”. Much more reliable matches.
Do you change the names of all your devices to people names? The living room lamp is Steve, the bedroom fan is Maryanne…
Which one’s Bill?
Good to see people already training ai to kill.
But he acknowledged that Alexa will need to drastically improve before that happens.
I get tired of the outrage-headline game.
Alexa is more like a telemarketer disguised as an assistant. Every interaction is followed by a “by the way . Its a shit experience so I stopped using mine.
Alexa was designed explicitly for that purpose. They lose money on every Echo sold, the whole idea was they would make money selling you stuff. Turns out people would rather use their Echo to check the weather, get recipes, etc. rather than voice shop.
I just can’t see a use case for voice shopping. There are almost zero instances where I want to buy something without having a visual of that thing in front of me at time of purchase.
I could possibly see something like “buy another stick of deodorant”, but even then I want to see if there are deals or some other options and would want to check the price at a minimum.
Seems like yet another MBA idea.
Yeah it seems the execs who had the idea for Alexa never used Amazon for shopping. It’s a shit shopping site full of scammy products. I’d never buy anything from them without checking out the prices reviews, etc.
It’s really only good for re-ordering things you’ve already ordered. It will let you know that it found something in your order history and then you can decide whether you want to order again.
And this makes sense, but I’d still want to check prices to make sure that my $3 deodorant didn’t get discontinued and priced at $30/stick.
Well you think this way because you’ve seen what happened to Amazon in the past 10 years. 10 years ago, when they were getting ready to launch the Echo, Amazon was a great retailer that people trusted. Now a decade of sellers gaming listings and reviews, and Amazon customer service deteriorating, we’ve been trained not to trust Amazon’s defaults.
Ha, I use mine almost exclusively as a light switch. I don’t have to get out of bed to turn off my lights or turn on my fan. I’m sure they’re losing a bunch of money on me
It’s a great lightswitch. Also, thermostat adjustor (my husband is very particular and changes it about a dozen times a day).
And they also have smart lights and phone apps that do the same thing.
It’s also good for setting a timer. But yeah, I’m not buying shit from it.
I use mine to stream spotify.
Setting all my Alexa’s to UK English got rid of all marketing “by the ways.” I still regret going with the Alexa ecosystem but at least for now there is a workaround for the most rage inducing part of it.
By the way, did you know that you can find out more about telemarketing with an audio book from audible on the subject. Would you like to hear a preview of that now?
So they expect that people pay for being spied upon and seriously data mined?
Yes and people will pay for it.
Sometimes I can’t help thinking some people deserve to be taken advantage of.
I don’t know about that. They never delivered on Smart Home promises and the only truly useful thing my Google AI does is to give me the forecast. Otherwise it’s just a wifi speaker.
If they finally integrate Bard, I would actually consider paying for the service.
We have a Google mini. They listen to my six year old request the song Poopy Bum Bum all day. The ads get interesting.
Alexa has a feature where you tell it you’re leaving the house and it will listen for smoke detectors or breaking glass, alerting you through your phone if it detects something. Amazon is putting that behind a paywall next year.
Let me in your house and I’ll observe it for you for less money
Google did that with Nest Aware years ago as well. It’s super annoying.
Just FYI, Alexa records everything you speak into it, you can listen to it here:
https://www.amazon.com/gp/help/customer/display.html?nodeId=GHXNJNLTRWCTBBGW
And much of it can be listened to by staff that are hired to label it to train the model.
I already don’t use it, you don’t have to sell me on it.
deleted by creator
I never got the appeal of those things even ignoring how their design is the antithesis of privacy. It just seems dumb to talk to the computer box, like it’s a thing to talk to when it’s just a microphone and software. I simply prefer direct, precise, and silent control of devices
It’s good for hands/device free control. Setting timers while cooking by simply saying “set a timer” or controlling lights from across the room without fiddling with a phone or remote.
Set a timer’s and set an alarm’s the only two I ever found useful personally. I stopped using google assistant because it just legitimately stopped understanding me correctly and I got frustrated with it.
It’s very sci fi. Star Trek amongst many others from the 80s. If you are old enough then you would remember that this was the stuff of fantasy. I can see why it appeals to people with disabilities and possibly kids for homework or something. But I am 1000 percent with you on the privacy part. No thanks.
I have doubts alexa is using AI, seen how dumb it is, but well
From the article:
Amazon has bet big on AI, with the company unveiling a new, AI-powered version of Alexa alongside updated versions of its Echo Frames and Carrera smart glasses last week.
Good luck, I guess? Got the first Google home, at first it was great, I was asking it tons of questions. Then the questions stopped, used it for turning on the lights and other automations. Then I installed Home Assistant and the only command Google Home got was to set a timer to know when to pull things out of the oven. Eventually I stopped doing that.
At the moment all Google/Nest Homes have their mic cut off, I only use them to stream music in my house from my NAS via Plex. So yeah…
I still use mine for voice commands with home assistant. Works great.
All mine to is turn lights on and off… very occasionally they might be used to find a phone, or set a reminder, but I wouldn’t miss it if that went.
I wondered if I was unusual in not using the voice features much, but according to this thread it seems I’m not.
How to make me go back to buying shit in person, by Amazon.com
Something tells me that they’ll still listen to you for free.
Their using the public to train AI. Then charging the public for the AI it trained.
Now you know why it’s called a smart device.
can’t be that smart if it’s using me for training
Yes?
I’ll happily join in bashing Amazon for plenty of reasons, but training an AI is a step that adds significant value to the material. Just like any other product that is an effort that people are willing to pay for.
deleted by creator
They thought people would be like “Alexa, but me a ton of shit on Amazon” but people just use it for timers and the weather
“Alexa, release the Roombas”
30 roombas make their way out from under my bed
Yeah, can you imagine trusting that thing to buy stuff for you? Bit scary, actually.
They had those “re-order product” physical buttons for a while which you were supposed to glue to your washing machine so you could reorder when your detergent ran out.
Besides legal issues (at least over here all they could do is put things in your shopping cart) apparently the primary customers of those buttons were hardware hackers, turning them into all kinds of stuff.
Oh no!
I’ll just have to install a weather app and use the timer on my stove instead of using Alexa.
Exactly. I never did find another use for that thing. Had one 2014-2022. It didn’t survive my last move. Was voted off the island.
