Presumably you had some point that you were trying to convey with your comment, which is going to get lost by the people who will see it as simply victim blaming. The tone of this reply and your other comments suggest that you’re fine having an abrasive personality and care more about some sense of being right than constructive criticism, so I’ll just leave it there and wish you a good day!
Didn’t think I had to spell this out, but in all three cases it’s victim blaming. Men blaming women for being raped, white people blaming black people for being shot by the police, and the previous poster blaming people for getting caught in shitty contracts by predatory companies. On a scale of severity they’re in completely different universes, but that’s kind of the point of an analogy: to use a more extreme example to illustrate why something is wrong.
Edit: And to be clear, this comment was not addressed at your comment, but the poster who replied to you.
I get where you’re coming from so I won’t downvote, but I thought you might want to know that this has some real “men shouldn’t rape women, but women shouldn’t dress slutty or get drunk” or “police shouldn’t shoot black men, but black men should just comply” vibes.
Whoops! Definitely a typo. Thanks for the catch!
Adding every picture I take on my phone to the blockchain is an enormous invasion of my privacy, and the number of times where having a cryptographically secure hash on the blockchain to prove a photo’s authenticity is minuscule. Especially in a world where people eagerly believe the most ludicrous bullshit because it reinforces their worldview, in spite of a mountain of evidence to contradict it.
This is more specific to Tesla than self driving in general, as Musk decided that additional sensors (like LiDAR and RADAR on other self driving vehicles) are a problem. Publicly he’s said that it’s because of sensor contention - that if the RADAR and cameras disagree, then the car gets confused.
Of course that raises the problem that when the camera or image recognition is wrong, there’s nothing to tell the car otherwise, like the number of Tesla drivers decapitated by trailers that the car didn’t see. Additionally, I assume Teslas have accelerometers so either the self driving model is ignoring potential collisions or it’s still doing sensor fusion.
Not to mention we humans have multiple senses that we use when driving; this is one reason why steering wheels still mostly use mechanical linkages - we can “feel” the road, we can detect when the wheels lose traction, we can feel inertia as we go around a corner too fast. On a related tangent, the Tesla Cybertruck uses steer-by-wire instead of a mechanical linkage.
This is why many (including myself) believe Tesla has a much worse safety record than Waymo. I’ve seen enough drunk and distracted drivers to believe that humans will always drive better than a human robot. Don’t get me wrong, I still have concerns about the technology, but Musk and Tesla has a history of ignoring safety concerns - see the number of deaths related to his desire to have non-mechanical handles and hide the mechanical backup.
Taxes are either regressive, proportional, or progressive; flat and progressive are the same thing. While some (many?) consider proportional to be a separate category, I would argue that it’s inherently regressive, as any fixed percentage is going to come disproportionately from non-disposable income for any lower income individuals. Sales taxes are considered regressive because of this and they are a flat rate for most purchases.
You can make the argument that people have to buy stuff to exist, but they don’t have to purchase a home, but given the alternative is renting which impacts lower income people even worse, this seems like a specious argument.
Even with property tax, insurance, repairs, and mortgage, I’m paying less per month than people renting much smaller apartments in my area. Thats neither fair nor right.
I feel like you’re ascribing so much more intelligence and thoughtfulness to Trump’s reasoning than has been consistently demonstrated. I fully believe that his entire reasoning is that Greenland is really big on most map projections and relatively easy to take by force (whether by bullying Denmark into ceding it or literally invading it militarily).
He wants to leave his mark by doing something very few Presidents have done, especially in the modern era. Same reason he created the Space Force or the White House ballroom - it’s a vanity project by a malignant narcissist who wants to leave a legacy and doesn’t care about the cost, or even the actual benefits.
Which is fine and dandy until the gold miners realize that they aren’t going to find enough gold to make it worthwhile and stop buying shovels and the market value of your company depends on your ability to continue selling shovels. Twenty five years after the dot com bubble burst, shovel seller Cisco is only just now reaching the same stock price they peaked at in early April of 2000.
Do we want the informed consumers making rational decisions kind of capitalism, or the kind where corporations exploit people who are helpless to whatever a lie they want to tell about the true cost of our decisions? Guess we have the answer.
It started in 1812. Although the Democratic-Republican party did evolve into the current Democratic party over the course of two centuries, it’s hardly fair to call them the same party. That’s eight generations between then and now and the political landscape has changed dramatically.
As for the “both sides do it” whataboutism, like so many “both sides” issues the current Republican Party benefits far more from gerrymandering than the current Democratic Party, and this is before this especially egregious Texas mid-census redistricting.
The only thing close to a decision that LLMs make is
That’s not true. An “if statement” is literally a decision tree.
If you want to engage in a semantically argument, then sure, an “if statement” is a form of decision. This is a worthless distinction that has nothing to do with my original point and I believe you’re aware of that so I’m not sure what this adds to the actual meat of the argument?
The only reason they answer questions is because in the training data they’ve been provided
This is technically true for something like GPT-1. But it hasn’t been true for the models trained in the last few years.
Okay, what was added to models trained in the last few years that makes this untrue? To the best of my knowledge, the only advancements have involved:
I’m hardly an expert in the field, so I could have missed plenty, so what is it that makes it “understand” that a question needs to be answered that doesn’t ultimately go back to the original training data? If I feed it training data that never involves questions, then how will it “know” to answer that question?
it knows from its training data that sometimes accusations are followed by language that we interpret as an apology, and sometimes by language that we interpret as pushing back. It regurgitates these apologies without understanding anything, which is why they seem incredibly insincere
It has a large amount of system prompts that alter default behaviour in certain situations. Such as not giving the answer on how to make a bomb. I’m fairly certain there are catches in place to not be overly apologetic to minimize any reputation harm and to reduce potential “liability” issues.
System prompts are literally just additional input that is “upstream” of the actual user input, and I fail to see how that changes what I said about it not understanding what an apology is, or how it can be sincere when the LLM is just spitting out words based on their statistical relation to one another?
An LLM doesn’t even understand the concept of right or wrong, much less why lying is bad or when it needs to apologize. It can “apologize” in the sense that it has many examples of apologies that it can synthesize into output when you request one, but beyond that it’s just outputting text. It doesn’t have any understanding of that text.
And in that scenario, yes I’m being gaslite because a human told it to.
Again, all that’s doing is adding additional words that can be used in generating output. It’s still just generating text output based on text input. That’s it. It has to know it’s lying or being deceitful in order to gaslight you. Does the text resemble something that can be used to gaslight you? Sure. And if I copy and pasted that from ChatGPT that’s what I’d be doing, but an LLM doesn’t have any real understanding of what it’s outputting so saying that there’s any intent to do anything other than generate text based on other text is just nonsense.
There is no thinking
Partially agree. There’s no “thinking” in sentient or sapient sense. But there is thinking in the academic/literal definition sense.
Care to expand on that? Every definition of thinking that I find involves some kind of consideration or reflection, which I would argue that the LLM is not doing, because it’s literally generating output based on a complex system of weighted parameters.
If you want to take the simplest definition of “well, it’s considering what to output and therefore that’s thought”, then I could argue my smart phone is “thinking” because when I tap on a part of the screen it makes decisions about how to respond. But I don’t think anyone would consider that real “thought”.
There are no decisions
Absolutely false. The entire neural network is billions upon billions of decision trees.
And a logic gate “decides” what to output. And my lightbulb “decides” whether or not to light up based on the state of the switch. And my alarm “decides” to go off based on what time I set it for last night.
My entire point was to stop anthropomorphizing LLMs by describing what they do as “thought”, and that they don’t make “decisions” in the same way humans do. If you want to use definitions that are overly broad just to say I’m wrong, fine, that’s your prerogative, but it has nothing to do with the idea I was trying to communicate.
The more we anthropomorphize these statistical text generators, ascribing thoughts and feelings and decision making to them, the less we collectively understand what they are
I promise you I know very well what LLMs and other AI systems are. They aren’t alive, they do not have human or sapient level of intelligence, and they don’t feel. I’ve actually worked in the AI field for a decade. I’ve trained countless models. I’m quite familiar with them.
Cool.
But “gaslighting” is a perfectly fine description of what I explained. The initial conditions were the same and the end result (me knowing the truth and getting irritated about it) were also the same.
Sure, if you wanna ascribe human terminology to what marketing companies are calling “artificial intelligence” and further reinforcing misconceptions about how LLMs work, then yeah, you can do that. If you care about people understanding that these algorithms aren’t actually thinking in the same way that humans do, and therefore believing many falsehoods about their capabilities, like I do, then you’d use different terminology.
It’s clear that you don’t care about that and will continue to anthropomorphize these models, so… I guess I’m done here.
I watched this entire video just so that I could have an informed opinion. First off, this feels like two very separate talks:
The first part is a decent breakdown of how artificial neural networks process information and store relational data about that information in a vast matrix of numerical weights that can later be used to perform some task. In the case of computer vision, those weights can be used to recognize objects in a picture or video streams, such as whether something is a hotdog or not.
As a side note, if you look up Hinton’s 2024 Nobel Peace Prize in Physics, you’ll see that he won based on his work on the foundations of these neural networks and specifically, their training. He’s definitely an expert on the nuts and bolts about how neural networks work and how to train them.
He then goes into linguistics and how language can be encoded in these neural networks, which is how large language models (LLMs) work… by breaking down words and phrases into tokens and then using the weights in these neural networks to encode how these words relate to each other. These connections are later used to generate other text output related to the text that is used as input. So far so good.
At that point he points out these foundational building blocks have been used to lead to where we are now, at least in a very general sense. He then has what I consider the pivotal slide of the entire talk, labeled Large Language Models, which you can see at 17:22. In particular he has two questions at the bottom of the slide that are most relevant:
The problem is: he never answers these questions. He immediately moves on to his own theory about how language works using an analogy to LEGO bricks, and then completely disregards the work of linguists in understanding language, because what do those idiots know?
At this point he brings up The long term existential threat and I would argue the rest of this talk is now science fiction, because it presupposes that understanding the relationship between words is all that is necessary for AI to become superintelligent and therefore a threat to all of us.
Which goes back to the original problem in my opinion: LLMs are text generation machines. They use neural networks encoded as a matrix of weights that can be used to predict long strings of text based on other text. That’s it. You input some text, and it outputs other text based on that original text.
We know that different parts of the brain have different responsibilities. Some parts are used to generate language, other parts store memories, still other parts are used to make our bodies move or regulate autonomous processes like our heartbeat and blood pressure. Still other bits are used to process images from our eyes and other parts reason about spacial awareness, while others engage in emotional regulation and processing.
Saying that having a model for language means that we’ve built an artificial brain is like saying that because I built a round shape called a wheel means that I invented the modern automobile. It’s a small part of a larger whole, and although neural networks can be used to solve some very difficult problems, they’re only a specific tool that can be used to solve very specific tasks.
Although Geoffrey Hinton is an incredibly smart man who mathematically understands neural networks far better than I ever will, extrapolating that knowledge out to believing that a large language model has any kind of awareness or actual intelligence is absurd. It’s the underpants gnome economic theory, but instead of:
It looks more like:
If LLMs were true artificial intelligence, then they would be learning at an increasing rate as we give them more capacity, leading to the singularity as their intelligence reaches hockey stick exponential growth. Instead, we’ve been throwing a growing amount resources at these LLMs for increasingly smaller returns. We’ve thrown a few extra tricks into the mix, like “reasoning”, but beyond that, I believe it’s clear that we’re headed towards a local maximum that is far enough away from intelligence that would be truly useful (and represent an actual existential threat), but in actuality only resembles what a human can output well enough to fool human decision makers into trusting them to solve problems that they are incapable of solving.
It didn’t lie to you or gaslight you because those are things that a person with agency does. Someone who lies to you makes a decision to deceive you for whatever reason they have. Someone who gaslights you makes a decision to behave like the truth as you know it is wrong in order to discombobulate you and make you question your reality.
The only thing close to a decision that LLMs make is: what text can I generate that statistically looks similar to all the other text that I’ve been given. The only reason they answer questions is because in the training data they’ve been provided, questions are usually followed by answers.
It’s not apologizing you to, it knows from its training data that sometimes accusations are followed by language that we interpret as an apology, and sometimes by language that we interpret as pushing back. It regurgitates these apologies without understanding anything, which is why they seem incredibly insincere - it has no ability to be sincere because it doesn’t have any thoughts.
There is no thinking. There are no decisions. The more we anthropomorphize these statistical text generators, ascribing thoughts and feelings and decision making to them, the less we collectively understand what they are, and the more we fall into the trap of these AI marketers about how close we are to truly thinking machines.
Spoiler alert: This country had roughly the same amount of integrity and ethics prior to 2016. The only difference is that Trump gave everyone who gave lip service to integrity and ethics permission to unmask and expose their hypocrisy. To those people, ethics was just a weapon to tie the hands of the few people who actually had strong values.