Reminds me of an early application of AI where scientists were training an AI to tell the difference between a wolf and a dog. It got really good at it in the training data, but it wasn’t working correctly in actual application. So they got the AI to give them a heatmap of which pixels it was using more than any other to determine if a canine is a dog or a wolf and they discovered that the AI wasn’t even looking at the animal, it was looking at the surrounding environment. If there was snow on the ground, it said “wolf”, otherwise it said “dog”.
Early chess engine that used AI, were trained by games of GMs, and the engine would go out of its way to sacrifice the queen, because when GMs do it, it’s comes with a victory.
Reg, why’d you just stab yourself in the shoulder?
Ah cmon, ain’t ya ever seen a movie?
Well of course I’ve seen a movie, but what the hell are ya doing?
Every time the guy stabs himself in a movie, it’s right before he kicks the piss outta the guy he’s fightin’!
Well that don’t… when that happens, the guys gotta plan Reg, what the hell’s your plan?
I dunno, but I’m gonna find out!
One of my favorite examples is when a company from India (I think?) trained their model to regulate subway gates. The system was supposed to analyze footage and open more gates when there were more people, and vice versa. It worked well until one holiday when there were no people, but all gates were open. They eventually discovered that the system was looking at the clock visible on the video, rather than the number of people.
The idea of AI automated job interviews sickens me. How little of a fuck do you have to give about applicants that you can’t even be bothered to have even a single person interview them??
“oooo books he must be really smart”
That reminds me of the time, quite a few years ago, Amazon tried to automate resume screening. They trained a machine learning model with anonymized resumes and whether the candidate was hired. Then they looked at what the AI was looking at. The model had trained itself on how to reject women.
I really hate that we are calling this wave of technology “AI”, because it isn’t. It is “Machine Learning” sure, but it is just brute force pattern recognition v2.0.
The desired outcomes you define and then the data you train it on both have a LOT of built-in biases.
It’s a cool technology I guess, but it’s being misused across the board. It is being overused and misused by every company with FOMO. Hoping to get some profit edge on the competition. How about we have AI replace the bullshit CEO and VP positions instead of trying to replace fast food drive through workers and Internet content.
I guess that’s nothing new for humans… One human invents the spear for fishing and the rest use them to hit each other over the head.
I agree with most of your points, but i don’t entirely like the “this is not intelligence” line of thought. We don’t even know yet how to define intelligence, and pattern recognition sounds a LOT like what our brains do. The hype is of course ridiculous, and the ways it’s being used is just stupid, but i do think pattern recognition could be a solid basis for whatever we end up considering intelligence.
