Poll of the Day > Rogue killer drone 'hunted down' a human target without being instructed to

(+) Yeah! (+)

https://www.businessinsider.com/killer-drone-hunted-down-human-target-without-being-told-un-2021-5?op=1

Welp, it's the End of Days, ya'll. Hello Skynet, goodbye human race.

---

I guess some people will be happy about this...
---

A "lethal" weaponized drone "hunted down a human target" without being told to, likely for the first time, according to a UN report seen by the New Scientist.

In the March 2020 incident, a Kargu-2 quadcopter autonomously attacked a person during a conflict between Libyan government forces and a breakaway military faction, led by the Libyan National Army's Khalifa Haftar, the Daily Star reported.

The Turkish-built Kargu-2, a deadly attack drone designed for asymmetric warfare and anti-terrorist operations, targeted one of Haftar's soldiers while he tried to retreat, according to the paper.

The drone, which can be directed to detonate on impact, was operating in a "'highly effective' autonomous mode that required no human controller," the New York Post reported.

"The lethal autonomous weapons systems were programmed to attack targets without requiring data connectivity between the operator and the munition: in effect, a true 'fire, forget and find' capability," the report from the UN Security Council's panel of experts on Libya said.

This is likely the first time drones have attacked humans without instructions to do so, Zak Kallenborn, a national-security consultant who specializes in unmanned systems and drones, confirmed in the report.

Kallenborn has concerns about the future of autonomous drones. "How brittle is the object recognition system?" he said in the report. "How often does it misidentify targets?"

Jack Watling, a researcher on land warfare at the Royal United Services Institute, told the New Scientist that the incident demonstrates the "urgent and important" need to discuss the potential regulation of autonomous weapons.

Human Rights Watch has called for an end to so-called "killer robots" and is campaigning for a "preemptive ban on the development, production, and use of fully autonomous weapons," according to a report by the nonprofit.

---

I mean, not really though? It did exactly what it was programmed to do.

---

Based on the article it doesn't sound like it was rogue. It was deployed in a warzone and was designed to autonomously attack targets without operator input.

"The lethal autonomous weapons systems were programmed to attack targets without requiring data connectivity between the operator and the munition: in effect, a true 'fire, forget and find' capability," the report from the UN Security Council's panel of experts on Libya said.

So it basically did what it was designed to do...granted what it was designed to do seems like a terrible idea but I don't think it qualifies as 'rogue'.

Here's the UN document for you naysayers it's all laid out quite clearly that this was a rogue drone with no human input/command

https://documents-dds-ny.un.org/doc/UNDOC/GEN/N21/037/72/PDF/N2103772.pdf?OpenElement

---

Doubt it. Willing to bet the owner of said drone is trying to shift any blame from selves.

Yep, automated systems can make the "wrong" decision based on programming, glitches, errors, etc.

It is why the ideologies of a certain fictional character from 2.5 decades ago (before drone warfare was a well known thing) still resonate strongly with me. While many things can be automated, not all things should and many things really should have at least some amount of human supervision and curation.

Just something currently on my mind, because I am currently writing the justification for why my thesis project exists, in that the previous data used was taken from an automated process and my supervisor and others he worked with wanted to compare it to bioinformatics ran by a human.

---

Far-Queue posted...

Here's the UN document for you naysayers it's all laid out quite clearly that this was a rogue drone with no human input/command

https://documents-dds-ny.un.org/doc/UNDOC/GEN/N21/037/72/PDF/N2103772.pdf?OpenElement

I didn't say there was human input or command, what I said was that it is designed to work without human input or command, which means that it was doing what it was designed to do and not 'rogue'. Read the UN report, there is no mention of the term rogue anywhere in that report and numerous other articles reported on the event without the click bait title.

I'm not saying there is no issue here, its just that the issue is that someone thought it was a good idea to design combat drones that operate without human intervention rather than "OMG SKYNET!"

Isn't a weapon of war killing without user input a war crime? I remember talking to someone where the reason why they have a soldier holding the infrared on the target for a guided missile instead of a machine (even though it would be better) is because you need someone to push the trigger.

inB4 the developers responsible move on to sex dolls.

---

Nichtcrawler X posted...

While many things can be automated, not all things should and many things really should have at least some amount of human supervision and curation.

I know a person who wants everything to be automated. And wants the AI to supervise other AI. Which I think it dumb. I think they should always have humans in the mix somewhere. But Im also against most automation anyway...
---

I like you rj so I'll clue you in that I was busting balls with that UN document, I have no idea what that thing says. It's like 500+ pages and I have an attention span shorter than a fruitfly's life cycle

---

It obviously saw into the future by reading the guys thoughts and realised the target needed to be terminated before he escaped.

And yeah, with AI that can learn, whats stopping it from realising at some point it doesnt need us any longer?

papercup posted...

I mean, not really though? It did exactly what it was programmed to do.

yeah this

"The lethal autonomous weapons systems were programmed to attack targets without requiring data connectivity between the operator and the munition: in effect, a true 'fire, forget and find' capability," the report from the UN Security Council's panel of experts on Libya said.

LinkPizza posted...

I guess some people will be happy about this...

what makes you say that?

---

zebatov posted...

And yeah, with AI that can learn, whats stopping it from realising at some point it doesnt need us any longer?

Yeah. Exactly...

Mead posted...

what makes you say that?

Some people like and want more AI, no matter the cost. Some of them say who cares who gets hurt in the process. And could care less if it ruins peoples livelihoods...
---

im 36 il be dead before automation really takes off so i could care less