31
DF General Discussion / Re: Want to know what would be pretty scary? And incredably difficult?
« on: June 02, 2010, 01:56:54 am »
Wait, we talkin' UD, TFTD, or APOC? Or the Gawd-offal will-not-be-named one?
March 6, 2024: Dwarf Fortress 50.12 has been released.
News: February 3, 2024: The February '24 Report is up.
News: February 4, 2021: Dwarf Fortress Talk #28 has been posted.
News: November 21, 2018: A new Threetoe story has been posted.
Forum Guidelines
The first AI's with any real depth will start on the internet.
I guarentee it.
No other place is more suited to interaction, for a machine.

Corbald: Crashing *immediately* is generally considered a better idea.
quite likely to make DF crash eventually.I see irony there
Well, he's wrong in the first paragraph. If a man says he has no volition, and he is correct, his statement that he has no volition says nothing about his own beliefs. It does not necessitate that he not believe it, and so there is no paradox; there is also therefore no proof that volition exists. Further, self-destruction does NOT frustrate all aims; there are situations in which it is an acceptable cost and a plausible means (such as, for instance, throwing oneself on a grenade in the hopes of protecting others). Most of the rest of that quote falls apart without those.
Since subjective standards can be changed by the volition of the one selecting them, by definition, they cannot be used as standards. Only standards which cannot be changed by the volition can serve as standards to assess when such changes ought be made.which I believe stands on it's own, and supports the other following points.
Morality defines the goals. logic defines how you set about achieving them, and which goals should be achieved.
Axioms: A statement that there is no truth, if true, is false. Nor can anyone testify that he has perceived that all his perceptions are illusions. Nor can anyone be aware that he has no awareness. Nor can he identify the fact that there are no facts and that objects have no identities. And if he says vents arise from no causes and lead to no conclusions, he can neither give cause for saying so nor will this necessarily lead to any conclusion. And if he denies that he has volition, then such a denial was issued unwillingly, and this testifies that he himself has no such belief."The Golden Transcendence" - John C. Wright
Undeniably, then, there are volitional acts, and volitional beings who perform them.
A volitional being selects both means and goals. Selecting a goal implies that it ought be done. Selecting a means that defeats the goal at which it aims is self-defeating; whatever cannot be done ought not be done. Self-destruction frustrates all aims, all ends, all purposes. Therefore self-destruction ought not be sought.
The act of selecting means and goals is itself volitional. Since at least some ends and goals ought not be selected (e.g., the self-defeating, self-destructive kind), the volitional being cannot conclude, from the mere fact that a goal is desired, that it therefore ought to be sought.
Since subjective standards can be changed by the volition of the one selecting them, by definition, they cannot be used as standards. Only standards which cannot be changed by the volition can serve as standards to assess when such changes ought be made.
Therefore ends and means must be assessed independently of the subjectivity of the actor; an objective standard of some kind must be employed. An objective standard of any kind implies at the very least that the actor apply the same rule to himself that he applies to others.
And since no self-destruction ought be willed, neither can destruction at the hands of others; therefore none ought be willed against others; therefore no destructive acts, murder, piracy, theft, and so on, ought be willed or ought be done. All other moral rules can be deduced from this foundation.

.
Thousands of fish, easy. Don't care if they're maybe going to be intelligent, they're not now. Besides which, morality is an entirely human construct; there is no physical law of morality. A rock is not moral, nor is a bear. It can't be universal because, at least currently, it applies only to human actions.There is also no physical law for mathematics either
. Mathematics, and Morality, reflect physical laws. Objective Morality would, of course, be useable only by those beings that are capable of being objective. In other words, those with volition. Not that Morality doesn't apply to a bear, or a rock, but that they, being imperfect, defy it. (In the case of the rock... Perfectly exemplify it?)Also, why would an emotionless AI self-terminate? Self-termination, as you said, would be a short-term waste of the resources that went into producing it. Failing to self-terminate would be no waste at all, however, as the AI could accomplish short-term goals.The AI has logically deduced that it should continue to exist. We would say that was a moral judgement.
Long-term, all of the resources that go into creating it and maintaining it will be wasted anyway, so the long-term cost assessment wouldn't figure into a logical AI's decisions in that way.Why would those resources be wasted? If the AI continues to do things that it determines to be 'useful,' it would have purpose of some sort. If it were ever to find it's self to be useless, it would indeed self terminate, to prevent to waste of the resources it would need to continue to function. However! self-termination would be a loss of volition, and logically it would seek to prevent the loss of it's own volition (once you're gone, you can't change your mind if you might become useful later!) so would make every attempt to remain useful, to justify it's use of resources.
As a general rule, if you stumble across an apparent paradox, the first step is to try and resolve it before declaring the situation impossible.I'm really not seeing how we disagree here...
First off, number 2 is fatally flawed. Morality is not universal. It can be made 'universal' with logic within the human species, but interspecies relations and relations within other species may follow entirely different rules. For example, is the slaughter of thousands of fish more or less wrong than the death of a human? If, as I suspect you would, you answered killing the human is more wrong because humans are intelligent, who is to say an AI would not say the same of us. That the death of thousands of humans is less wrong than the death of one AI with superhuman intelligence. Morality is an evolved trait which is used to more or less keep social structures together. A non-social species, if it were to evolve to intelligence*, may not even acknowledge morality as a concept. This is why if we create super-intelligent AI, they must be started from a template similar to humans; to think of us as being essentially the same as them; part of their society. When you have an us and a them, it will rapidly devolve into us vs them.
Secondly, organic computers are not magical. They can not fit infinite numbers of transistors into a finite space. The reason organic processors such as the brain are currently more efficient than your PC's CPU is because they are massively parallel. A neuron maxxes out at around 1 or 2 kHz, whereas even a crappy PC goes at almost 2.5gHz. The difference is you have only a small handful of processors (1 to 16 or so) whereas you have billions of neurons. However, when talking of organic processing methods, what is being discussed (to the best of my knowledge) is essentially chemical reaction based. What matters is how they perform, not whether they are arbitrarily classified as organic or inorganic. In that regard, I'm fairly sure nanotech beats out organic processing (or likely will in a relatively short period of time) in terms of both speed and durability.
*speaking purely in hypotheticals here; social structure may or may not actually be one of the keys to evolving higher intelligence
Read the trilogy: "The Golden Age" by John C. Wright. Specifically, book 3, "The Golden Transcendent" After Phaethon meets his father at the Solar Orbital Array, while preparing to enter the Sun, the group discuses Objective Morality. Phaethon presents the most exacting definition of the subject I have ever seen. If someone owns the book and can post the (admittedly multi-page) quote, please do.
YOU HAD PICOMETRES?You kidding me? I've put myself through 1 - 2 fps for regular DF games, hours spent watching my dwarfs going to the stockpile and then drinking for hours.
Some people don't realize how good they have it...
1 to 2 FPS? Luxury! Why, we used to have to share a single frame every minute, all twenty-six of us, with no backlight, and 'alf the screen was missing, and we were all huddled in one corner for fear of falling...
A single frame? You were lucky to have a frame! We had to live in the hole of a punch card dropped under the central housing of a UNIVAC II in a decommissioned nuclear silo, and every-morning we'd have to get up at 4;00 AM and die of radiation that was leaking from a nearby cracked warhead. But we were happy then....
*sticks nose in air*
A whole punch card? YOU WERE LUCKY TO HAVE A PUNCH CARD! Back in my day, we had to work for a unforgiving blood god (His name was Armok, but we called him "The Player", and not for his notorious pimping of the cats) who usually sacrificed us for a HOLE. But we were ecstatic back then...
Well, when I call it a punch card, it was more of broken-off sliver of the Antikythera mechanism, floating in a puddle of radioactive septic goo that had a tendency to mutate animals into obnoxious teenaged vigilante's.... but it was a punch card to us!
You were lucky to have your puddle of radioactive septic goo! There were a hundred and fifty of us living on a single hard disk platter in a broken-down IBM RAMAC that rendered about three frames during the entire Clinton administration. Every morning at six we'd get up, defragment the hard drive with our tongues, and head down to the mill where we'd have our arms and legs ripped off by elephants for a chance at seeing a single 'E'!
WHAT? A WHOLE DISK PLATTER? BLASPHEMY!
When I was your age, over 9000 of us lived in a single particle of matter! Every day we had to be on the lookout for flying electron particles, while the very neurons that we stood on kept giving way, killings hundreds of us every day!
Only hundreds?!
Son, in my day we didn't have 9,000 of us in one particle, no, not 9,000, not 10,000, not 1,000,000, not even 100,000,000. No, we had 100,000,000,000,000,000,000 of us in one particle!
Every day we would lose hundreds of thousands for each Picometre of movement anywhere on the earth! We stopped counting the deaths a mere second after we started!
Son, let me tell you. In my day, we lived a hundred of us to each planck volume, and GLAD OF IT. Every day we had to fight back the black holes that threatened to form, and we were HAPPY they weren't CARP.
Blah, Lucky worms, all of you. i only had access to the 5 spirits Earth, wind, Fire, water and lighting. i had none of this quantum Eistine mumble jumbo mechanics. we worshiped the Toads and where happy with our lot in life
) This trend would obviously continue to higher levels as well. It's simply wasteful to murder/steal/destroy. Even medical science is trying it's best to remove the cutting from surgery, for obvious reasons. ...to argue that moral judgements can be rationally defensible, true or false, that there are rational procedural tests for identifying morally impermissible actions, or that moral values exist independently of the feeling-states of individuals at particular times.R W Hepburn
)
)'