No doubt a stupid question, but I am masterful in the asking of them. I can be the guy everyone sniggers at whenever I post - every forum should have one.
So: if I understand it correctly, whole brain emulation is one approach to building a platform for Friendly AGI. If we assume that cognitive functionalism holds true as a theory — the idea that our brains are a kind of computer — there are two very promising approaches worth pursuing. One strategy is the rules-based approach as, for example, promoted by Ben Goertzel. This involves hard-coding to figure out the algorithms of intelligence and the ways that they’re intricately intertwined - cognitive science.
The second approach seems to be focussed on reverse engineering of the human brain itself. Neuroscientists say there’s no reason to believe that we can’t model this structure ourselves. Here, whole brain emulation implies the re-creation of all the brain’s properties in an alternative substrate, namely a computer system, creating a 1-to-1 model where all relevant properties of a system exist.
My question, then, is - would the latter method require reverse engineering a single brain and if so, whose? Having bipolar disorder, the last thing you would want would be me holding the fate of the world in my hands. Hell, I can barely use my iPhone and my mood swings would, I feel, make for a very dangerous Singularity.
So, is this a dumb question? If reverse engineering the brain in order to build the platform for AGI wins out of the two approaches stated above, who exactly will the AGI ‘be’ - at least to begin with? Or is it (as I suspect) somewhat more complicated than that?