In the late 1700s, French scientist Antoine Lavoisier proved that the mechanism behind burning is oxidation. Lavoisier’s discovery killed off an eternity of dogma involving a non-existent substance called phlogiston. The facts spoke for Lavoisier, but phlogiston did not go quietly or quickly.
I find myself in a kind-of modern version of the phlogiston story with my research into artificial general intelligence. I swim against the tide of the received view – that is, a position that is taken for granted without apparent need for criticism.
Allow me to set the scene with a story.
It’s 100,000 BCE. Your dinner is the cooling dead thing at your feet. You have fire back at camp. You have no clue what fire is, but you know it makes food edible.
Fast forward.
It’s the early 20th century and you are one of the Wright brothers. Inspired by birds, you think you can make a contraption fly. You experiment with shapes in a makeshift wind tunnel and find that certain shapes drag less and lift more. Eventually you fly a few feet.
Fast forward.
A hundred years later, you are a trainee pilot doing touch-and-go landings in a simulator. A physics model of flight is in the computers running the simulator. Just for fun you stall your jetliner over a shopping mall.
As you leave the simulator, having flown 16,384 km and gone nowhere, you remind yourself that flight and the computed physics of flight are not the same thing and that, thankfully, no shoppers died when a plane crashed through the mall.
My point?
No-one needed or assumed a theory of combustion prior to cooking dinner with it. We cooked dinner and then we eventually developed a theory of combustion.
Likewise, we flew and then figured out the detailed physics of flight. Historically, empirical scientific knowledge grows in this way.
In addition, modern computing gives unprecedented power to examine physics models of the natural world. But no matter how accurate the model, if someone told you the computed model and the natural world were literally the same thing, you’d be right to question their background assumptions.
If there was no difference between a computed physics model of fire and fire, the computer should burst into flames. If there was no difference between a computed model of flight and flight, the computer should fly. These things don’t happen and nobody expects them to.
Well, almost nobody.

There is a specialised science called artificial general intelligence (AGI). This isn’t artificial intelligence (AI), but AGI.
The difference? AI solves specific problems. Deep Blue – which was built to play chess – and Watson – which was built to win games of Jeopardy! – are examples of AI. By contrast, an AGI is a modeller of the unknown: a very different prospect.
Quite simply, AGI is about building “thinking machines” – general-purpose systems with intelligence comparable to that of the human mind.
Worldwide, without exception, the solution for AGI is the computer. In AGI, for the first time in history, a computed model of a natural phenomenon (you, the reader) is expected to be literally indistinguishable from the natural original. At best, based on the fire and flight examples, this expectation is without precedent in science.
This misdirection has made lots of good AI but has failed to make AGI non-stop since the 1950s. With this chronic failure, why has nobody built artificial (inorganic) brain tissue using the actual physics of cognition?
Neuroscience says this would involve an intricate dance between old-fashioned telephone-exchange signalling (known as action potentials) and a more modern cell-phone-like communication called electromagnetic field coupling.
The materials used in this process are the same used in the semiconductor chip industry. The difference is in the chip architecture, packaging and interconnections.
Sure, it’s complicated, but as an engineer/neuroscientist I can build these things and put them in a body of some sort. Like fire and flight, I can build the AGI using inorganic brain tissue and then learn about how (if) it works. Like the Wright Brothers’ early flights it will stumble and fall. But learning about cognition shall ensue and then I can build AGI with the physics of cognition. And then I know what I can compute with a model and what I can’t.

Sounds like a normal scientific approach to the problem, doesn’t it?
Try suggesting it to other researchers and research-funding providers.
Amid the fervent protests, AGI developers using computers profoundly confuse the map with the territory. You can point out the misdirection until you turn blue. They do not want to know.
Still confused? Well, if AGI were flight, the story would run something like this:
You want to fly from Melbourne to London. You build a flight simulator, get in, fly to London, get out of the simulator, and you are still in Melbourne! Undeterred, you build another flight simulator only to get the same result. And again, and again, and again.
Some 60 years pass and brilliant flight simulators litter the science landscape, but flight still eludes you. At no stage does it occur to you that the physics of flight is missing.
Get the picture?
In this way, millions of dollars are spent every year chasing the AGI rainbow with computers. Billions more are in the pipeline. The amount of funding, past and planned, for AGI using actual brain physics?
Zero.
Call me picky, but does this seem a little unbalanced, under-justified and, well, just plain odd?
The essential brain-tissue physics itself, insofar as it relates to AGI and fully understanding brain dynamics, is spectacularly under-explored for no sound reason. The mother of all low-hanging fruit awaits the end of nothing more than 17th-century thinking.
Have a look for yourself – there are email forums (e.g. Fabric of Reality) full of this mindset.
Me? I’d rather just build the artificial brain tissue and fix it scientifically like Lavoisier did.
Colin Hales
Researcher in brain electrodynamics at the Centre for Neural Engineering at University of Melbourne
The following generationally acculturated responses to this article are expected:
Read more***********************************************************************************
* I will be the one that has to justify my position when, historically, the reverse should be the case.
* The Church-Turing Thesis and the phrases "physics is digital" and "cognition is information processing" will be uncritically misinterpreted and used as justification. The applicaiton of the C-T theorem _presupposes_ the brain…
Stephen Pritchard
Researcher, cognitive science
Could you explain how constructing a machine out of inorganic brain tissue (could we have some detail on what this is) differs from simulating brain tissue using a computer programmed to model the relevant physics and chemistry of brain operation at the lowest levels? Are you saying that AGI needs to be embodied in a way that is not achievable with computer simulation?
I understand all this in terms of "levels" of explanation. I see intelligence as a 'high level' understanding of what the brain…
Read moreMark Moskvitch
Safety Specialist
Colin,
An interesting discussion. I am commenting rather behind others as I only just happened upon your comments on a discussion with Jaan Tallinn regarding AGI.
I think the key point that Mr Tallinn and his colleagues are missing is that so long as a human can wield an axe, computer-based models as he describes can never take over. That is, they seem to ignore the need for a physical entity in a physical world. A computer algorithm, whether more intelligent than a human or not, exists in…
Read moreRich Bodo
Pro
For the layman trying to google and wrap his head around this...to clarify, you want to physically replicate human brain tissue with semiconductors.
You don't want to use existing semiconductors to simulate the behavior of human brain tissue, as in [1], [2], [3].
You want to physically fashion silicon that has the same layout and physical characteristics as human brain tissue.
Assuming we can manufacture anything, my question is, in what detail do we understand the physical structure and…
Read moreColin Hales
Researcher
Hi,
Replication
This is not simulation, emulation, mimicry, modelling (analog or digital). IBM did not replicate. Those who are most imbued with the phlogistonised thinking are in the computer science field. They are completely unable to see the difference because they are immersed in what they do.
"To he that only has a hammer, all the worlds problems look like nails" (Maslow)
Semiconductors?
No. The chips are not based on semiconductors. There are parts of it that can use standard digital electronics, but this is not the important part that does the signaling: = Leaky capacitors.
Colin Hales
Researcher
Rich,
To complete the answer to your question, I will start by replicating an ant-sized brain. That, as AGI, would be a major breakthrough. It's smarter than any existing AGI (handling novelty).
The key to understanding what the chips do is that the signalling in a brain is LITERALLY happening in the chips, but without all the biological overheads. The chips will have and EEG and MEG signature like the brain does.
cheers
colin
Stephen Pritchard
Researcher, cognitive science
once you've explained how a leaky semiconductor does signalling, it should be straightforward to simulate it on a computer.
Colin Hales
Researcher
I did not say that a "leaky semiconductor" did signalling. I said that semiconductors have nothing to do with the signalling physics.
I said that leaky CAPACITORS do the signalling.
Yes, you can simulate all of it on a computer.
I am saying that the simulation is NOT the science of cognition.
I am saying you build, like artifical fire, artificial cognition... then you explore it and you find out about the science of cognition.
can you see this?
Exploration of the physics of cognition is not the computation of assumed physics. You cannot claim to have accessed all the properties of the natural original by replacing it with the physics of a computer.
Stephen Pritchard
Researcher, cognitive science
My mistake, I meant, capacitor, but wrote semiconductor.
-----
"I am saying you build, like artifical fire, artificial cognition... then you explore it and you find out about the science of cognition."
I see what you are saying. I just think your analogy is unsuccessful. Your analogy is that early humans could use and make fire before they understood how it worked, and you argue that we should use the same approach for cognition, and that making artificial brain tissue is such an approach…
Read moreRich Bodo
Pro
Colin,
Thanks for the clarification. I don't think I will understand the signalling in the near future, but for now I can say it is very interesting and exciting research you are doing.
Also, I know we're all dissing your analogies, but your CERN one hangs together nicely because it compares physical exploration to simulation directly.
Thanks for posting. If I run across any investor types that are looking into AGI (sadly unlikely, but you never know) I'll be sure to mention your project. If you have a website for your work you should mention it here!
If you are looking to present forward looking omnibus talk on this, you might mention this to the folks who run the singularity summit - if nothing else it would be a fun way to meet people who are sure to be very interested in the topic.
Evgeni Sergeev
logged in via LinkedIn
Colin, what is the procedure for replicating an ant's brain?
We need its connectome for that, I think. Once we have the brain, we also need the body, so that it can be embodied and act like a normal ant. It will need mechanical actuators to move, photo-sensitive elements to see, transducers for its antennae, chemical sensors. I don't think we can miniaturise all that, so we're talking about an ant the size of a dog at least. Then we can start studying the computational maps in its brain. That's the plan, if I read it right?
Back to step 1. Can we get an ant's connectome and how do we know we got it in enough detail? Especially, how can we tell the strengths of its synapses from scans?
Colin Hales
Researcher
:-)
I'm being thrown into the bear pit at the next singularity summit here in Melbourne.
I never expected to have to wage this particular battle, and it's taken 10 years to learn how.
It'll be fun.
cheers
Colin
Colin Hales
Researcher
Hi Evgeni,
You have intuited through to the nitty gritty! If I could hire you to help I would!
Yes ANT Version 0.0 will be the size of a dog, with all the attendant input/output and power needs. Ugly ant-dog indeed! Current robotics has the bodies and the instrumentation is available. I am not too concerned about this end of it.
As to connectomes: Once the basic chip topology is created, we don't 'program it'. We learn about learning adaption, and hard-wire the dynamics of learning adaptation…
Read moreEvgeni Sergeev
logged in via LinkedIn
Dawkins' 747 idea comes to mind when we talk about phylogenetic learning. I don't think that a big random, or uniform, system of the right kind of components can self-assemble into many distinct parts to divide-and-conquer the problem of e.g. vision. (cf. Felleman and van Essen's hierarchy). Rather, the only way we know it can happen is by evolution, beginning with modest goals, and building incrementally.
A great advantage that we have over natural selection, is that we already have a fair idea…
Read moreGeorge Michaelson
Person
What has changed since the Lighthill report of 1973?
Colin Hales
Researcher
Nothing! That's the point!
Despite the report pointing out problems with AI approaches using computers....absolutely _nobody_ has done actual replication.
In a wet neuroscience sense, things have recently changed. We finally have empirical confirmation of ephaptic coupling. Now we have solid science on what to replicate.
Anastassiou, C. A., Perin, R., Markram, H. & Koch, C. 2011 Ephaptic coupling of cortical neurons Nature Neuroscience, 14 217-223
Frohlich, F. & McCormick, D. A. 2010 Endogenous Electric Fields May Guide Neocortical Network Activity NEURON, 67 129-143
cheers
Colin
Colin Hales
Researcher
Nothing! That's the point!
Despite the report pointing out problems with AI approaches using computers....absolutely _nobody_ has done actual replication.
In a wet neuroscience sense, things have recently changed. We finally have empirical confirmation of ephaptic coupling. Now we have solid science on what to replicate.
Anastassiou, C. A., Perin, R., Markram, H. & Koch, C. 2011 Ephaptic coupling of cortical neurons Nature Neuroscience, 14 217-223
Frohlich, F. & McCormick, D. A. 2010 Endogenous Electric Fields May Guide Neocortical Network Activity NEURON, 67 129-143
cheers
Colin
Stephen Pritchard
Researcher, cognitive science
I worry that discussing Lighthill might conflate AI and AGI. There have been massive advances in AI since 1973.
And while AIs typically still operate in narrow domains, the scope and complexity of those domains has greatly broadened, which is useful for thinking about AGI.
e.g. 1970s: an AI that can move simulated coloured blocks when asked to by the user.
today: google returning you relevant search results in seconds
Read moretoday: computers are the best at chess
today: computers are the best…
Peter de Lissa
logged in via Twitter
Perhaps you can clarify your flight simulation analogy. Creating an artificial general intelligence is measured by its capacity to perform functions. If you want to say that the goal of getting to London can't be done only by modelling then you may as well say you can't build a plane to fly to London if you only design the blueprints for the plane.
To pose an extreme hypothetical to circumvent the extreme conditions of the analogy, what if the computer model designed a plane and incorporated its own architecture into it? If the model were sufficiently capable of liaising with engineers and obtaining the funds for it all, it could probably get to London.
I'm not trying to be pedantic, I just want to point out that the benchmarks for success are intrinsic to these questions.
Colin Hales
Researcher
Creating an artificial general intelligence is measured by its capacity to perform functions.
NO.
It is measured by its capacity to behave like humans (biology). This includes an ability to handle novelty.
One perfect benchmark is "the scientist". Scientists are modellers of the unknown. A computational model of a modeller of the unknown is an oxymoron because you have to provide a formal model of the unknown.
So the answer to all this is that YES, you can simulate a scientist, but to do that you'd have to know everything and simulate the (unknown) environment as well. So it's quite possible, but completely useless from the perspective of incomplete knowledge of the natural world.
"The Scientist" is my benchmark AGI.
Confont your computed AGI with something that nobody (including the AGI designers) ever saw before .... viola.... underperformance.
Peter de Lissa
logged in via Twitter
"It is measured by its capacity to behave like humans (biology)"
Well it is obvious you are of the opinion that we must replicate the biological functions, but incorporating it into the definition of AGI just begs the question, if that is your intention. I'm not sure why "no" was capitalised, was it to emphasise that I am wrong? If, within your definition, AGI is measured by its capacity to behave like humans, then is that not the array of functions it is tasked to perform?
Is it your assumption that a model can't incorporate an ever evolving model of the external world into its own model? Are you suggesting that by definition models can't learn? Are you suggesting that the only possible way in which such a creation can learn is through a strict replication of the biological functions?
Colin Hales
Researcher
"Is it your assumption that a model can't incorporate an ever evolving model of the external world into its own model? Are you suggesting that by definition models can't learn? Are you suggesting that the only possible way in which such a creation can learn is through a strict replication of the biological functions? "
No (capslock in control this time!).
What I am saying is that I do not know. You do not know. Nobody knows because the basic exploration has not been completed because replication…
Read moreColin Hales
Researcher
Once again:
It is
* the total lack of funding for (proper) replication that is the issue here.
* 100% confinement to AGI by computing that is the issue here.
* the invisibility and unawareness of this situation that I am trying to redress.
Those in the computer science field will find this situation the most difficult to see because it has been generationally inherited and is now trained-in systemically.
Dennis Alexander
logged in via LinkedIn
Ok, replication is different to simulation.
The replicant will consist of networked "leaky capacitors" (variable or fixed, multiple networks or single network?)
Input is a real question: how direct is the replication using inorganic materials and will there be the physiological equivalents of channel combination and separation?
Brains as embedded organs in living organisms are motivated by their embedded context. How do you propose to replicate the motivational input?
And these are just a few of the questions that will have to be answered! And I recognise that programmatic simulation cannot perform the replication because the program (software) would have to be built on assumptions about the physics not on observations of the physics of inorganic (artificial) brain replicants.
A very worthwhile research project. Whether it will yield a "positronic" brain or not is another matter altogether.
Ben Goertzel
logged in via Twitter
Colin,
Your analogies, to fire, flight etc., are rather screwily drawn.
Let's say the goal of manned flight is to lift humans high up in the air and move them to a different point in the world, and then let them down without killing them. This is an empirical test criterion, and one can measure whether it's been done or not via purely functional observations, without needing to know about the mechanisms. The Wright Brothers did it without feathers and flapping wings, and what they did still…
Read moreColin Hales
Researcher
Hi Ben,
All your comments are valid. But, as I just posted above (modified slightly), none of it justifies the total lack of replication approaches in the face of 60+ years of AGI failure.
***************
Read moreWhat I am saying is that I do not know for sure. You do not know. _Nobody_ knows because the basic exploration has not been completed because the necessary replication (as practised everywhere else in science) has not been carried out yet.Until we do the exploration properly we cannot model…
Brett Hall
logged in via Facebook
Colin, I'm finding in your posts - here and in other places - a rather slippery tendency to *sometimes* be committed to the notion that "The brain is not a computer" and then make more agnostic claims like "I do not know for sure". I think it would greatly help your case if you were consistent about your actual position. If you are agnostic, then be clear.
And then you can stop denigrating those you disagree with. You don't need to fight dogmatism with dogmatism. Yet that seems to be one of your…
Read moreDan Smith
Network Engineer
I like the general idea of empirically assessing the dirty analog world, but your analogies just confused me.
Firstly, shouldn't you be taking the Wright Bros to task for persisting with that crazy wood stuff, and not sticking to feathers, tendons and muscles with their designs? They uncovered general principles through observation, trial and error and by using similar shapes, but not identical materials. I agree that 60-odd years of little to no AGI progress doesn't sound great, but I'd also…
Read moreTony Linde
Tony Linde is a Friend of The Conversation.
retired
The analogies in this article are non sustainable. The author reckons that because computers are used to simulate real life, any attempt at AGI in a computer will be a model, not a real 'thinking machine'. This is akin to saying that you cannot build a flying machine using wood and carpentry techniques because this technology is used to build tables. With his analogy, the Wright brothers ought to have built wings for people, not a flying machine. I assume that AGI researchers are using computers to build a thinking machine because they consider it to be the best technology for the purpose.
'I can build the AGI using inorganic brain tissue and then learn about how (if) it works'. So, do it. If your approach is better then prove it. If that works, then others will follow. You do yourself a disservice by denigrating the approach others take. Just get on with proving your own ideas and stop knocking others.
Colin Hales
Researcher
Knocking others? Maybe I should take it as a positive sign that my logic is touching some nerves. If that gets people thinking then great, I have done my job as a communicator.
The point of the article is that when you try to get $ you run across the "received view" and encounter difficulty ....so much difficulty that in the entire history of AGI _nobody_ has done replication, and the reasons for it do not stand up to scrutiny and deserve a poke in the eye.
I have a viable design for the basic…
Read moreMark Harrigan
Dr
Colin, thanks for the article. It was very interesting. I agree model simulation is (generally) incapable of replicating that which it does not first understand or assume (except by accident) - although sometimes one can obtain astounding surpriseful results based on simple rules when modelling dynamically and detailed complex systems (e.g. bird flocking)
At the end of the day it appears your main gripe is that all funding is directed toward a single approach and that the "failure" to demonstrate…
Read moreColin Hales
Researcher
Thanks Mark.
I am aware of my curmudgeon tendencies, and I have tried a plethora of approaches. You shoudl have seen the first version of the article!
My formal funding approach involves a very modest goal: a smart sensor achieved in a very structured manner, with mere pointers to the various downstream potentialities. AGI is not even mentioned, nor is consciousness or any of the stuff. It doesn;t need to be. I fact the work looks like standard brain electromagnetism explored by replication…
Read moreMark Harrigan
Dr
Cheers Colin - I don't think your a curmudgeon - or even tending that way! :)
I guess then I have no other advice. Your work seems immensely interesting. I earnestly hope you get some funding to get you going while at the same time manage to shake a few trees so that the traditional AI/AGI practitioners might at least review their singlemindedness.
Best of Luck
Otmar Pokorny
Independent Scholar
"So the answer to all this is that YES, you can simulate a scientist, but to do that you'd have to know everything and simulate the (unknown) environment as well. So it's quite possible, but completely useless from the perspective of incomplete knowledge of the natural world." (Colin)
Otmar writes: Your goal of replicating the human mind is one we share. However, Colin continues:
"With this chronic failure, why has nobody built artificial (inorganic) brain tissue using the actual physics of…
Read moreGil Hardwick
Anthropologist
I'm less inclined to agree with the comments, here, Colin. I think a big selling point for you is in highlighting the fact that human engagement with even the current crop of computers is unnecessarily time consuming and expensive, only appearing less so by comparison with the earlier armies of typists and actuaries housed in huge government buildings somewhere up in the city somewhere.
I have been building custom systems as a sideline for 30 years now, initially because I needed computers for…
Read moreColin Hales
Researcher
Hi Gil,
My first anthropologist in an AGI discussion! Cool. :-)
You are right about the machine tuition: they cannot be programmed. They will be coached, like us. By example.
Indeed I can relate directly to all your observations. I have an industrial control background, and the reason I am in this position was because I used to make a living programming incredibly stupid, inflexible, expensive fragile computer control systems to do the dumbest things. It was waaaaay too hard.
I thought I might be able to do something about it. So I sat for a couple of years and thought about it.
The solution generalised easily into AGI (sorry but I think this name will stick!) ... and here I am over a decade later still trying to get my ideas realised. It seems patience is a prerequisite in this.
I never thought I'd have to de-phlogistonate the whole of science. Funny how things turn out!
cheers
colin
Brett Hall
logged in via Facebook
Colin, on this topic it seems you have more answers than questions. And that is precisely not the approach you cannot have towards hard problems in consciousness like AGI.
I find you to be on the same continuum as those who argue that the brain *is* (obviously) a computer. You're at the other end of the spectrum, sure - but you are dogmatic about what you think as much as they are. I explain this below...
As you have mentioned (and in some sense tarred with the same brush) the people at the…
Read moreMartin Spencer
PhD student at University of Melbourne
FYI: You just placed a 3000 word comment.
Also, you said: ".... it won't be until 2019, using Moore's Law and other considerations, before we have the capacity to simulate a human brain....So it's not that it's failed. It hasn't even been tried yet."
How much computer power do we have in 2012? Enough to simulate what animal? Has this animal successfully been simulated? I think this tells you something about what will be discovered in 2019.
Brett Hall
logged in via Facebook
I did not make those claims about what will be in 2019. I don't know anything about the technology of 2019. If you read what I have actually written it is simply a summary of an article where IBM researchers make claims about 2019.
I'm not sure what you are getting at with your questions. My own position is that we don't know either way whether human brains and AGI can be simulated on computers, or not. I am concerned that proponents of "brains are computers" and proponents of "no they're not" are equally dogmatic and hostile towards each other for no good reason as neither side has an explanatory theory of consciousness with which to settle the matter.
It is not possible to predict what will or will not be in 2019. That would be prophesy.
Yoron Hamber
Thinking
You need consciousness to be aware of yourself I think? There are some experiments in where one test whether different animals recognize themselves in a mirror, and as I remember it not all do so. You have other experiment in where it has been shown that certain kinds of birds are capable of very logical reasoning coming to fruition only through several steps, in attaining a goal, most often food :)
So is logic then the same as consciousness, as in being conscious about yourself? Doesn't seem…
Read moreMartin Spencer
PhD student at University of Melbourne
You said: "I'm not sure what you are getting at with your questions." I'm pointing out that here and now there is good evidence that computing power is not our limitation to recreating the function of brains. This does not prove that computers will never think, but it does show that computing power is not the limitation you seem to suggest that it is. We do not have to wait until 2019 to show that we have some lack of understanding.
Yoron Hamber
Thinking
Quite so. Find how to simulate a brain- Let it fire up and see how it defines itself, give it some stimuli as a 'eye' of some sort and study how it rearrange itself. Because that's the brains 'plasticity'. If you find a way to do that and see it adapt, you might also find a way to communicate with it. Maybe :)
I don't really know but it's also a question of how the brain communicates within itself, if it does it on several simultaneous planes or if it does it 'linearly'. I doubt the linearity myself, I expect it to be able to use several modes simultaneously with only a few coming out as your or mine expression of how it has drawn its final 'conscious' conclusion.
Plasticity is the way it works.
Colin Hales
Researcher
In relation to the comments overall .... I find I must simply defer to the point of the article: replication is spectacularly underexamined for reasons that are lacking.
If you see the very first comment I made you will find a list of the expected defenses of computer-only approaches.to the study of neuroscience/cognitive science and the creation of AGI.
The comments reflect instances of exactly those listed items. I have also demonstrated how easy it is to provoke advocacy of the listed items…
Read moreYoron Hamber
Thinking
Maybe there is one good analogue to a brain? I'm thinking of this guy that makes very small robots using analogue technology, not digital. That works beautifully and those small machines can do a lot of stuff that would take the processing of a much larger digital 'linear' computer to mimic. Maybe we are expressions, as some wavefronts expressed from a ocean of 'thinking'?
But whatever a brain is, it's not a computer, although it shares a lot with computers. And I'm just as sure that it isn't 'linear', and all computers we use today, that I know of, does linear computing never mind if it's called 'parallel processing' etc. It's still linear.
What that means to me is that we might be able to mimic a brain digitally, but it would have to be a colossus of a linear digital machine to do it. Nature can do the same with very small organisms.
Jeremy Garnett
Learning Technologies Support Officer
From reading both the article and the comments, I interpret the underlying issue as being a question of method, rather than metaphor, investment or, indeed, intelligence. The solution would, I imagine, require all five.
Science is, in my mind, the systematic investigation of possibilities. Though there may be a set goal in mind, such as the creation of an AGI or an AI, there may be other questions that arise; are answered; and may, indeed, feed back into the original study. One such question…
Read moreJoscha Bach
logged in via Twitter
Colin, thank you for the nice write-up on your position. As people working on strong AI will continue to tell you (until you turn blue): in their view, thinking is a (very specific form of) information processing, and simulated information processing happens to be information processing, too. Thus, a simulated thought process will be a thought process.
Thinking is not neural activity any more than flying is feather activity. Flying is functionally the realization of certain aerodynamic principles, and feathers are just a possible implementation of that. Likewise, thinking is functionally the realization of certain information processing principles, and biological neurons are just implementing these.
In fact, your approach is likely to fail for another reason: thinking is perhaps best understood as the solution of a very complex control problem (how to navigate primates through a physical and social environment). Thinking is not the result of piling up brain tissue.
Evgeni Sergeev
logged in via LinkedIn
I have two comments in reply:
1) The term _thinking_ can refer to linguistic-type thinking, with symbols and production rules. Even visual imagination.
Read moreEarly AI attacked those type of problems. But these types of thinking are probably a corollary of the _other_ activity that the brain performs, and that's creating the signs and symbols out of the input data in the first place. That activity may or may not be best described as thinking. This is the forming of words and phrases out of sound, and…
Colin Hales
Researcher
I'd like to point out that the required hardware ( that does actual action potentials coupled spatially with the actual EM fields produced by the action potentials) does not exist. It's not an FPGA or any other kind of semiconductor model of anything. No memory of the kind we know. No bus suystem of the kind we know. No register system of the kind we know. It's not analog computing. It's not manipulatinf symbols of the kind found in a computer program.
In replication there are no models. There…
Read moreEvgeni Sergeev
logged in via LinkedIn
Let's explore the Wright brothers analogy some more. I'm not familiar with the historic details, but suppose they have conducted experiments with objects in a wind tunnel *in order to figure out the physics* of aerodynamic properties of simple objects. Then they had to take these simple objects, wings, and put them onto a cabin, so that flight could be combined with carrying people.
Is _replication_, in your usage, the activity of isolating parts of the system in a way that allows them to be characterised…
Read moreJoscha Bach
logged in via Twitter
1) I agree, except to the word "blocking". I think that most people in the field have understood the need for understanding sub-symbolic and distributed processing to capture cognition. Symbolic processing does exist (for instance in planning and grammatical language), but only as a special case.
2) I do not agree, hardware is not the problem. The majority opinion on the computational complexity yielded by biological neurons and their translation into neural abstractions is quite well supported…
Read moreColin Hales
Researcher
Evgeni,
'Laws of nature' (LoN, statements of regularity) have multiple origins. A physics model is a LoN. In settling on a LoN we have:
1) Observation of the natural phenomenon as it is. This can support a particular model.
2) There is replication of the natural phenomenon. This can lead to novel observations (1), augment thereby augment a LoN, making it more general.
3) There is computer simulation of models. This can be suggestive of new (1) or changes to a LoN.
To find geniuinely…
Read moreColin Hales
Researcher
Joscha,
"If Colin wants to make an argument about hardware that convinces computer scientists or funding agencies, he needs to stop using misguided metaphors and non-sequitur arguments. His idea that hardware beats computation is fundamentally flawed. "
1) My metaphors are merely a depiction of 2000 years of science. Please go read about it. It is the way it is.
2) "His idea that hardware beats computation is fundamentally flawed". I have not said this at all. Please read the dialog and the original article. I say that replication is a tried method that has been completely unexplored in brain tissue. How much has been missed? Nobody knows! That's the point.
Also: See the most recent comment to Evgeni.
Once again I find myself deferring the item 1 of my very first comment above. I should not have to be justifying this approach. How much evidence of this 'phlogistonised thinking' do I have to provide?
Yoron Hamber
Thinking
Nice thinking :)
You could also consider the way the brain interpret a flavor from geometrical formations aka molecules and up, The better they 'fit' their receptors the stronger the taste.
So where does the flavor we taste becomes created? In the molecules? Or is it a layer of 'theoretical definitions' our brains present us with, the 'conscious' me, interpreting the signals it get from the receptors??
So you have the receptors answering to a geometry identifying it. You have the 'brain' interpreting the same into a flavor. Then yourself, consciously 'tasting' that flavor.
Plasticity and some other way of synergy that I don't find the word for. And then the question. What of this do you think best represent 'intelligence and consciousness'?
The last 'layer' perhaps?
And that 'fog/cloud', if so, is something more that the sum of its constituents, as i see it.
Evgeni Sergeev
logged in via LinkedIn
I think in the next 100 years science might figure out ways to visualise very well what lights up when smells and tastes occur. But I fear that nothing interesting could be said about the "feel" of subjective experience, although a great deal has been said (cf. the field of philosophy).
Evgeni Sergeev
logged in via LinkedIn
It seems that justify you must. Historically, people's minds have been controlled by certain memes and not others for no better reason than they were the loudest or the clearest or stuck by some other mechanism. What seems logical to one person is neglected by another.
Replication. Do you think any cognition at all is important? Personally I'm mostly interested in the vision and motor capabilities of mammals and birds.
Is there anything to learn by replicating C. elegans to start off with? Does it have cognition that we don't understand? Does it do anything that cannot be simulated by our model of it?
Joscha Bach
logged in via Twitter
In the article, you point out: "If there was no difference between a computed model of flight and flight, the computer should fly." -- This is a flawed metaphor, in my view. See, if our discourse would be the result of a computed model of thinking instead of thinking, it would still be the very same discourse.
The general idea that computation can be likened to phlogiston is wrong on multiple levels (but I like the narrative approach it engenders). You suggest that physics (i.e. hardware) can…
Read moreYoron Hamber
Thinking
Maybe, but the consciousness is a subjective experience as I see it. And as such it's what I call 'theoretical', although more real to us than what creates it :)
It seems as if most of the things we call real, just are interpretations we do.
Colin Hales
Researcher
Hi Evgeni,
I am extremely interested in cognition and consciousness, and see a whole taxonomy of animals worth exploring.
Retention of the fully expressed physics is expected to be highly informative of the kind and extent of coherence mechanisms operating within and between brain regions, and between the brain and the external environment. By use of the natural physics I expect to see phenomena that will not be seen with assumed models and computing.Just like replication has always done.
cheers
Colin
Colin Hales
Researcher
Joscha,
It is a brute fact that NOBODY has replicated and explored brain tissue physics. If so, please deliver evidence of it. I fear you don’t know what replication actually is. You mistake the blue brain for replication. It’s not replication.
An information metaphor ( = map) is not the actual physics of tissue (the territory). Look at a brain. Where’s the ‘information’? No such thing. There’s atoms and cells etc.
And so forth.
Look. Leave to the literature trail. When my replication results come out, then we can have a decent discussion based on solid experimentation.
Joscha Bach
logged in via Twitter
Colin, it is a brute fact that nobody has replicated wing tissue physics, and hence, no artificial system can fly. Look at a bird. Where are 'aerodynamic principles'? No such thing. There's atoms and cells etc.
Do you see how your argument falls on its face?
Please, let me summarize the discussion:
AI researcher:
Read more1. Cognition is information processing.
2. Neurons facilitate information processing. We can abstract from that, and functionally replicate what neurons do.
3. We have demonstrated…
Evgeni Sergeev
logged in via LinkedIn
:) I insist on "blocking". In the sense that people in the field are well aware of the problem, but ... eh ... there is still work to be done there :)
That cat concept forming network sounds interesting, but I can't find it on the net. Is it in some video talk?
Joscha Bach
logged in via Twitter
Again, I agree to the way you put it.
The informal description of the cat conceptualizer went through the usual hype channels, like Engadget: http://www.engadget.com/2012/06/26/googles-search-for-cats/
Some more details are here: http://arxiv.org/abs/1112.6209
Caveat: Yes, it is unsupervised, deep learning. Yes, it demonstrates that ANNs can do automatic concept formation. No, it does not scale towards general AI (it does not extend into a straightforward architecture for that), and it even is restricted to bitmaps.
Colin Hales
Researcher
No.
No matter how may times I do this and how concisely I put it, you keep getting it wrong.
6. Once we build my hardware, we can model human cognition.
I do not want to _MODEL_ anything. I want to replicate it.
Sorry I can't do this any more. Life is too short.
Evgeni Sergeev
logged in via LinkedIn
In a corporate environment you will often find people who say "the company would want A and B", or "A is in the interest of the company, while B is not". This surprised me at first because it seemed like personifying the company. Was is a euphemism for the president or the chairperson? No. Then how do we find out what the company wants? This is a set of memes that are shared by the management (more or less). So this way a virtual thing like the company becomes conscious: it's made up of a bunch of…
Read moreJoscha Bach
logged in via Twitter
"I do not want to _MODEL_ anything. I want to replicate it."
That is my point. The functional modeling of information processing is its replication. You claim that (a) cognition is different from information processing (which is unconvincing, because the information processing abstractions yield the expected results), and that (b) you therefore have to reproduce the physical level (but from there, it would not follow that you get a cognitive system at all, because even if the EM fields were necessary…
Read moreYoron Hamber
Thinking
There 'plasticity' might present a guide. Seems as if the brain can much do anything, and adapt and take in all kinds of sensory input to then interpret them as a integral part of 'itself', and that experience it will present to ones conscious mind too. The expression 'steering by ones pants' isn't as far from the truth that one might think, if looking at it this way :)
Chris Barry
logged in via Twitter
The conversation about thinking robots is continuing over at the TechnYou blog if you are interested :)
http://technyou.edu.au/2012/07/thinking-robots/
Joshua Ridley Pratt
logged in via Facebook
Colin,
Would it not be possible for AGI to function in a different way to the way the our brains function.
To use your Wright brothers analogy: Their plane didn't work the same way as a bird does but produced a similar outcome.
Why can't this be true of AGI as well.
We don't need a real brain whatever it is made of, we just need something that produces outcomes like a brain.
Thanks.
P.S. I don't mind if I'm wrong. I just want to find out if I am.
Colin Hales
Researcher
Firstly, I am not the arbitrator/oracle of all things right/wrong!
Yes, the plane and the bird and different, but operate on the same principles.
"Why can't this be true of AGI as well?"
Exactly! My AGI proposition is to do exactly that. What I also suggest is that the 'basic operating principles' of a brain, upon which an AGI needs to be based, _is not a computer_, and that this is the principal reason why AGI has failed non stop for 60 years.
So I propose to build what a brain does…
Read more