Humanaut wrote:
What goals would motivate a computer?
At some point during the development of AI's a programmer would likely embed "prime directives" into a computer; for example seek out more knowledge with an aim to understanding the physical world. Asimov came up with his three laws of robotics which are also a good basis.
In humans those directives evolved as "Self preservation and reproduce" and all our other needs, wants and desires are subordinate to those two prime directives or instincts.
If scientists/programmers ever produce nanites with the ability to reproduce themselves and give them the same two prime directives / instincts then the lid will be well and truly off Pandora's box! Welcome to the world of grey goo.
_________________
I've left WP indefinitely.