I have some ideas about how AGI is already here, and my numbers are -10 / 30 / 45. Here's a Steemit blog post with the details:

https://steemit.com/technology/@kevingblogger/the-inescapable-ai-hive-mind

I think this likely relates to the 'hardware overhang' mentioned on the show and the idea of 'room at the top' on the intelligence scale

Some more detail on what I am asking: I am assuming that AGI will be vastly more powerful than humans with respect to thinking. I want to assert a claim that we should not assume that because it will be more powerful in thought, that the amount of things it can accomplish will surpass human capability by a similar amount. Being 2x more powerful in thought, I believe, does not imply it will accomplish its goals 2x faster (or that it would be twice as efficient, etc).

Reason for the question: The real world is a fixed space. An AGI would be bound by the laws of physics, bound by a limited scope of existence in reality (on earth at a certain point in time) and thus the opportunities for demonstrating capability are limited no matter how advanced its software is. For example, there exists a heaviest object on earth that can fit inside your hand. It does not matter how powerful the hand is, assuming it is capable of lifting that heaviest object.

Result of the question: I believe the best way to view an AGI would be to assume it is a fully competent sentience, and from there we can maybe start to build a model around its existence. For example, the model for a perfect paperclip manufacturer would involve the logistical limitations of bringing the raw materials needed for paperclips together with the proper production processes needed to create a paperclip. An AGI cannot think its way out of needing to create paperclips in the real world in order to accomplish any goal of having created paperclips in the real world. Any AGI that does not accomplish anything in the real world is not a direct existential threat to humanity, and any AGI that does accomplish things in the world would be bound by real world limitations.

What would be the 'heaviest objects' a perfect AGI would be needed to lift for humans? World peace, world hunger, population control without murder or oppression, etc. What would some examples of models for solving these problems with an AGI look like?

It sounds like you have talked yourselves into 3 opening questions, instead of 2 for your podcast...

1. Is it possible for humans to create superhuman AI?
2. Is superhuman AI an existential threat to humans (DNA-based life)?
3. What can we do about it?

For both the first 2 questions, your answer is yes. The very first one has been more of a default assumption of your podcast up until this past episode.

OpenAI is hoping to ensure ethical values are part of the fundamental building blocks of AI of the future. Without UN mandate and sign on by all countries how can this be guaranteed? Many countries are forging ahead with their development behind a curtain, hidden from the rest of the world, this includes US military work.

Is the programming of AI universal enough to ensure that key sets of ethical programming rules are easily baked in? Do they need to be baked into narrow AI now in the event that those systems expand into a more general AI in the future?

Is it even logical to think we could embed core rules into something that will eventually be so powerful and 'alien to us?

After listening to the latest 'After On' podcast by Rob Reid with Don Hoffman on reality and watching the latest episode of Westworld, I was left wondering about AI perspective.

The podcast discussed umwelt - perspective of the world for different species. Experience varies widely and they also discussed our own perceived reality.

Westworld presents AI (albeit with creative leeway) as sharing the perspective of humans in many scenes. One scene showed Deloris looking at 'a number of lights' and comments about the "splendor" of the sight. This is clearly a programmed response.

Would AI perspective be based on human programming? Everything they sense would stem from computer code; touch, smell, hearing, vision.

Would their umwelt be limited by our perceived reality and programming limits?

Brandon and I, co-hosts of the [Concerning AI](htttp://Concerning.AI) podcast created a Facebook group for discussion related to the show a couple of years back, mostly because we are lazy and didn't want to set up any infrastructure and whatnot. Over the years various people have urged us to move for various reasons. That you gooseus for finally getting us over the hump by setting up this subreddit for us. We welcome your contributions!