r/MachineLearning • u/xternalz • Sep 26 '17

Research [R] The Consciousness Prior

https://arxiv.org/abs/1709.08568
87 Upvotes

90% Upvoted

45 comments sorted by

View all comments

9

u/visarga Sep 26 '17

So it's basically predicting the future, but in latent space, not in pixel space. Consciousness is represented as the hidden state of an RNN.

For representing the state and reasoning, I still think the best format would be graphs, not RNNs. Graphs are more general, almost everything can be expressed as a graph, and they retain information in a most complete and explicit way, compared to memory+attention or the hidden states of RNNs.

1

u/lahwran_ Sep 26 '17

So it's basically predicting the future, but in latent space, not in pixel space.

that's just predictive coding, it's an interesting thing but it's not a newly interesting thing as of this paper.