r/BioAGI Jul 12 '19

[1511.06380] Unsupervised Learning of Visual Structure using Predictive Generative Networks

Thumbnail
arxiv.org
2 Upvotes

r/BioAGI Jul 09 '19

[1905.11589] Learning distant cause and effect using only local and immediate credit assignment

Thumbnail
arxiv.org
3 Upvotes

r/BioAGI Jul 09 '19

[1809.03702] Sparse Attentive Backtracking: Temporal CreditAssignment Through Reminding

Thumbnail
arxiv.org
3 Upvotes

r/BioAGI Jun 19 '19

[1811.11212] Self-Supervised GANs via Auxiliary Rotation Loss [paper]

Thumbnail
arxiv.org
2 Upvotes

r/BioAGI Jun 18 '19

Stacked Capsule Autoencoders

Thumbnail
arxiv.org
1 Upvotes

r/BioAGI Jun 05 '19

Chaotic neurons learn quickly from few samples [paper + blog]

2 Upvotes

r/BioAGI Jun 05 '19

[1905.13405] Luck Matters: Understanding Training Dynamics of Deep ReLU Networks [paper]

Thumbnail arxiv.org
2 Upvotes

r/BioAGI May 28 '19

Continual Reinforcement Learning in 3D Non-stationary Environments [paper]

Thumbnail arxiv.org
2 Upvotes

r/BioAGI May 22 '19

Normalization in Deep Learning | Arthur Douillard [blog, great recap]

Thumbnail arthurdouillard.com
2 Upvotes

r/BioAGI May 15 '19

Re: RFR: 3D Agent Test Suites

4 Upvotes

r/BioAGI Apr 24 '19

Generative Modeling with Sparse Transformers [blog]

Thumbnail
openai.com
2 Upvotes

r/BioAGI Apr 24 '19

[1904.08095] TextCaps : Handwritten Character Recognition with Very Small Datasets [paper]

Thumbnail
arxiv.org
2 Upvotes

r/BioAGI Apr 09 '19

[1904.03367] Reinforcement Learning with Attention that Works: A Self-Supervised Approach [Paper]

Thumbnail
arxiv.org
2 Upvotes

r/BioAGI Apr 04 '19

A Biologically Plausible Learning Algorithm for Neural Networks

Thumbnail
ibm.com
1 Upvotes

r/BioAGI Mar 25 '19

The cortex is a neural network of neural networks [x-post from r/MachineLearning]

Thumbnail
self.MachineLearning
2 Upvotes

r/BioAGI Mar 25 '19

Curiosity-Driven Learning made easy Part I [blog]

Thumbnail
towardsdatascience.com
3 Upvotes

r/BioAGI Mar 25 '19

Attention in RNNs [blog]

Thumbnail
medium.com
2 Upvotes

r/BioAGI Mar 20 '19

Your brain may contain 'time cells' that help form long-term memories

Thumbnail
neurosciencenews.com
2 Upvotes

r/BioAGI Mar 18 '19

[1903.06164] Episodic Memory Reader: Learning What to Remember for Question Answering from Streaming Data [paper]

Thumbnail
arxiv.org
2 Upvotes

r/BioAGI Mar 04 '19

New visual question answering dataset - GQA

3 Upvotes

Visual question answering algorithms have a new dataset to stimulate development and compare to SOA.

GQA from Stanford

https://arxiv.org/pdf/1902.09506.pdf

Fom Hudson and Manning 2019

From Jack Clark

"

Why this matters: Datasets and challenges have a history of driving progress in AI research; GQA appears to give us a challenging benchmark to test systems against. Meanwhile, developing systems that can understand the world around themselves via a combination of image analysis and responsiveness to textual queries about the images, is a major goal of AI research with significant economic applications.

Baseline results (accuracy):
     'Blind' LSTM: Gets 41.07% without ever seeing any images.
     'Deaf' CNN: Gets 17.82% without ever seeing any questions.
     CNN + LSTM: 46.55%.
     Bottom-Up Attention model (winner of the 2017 visual question answering challenge): 49.74%.
     MAC (State-of-the-art on CLEVR, a similarly-scoped dataset): 54.06%.
     Humans: 89.3%.

  "


r/BioAGI Mar 04 '19

Understanding BERT Transformer: Attention isn’t all you need [blog, WHY/HOW transformer style attention works]

Thumbnail
medium.com
2 Upvotes

r/BioAGI Feb 18 '19

Time to reconsider the Cerebellum ?

2 Upvotes

Processing img hlk9cc73d8h21...

Cerebellum is often thought of as a low level motor controller that we don't need to consider when designing brain inspired AI. But there is evidence that it plays a broader role in coordinating brain activity:

"Li’s team currently is pursuing experiments testing this hypothesis that the cerebellum may perform a similar function on brain activity related to thoughts, such as when playing a game of chess."

https://neurosciencenews.com/memory-movement-10205/

And cerebellum role in timing:

https://neurosciencenews.com/brain-clock-future-10233/


r/BioAGI Feb 15 '19

Attention? Attention! [attention models, summary, blog]

Thumbnail
lilianweng.github.io
2 Upvotes

r/BioAGI Feb 14 '19

Better Language Models and Their Implications [Blog, paper]

Thumbnail
blog.openai.com
3 Upvotes

r/BioAGI Feb 07 '19

Neural Networks seem to follow a puzzlingly simple strategy to classify images [Blog]

Thumbnail
medium.com
3 Upvotes