📰 Distill.pub

Detailed derivations and open-source code to analyze the receptive fields of convnets.

A closer look at how Temporal Difference Learning merges paths of experience for greater statistical efficiency

Six comments from the community and responses from the original authors

The main hypothesis in Ilyas et al. (2019) happens to be a special case of a more general principle that is commonly accepted in the robustness to distributiona

An example project using webpack and svelte-loader and ejs to inline SVGs

An example project using webpack and svelte-loader and ejs to inline SVGs

An experiment showing adversarial robustness makes neural style transfer work on a non-VGG architecture

Section 3.2 of Ilyas et al. (2019) shows that training a model on only adversarial errors leads to non-trivial generalization on the original test set. We show

What we'd like to find out about GANs that we don't know yet.

How to turn a collection of small building blocks into a versatile tool for solving regression problems.

Inspecting gradient magnitudes in context can be a powerful tool to see when recurrent units use short-term or long-term contextual understanding.

By using feature inversion to visualize millions of activations from an image classification network, we create an explorable activation atlas of features the n

If we want to train AI to do what humans want, we need to study humans.

A powerful, under-explored tool for neural network visualizations and art.

A simple and surprisingly effective family of conditioning mechanisms.

Interpretability techniques are normally studied in isolation. We explore the powerful interfaces that arise when you combine them -- and the rich structure of

By creating user interfaces which let us work with the representations inside machine learning models, we can give people new tools for reasoning.

A visual guide to Connectionist Temporal Classification, an algorithm used to train deep neural networks in speech recognition, handwriting recognition and othe

How neural networks build up their understanding of images

We often think of optimization with momentum as a ball rolling down a hill. This isn't wrong, but there is much more to the story.

Science is a human activity. When we fail to distill and explain research, we accumulate a kind of debt...

Several interactive visualizations of a generative model of handwriting. Some are fun, some are serious.

When we look very closely at images generated by neural networks, we often see a strange checkerboard pattern of artifacts.

Although extremely useful for visualizing high-dimensional data, t-SNE plots can sometimes be mysterious or misleading.