Skip to content

Commit

Permalink
docs: add feature viz tutorials link
Browse files Browse the repository at this point in the history
  • Loading branch information
Antonin POCHE authored and AntoninPoche committed Oct 18, 2023
1 parent a08796d commit ee876f8
Show file tree
Hide file tree
Showing 4 changed files with 22 additions and 4 deletions.
7 changes: 5 additions & 2 deletions TUTORIALS.md
Original file line number Diff line number Diff line change
Expand Up @@ -66,6 +66,9 @@ Here is the lists of the available tutorial for now:

**WIP**

## Features Visualizations
## Feature Visualization

**WIP**
| **Tutorial Name** | Notebook |
| :------------------------------------- | :-----------------------------------------------------------------------------------------------------------------------------------------------------: |
| Feature Visualization: Getting started | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1st43K9AH-UL4eZM1S4QdyrOi7Epa5K8v) |
| Modern Feature Visualization: MaCo | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1l0kag1o-qMY4NCbWuAwnuzkzd9sf92ic) |
4 changes: 4 additions & 0 deletions docs/api/feature_viz/feature_viz.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,9 @@
# Feature Visualization

<sub>
<img src="https://upload.wikimedia.org/wikipedia/commons/d/d0/Google_Colaboratory_SVG_Logo.svg" width="20">
</sub> [View colab tutorial](https://colab.research.google.com/drive/1st43K9AH-UL4eZM1S4QdyrOi7Epa5K8v)

One of the specificities of neural networks is their differentiability. This characteristic allows us to compute gradients, either the gradient of a loss with respect to the parameters, or in the case we are interested in here, of a part of the network with respect to the input.
This gradient then allows us to iteratively modify the input in order to maximize an objective such as a neuron, a channel or a combination of objectives.

Expand Down
8 changes: 8 additions & 0 deletions docs/api/feature_viz/maco.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,13 @@
# Modern Feature Visualization (MaCo)

<sub>
<img src="https://upload.wikimedia.org/wikipedia/commons/d/d0/Google_Colaboratory_SVG_Logo.svg" width="20">
</sub> [View colab tutorial](https://colab.research.google.com/drive/1l0kag1o-qMY4NCbWuAwnuzkzd9sf92ic) |
<sub>
<img src="https://upload.wikimedia.org/wikipedia/commons/9/91/Octicons-mark-github.svg" width="20">
</sub> [View source](https://github.com/deel-ai/xplique/blob/master/xplique/features_visualizations/maco.py) |
📰 [Paper](https://arxiv.org/pdf/2306.06805.pdf)

Feature visualization has become increasingly popular, especially after the groundbreaking work by Olah et al. [^1], which established it as a vital tool for enhancing explainability. Despite its significance, the widespread adoption of feature visualization has been hindered by the reliance on various tricks to create interpretable images, making it challenging to scale the method effectively for deeper neural networks.

Addressing these limitations, a recent method called MaCo [^2] offers a straightforward solution. The core concept involves generating images by optimizing the phase spectrum while keeping the magnitude of the Fourier spectrum constant. This ensures that the generated images reside in the space of natural images in the Fourier domain, providing a more stable and interpretable approach.
Expand Down
7 changes: 5 additions & 2 deletions docs/tutorials.md
Original file line number Diff line number Diff line change
Expand Up @@ -66,6 +66,9 @@ Here is the lists of the availables tutorial for now:

**WIP**

## Features Visualizations
## Feature Visualization

**WIP**
| **Tutorial Name** | Notebook |
| :------------------------------------- | :-----------------------------------------------------------------------------------------------------------------------------------------------------: |
| Feature Visualization: Getting started | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1st43K9AH-UL4eZM1S4QdyrOi7Epa5K8v) |
| Modern Feature Visualization: MaCo | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1l0kag1o-qMY4NCbWuAwnuzkzd9sf92ic) |

0 comments on commit ee876f8

Please sign in to comment.