Skip to content

Commit 59ff3f3

Browse files
committed
Update documentation
1 parent 4096b1b commit 59ff3f3

14 files changed

Lines changed: 508 additions & 31 deletions

File tree

_sources/index.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -34,13 +34,13 @@ We will present our tutorial about _Interpretability Techniques for Speech Model
3434

3535
**Representational Analysis methods**:
3636
- Probing{cite}`cormacenglishDomainInformedProbingWav2vec2022, choEvidenceVocalTract2023,bentumProcessingStressEndEnd2024,shen-etal-2024-encoding,bentum25_interspeech,deheerklootsWhatSelfsupervisedSpeech2025,cormacenglishDomainInformedProbingWav2vec2022`
37-
- Representation space comparisons: RSA{cite}`chrupala-etal-2020-analyzing,shenWaveSyntaxProbing2023a`, CCA{cite}`Pasad2021`, CKA{cite}`pmlr-v97-kornblith19a`)
37+
- Representation space comparisons: RSA{cite}`chrupala-etal-2020-analyzing,shenWaveSyntaxProbing2023a`, CCA{cite}`Pasad2021`, CKA{cite}`pmlr-v97-kornblith19a`
3838
- CTC & Decoder lenses{cite}`deheerklootsHumanlikeLinguisticBiases2024,langedijkDecoderLensLayerwiseInterpretation2024`
3939
- Embedding similarities (ABX tests){cite}`schatz2016,algayresDPParseFindingWord2022,seysselDiscriminatingFormMeaning2025`
4040

4141
**Feature Importance Scoring methods**:
4242
- Context-mixing: Attention{cite}`yangUnderstandingSelfAttentionSelfSupervised2020a,shimUNDERSTANDINGROLESELF2022,alastrueyLocalityAttentionDirect2022,audhkhasiAnalysisSelfAttentionHead2022`, Attention Norm{cite}`kobayashiAttentionNotOnly2020a`, Value-Zeroing {cite}`mohebbiHomophoneDisambiguationReveals2023a`
43-
- Feature attribution {cite}`fucciExplainabilitySpeechModels2024,shenReliabilityFeatureAttribution2025`: Gradient-based{cite}`prasadHowAccentsConfound2020,guptaPhonemeDiscretizedSaliency2024` & Perturbation-based{cite}`wuExplanationsforASR2023,pastor-etal-2024-explaining`
43+
- Feature attribution{cite}`fucciExplainabilitySpeechModels2024,shenReliabilityFeatureAttribution2025`: Gradient-based{cite}`prasadHowAccentsConfound2020,guptaPhonemeDiscretizedSaliency2024` & Perturbation-based{cite}`wuExplanationsforASR2023,pastor-etal-2024-explaining`
4444

4545
## References
4646

_sources/interspeech2025/intro.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
# Interspeech 2025
1+
# Interspeech 2025 tutorial
22

33
We provide four notebooks, exemplifying the interpretability techniques we cover in the tutorial. The notebooks are designed to work on Google Colab, open them through the links below:
44

_sources/reading-list.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
# Reading list
2+
3+
In [this github repository](https://github.com/mdhk/awesome-speech-interpretability) we share an annotated bibliography we are compiling while surveying interpretability analyses of speech processing models. Your suggestions are very welcome!

genindex.html

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -177,9 +177,9 @@
177177
</a>
178178
</li>
179179
</ul>
180-
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Tutorial Materials</span></p>
180+
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Materials</span></p>
181181
<ul class="nav bd-sidenav">
182-
<li class="toctree-l1 has-children"><a class="reference internal" href="interspeech2025/intro.html">Interspeech 2025</a><input class="toctree-checkbox" id="toctree-checkbox-1" name="toctree-checkbox-1" type="checkbox"/><label class="toctree-toggle" for="toctree-checkbox-1"><i class="fa-solid fa-chevron-down"></i></label><ul>
182+
<li class="toctree-l1 has-children"><a class="reference internal" href="interspeech2025/intro.html">Interspeech 2025 tutorial</a><input class="toctree-checkbox" id="toctree-checkbox-1" name="toctree-checkbox-1" type="checkbox"/><label class="toctree-toggle" for="toctree-checkbox-1"><i class="fa-solid fa-chevron-down"></i></label><ul>
183183
<li class="toctree-l2"><a class="reference internal" href="interspeech2025/representational-analyses/probing.html">Probing exercise: Does Wav2Vec2 encode vocal tract movements?</a></li>
184184

185185

@@ -206,6 +206,7 @@
206206

207207
</ul>
208208
</li>
209+
<li class="toctree-l1"><a class="reference internal" href="reading-list.html">Reading list</a></li>
209210
</ul>
210211

211212
</div>

index.html

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -74,7 +74,7 @@
7474
<link rel="icon" href="_static/favicon.ico" />
7575
<link rel="index" title="Index" href="genindex.html" />
7676
<link rel="search" title="Search" href="search.html" />
77-
<link rel="next" title="Interspeech 2025" href="interspeech2025/intro.html" />
77+
<link rel="next" title="Interspeech 2025 tutorial" href="interspeech2025/intro.html" />
7878
<meta name="viewport" content="width=device-width, initial-scale=1" />
7979
<meta name="docsearch:language" content="en" />
8080
</head>
@@ -181,11 +181,10 @@
181181
</a>
182182
</li>
183183
</ul>
184-
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Tutorial Materials</span>
185-
</p>
184+
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Materials</span></p>
186185
<ul class="nav bd-sidenav">
187186
<li class="toctree-l1 has-children"><a class="reference internal"
188-
href="interspeech2025/intro.html">Interspeech 2025</a><input class="toctree-checkbox"
187+
href="interspeech2025/intro.html">Interspeech 2025 tutorial</a><input class="toctree-checkbox"
189188
id="toctree-checkbox-1" name="toctree-checkbox-1" type="checkbox" /><label class="toctree-toggle"
190189
for="toctree-checkbox-1"><i class="fa-solid fa-chevron-down"></i></label>
191190
<ul>
@@ -224,6 +223,7 @@
224223

225224
</ul>
226225
</li>
226+
<li class="toctree-l1"><a class="reference internal" href="reading-list.html">Reading list</a></li>
227227
</ul>
228228

229229
</div>
@@ -647,7 +647,7 @@ <h2>Tutorial contents<a class="headerlink" href="#tutorial-contents"
647647
CCA<span id="id3"><sup><a class="reference internal" href="#id20"
648648
title="Ankita Pasad, Ju-Chieh Chou, and Karen Livescu. Layer-wise analysis of a self-supervised speech representation model. In 2021 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), volume, 914-921. 2021. doi:10.1109/ASRU51503.2021.9688093.">9</a></sup></span>,
649649
CKA<span id="id4"><sup><a class="reference internal" href="#id21"
650-
title="Simon Kornblith, Mohammad Norouzi, Honglak Lee, and Geoffrey Hinton. Similarity of neural network representations revisited. In Kamalika Chaudhuri and Ruslan Salakhutdinov, editors, Proceedings of the 36th International Conference on Machine Learning, volume 97 of Proceedings of Machine Learning Research, 3519–3529. PMLR, 09–15 Jun 2019. URL: https://proceedings.mlr.press/v97/kornblith19a.html.">10</a></sup></span>)
650+
title="Simon Kornblith, Mohammad Norouzi, Honglak Lee, and Geoffrey Hinton. Similarity of neural network representations revisited. In Kamalika Chaudhuri and Ruslan Salakhutdinov, editors, Proceedings of the 36th International Conference on Machine Learning, volume 97 of Proceedings of Machine Learning Research, 3519–3529. PMLR, 09–15 Jun 2019. URL: https://proceedings.mlr.press/v97/kornblith19a.html.">10</a></sup></span>
651651
</p>
652652
</li>
653653
<li>
@@ -686,7 +686,7 @@ <h2>Tutorial contents<a class="headerlink" href="#tutorial-contents"
686686
</p>
687687
</li>
688688
<li>
689-
<p>Feature attribution <span id="id10"><sup><a class="reference internal" href="#id30"
689+
<p>Feature attribution<span id="id10"><sup><a class="reference internal" href="#id30"
690690
title="Dennis Fucci, Beatrice Savoldi, Marco Gaido, Matteo Negri, Mauro Cettolo, and Luisa Bentivogli. Explainability for Speech Models: On the Challenges of Acoustic Feature Selection. In Felice Dell'Orletta, Alessandro Lenci, Simonetta Montemagni, and Rachele Sprugnoli, editors, Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024), 373–381. Pisa, Italy, December 2024. CEUR Workshop Proceedings.">22</a>,<a
691691
class="reference internal" href="#id31"
692692
title="Gaofei Shen, Hosein Mohebbi, Arianna Bisazza, Afra Alishahi, and Grzegorz Chrupała. On the reliability of feature attribution methods for speech classification. In Interspeech 2025. 2025. doi:10.48550/arXiv.2505.16406.">23</a></sup></span>:
@@ -1014,7 +1014,7 @@ <h2>References<a class="headerlink" href="#references" title="Link to this headi
10141014
<a class="right-next" href="interspeech2025/intro.html" title="next page">
10151015
<div class="prev-next-info">
10161016
<p class="prev-next-subtitle">next</p>
1017-
<p class="prev-next-title">Interspeech 2025</p>
1017+
<p class="prev-next-title">Interspeech 2025 tutorial</p>
10181018
</div>
10191019
<i class="fa-solid fa-angle-right"></i>
10201020
</a>

interspeech2025/feature-importance-scoring/context_mixing.html

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -180,9 +180,9 @@
180180
</a>
181181
</li>
182182
</ul>
183-
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Tutorial Materials</span></p>
183+
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Materials</span></p>
184184
<ul class="current nav bd-sidenav">
185-
<li class="toctree-l1 current active has-children"><a class="reference internal" href="../intro.html">Interspeech 2025</a><input checked="" class="toctree-checkbox" id="toctree-checkbox-1" name="toctree-checkbox-1" type="checkbox"/><label class="toctree-toggle" for="toctree-checkbox-1"><i class="fa-solid fa-chevron-down"></i></label><ul class="current">
185+
<li class="toctree-l1 current active has-children"><a class="reference internal" href="../intro.html">Interspeech 2025 tutorial</a><input checked="" class="toctree-checkbox" id="toctree-checkbox-1" name="toctree-checkbox-1" type="checkbox"/><label class="toctree-toggle" for="toctree-checkbox-1"><i class="fa-solid fa-chevron-down"></i></label><ul class="current">
186186
<li class="toctree-l2"><a class="reference internal" href="../representational-analyses/probing.html">Probing exercise: Does Wav2Vec2 encode vocal tract movements?</a></li>
187187

188188

@@ -209,6 +209,7 @@
209209

210210
</ul>
211211
</li>
212+
<li class="toctree-l1"><a class="reference internal" href="../../reading-list.html">Reading list</a></li>
212213
</ul>
213214

214215
</div>

interspeech2025/feature-importance-scoring/feature_attribution.html

Lines changed: 13 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -62,6 +62,7 @@
6262
<link rel="icon" href="../../_static/favicon.ico"/>
6363
<link rel="index" title="Index" href="../../genindex.html" />
6464
<link rel="search" title="Search" href="../../search.html" />
65+
<link rel="next" title="Reading list" href="../../reading-list.html" />
6566
<link rel="prev" title="Quantifying Context-Mixing in Speech Transformers" href="context_mixing.html" />
6667
<meta name="viewport" content="width=device-width, initial-scale=1"/>
6768
<meta name="docsearch:language" content="en"/>
@@ -177,9 +178,9 @@
177178
</a>
178179
</li>
179180
</ul>
180-
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Tutorial Materials</span></p>
181+
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Materials</span></p>
181182
<ul class="current nav bd-sidenav">
182-
<li class="toctree-l1 current active has-children"><a class="reference internal" href="../intro.html">Interspeech 2025</a><input checked="" class="toctree-checkbox" id="toctree-checkbox-1" name="toctree-checkbox-1" type="checkbox"/><label class="toctree-toggle" for="toctree-checkbox-1"><i class="fa-solid fa-chevron-down"></i></label><ul class="current">
183+
<li class="toctree-l1 current active has-children"><a class="reference internal" href="../intro.html">Interspeech 2025 tutorial</a><input checked="" class="toctree-checkbox" id="toctree-checkbox-1" name="toctree-checkbox-1" type="checkbox"/><label class="toctree-toggle" for="toctree-checkbox-1"><i class="fa-solid fa-chevron-down"></i></label><ul class="current">
183184
<li class="toctree-l2"><a class="reference internal" href="../representational-analyses/probing.html">Probing exercise: Does Wav2Vec2 encode vocal tract movements?</a></li>
184185

185186

@@ -206,6 +207,7 @@
206207

207208
</ul>
208209
</li>
210+
<li class="toctree-l1"><a class="reference internal" href="../../reading-list.html">Reading list</a></li>
209211
</ul>
210212

211213
</div>
@@ -970,6 +972,15 @@ <h1>Last words:<a class="headerlink" href="#last-words" title="Link to this head
970972
<p class="prev-next-title">Quantifying Context-Mixing in Speech Transformers</p>
971973
</div>
972974
</a>
975+
<a class="right-next"
976+
href="../../reading-list.html"
977+
title="next page">
978+
<div class="prev-next-info">
979+
<p class="prev-next-subtitle">next</p>
980+
<p class="prev-next-title">Reading list</p>
981+
</div>
982+
<i class="fa-solid fa-angle-right"></i>
983+
</a>
973984
</div>
974985
</footer>
975986

interspeech2025/intro.html

Lines changed: 7 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@
88
<meta charset="utf-8" />
99
<meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="generator" content="Docutils 0.18.1: http://docutils.sourceforge.net/" />
1010

11-
<title>Interspeech 2025 &#8212; Tutorial @ Interspeech 2025</title>
11+
<title>Interspeech 2025 tutorial &#8212; Tutorial @ Interspeech 2025</title>
1212

1313

1414

@@ -178,9 +178,9 @@
178178
</a>
179179
</li>
180180
</ul>
181-
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Tutorial Materials</span></p>
181+
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Materials</span></p>
182182
<ul class="current nav bd-sidenav">
183-
<li class="toctree-l1 current active has-children"><a class="current reference internal" href="#">Interspeech 2025</a><input checked="" class="toctree-checkbox" id="toctree-checkbox-1" name="toctree-checkbox-1" type="checkbox"/><label class="toctree-toggle" for="toctree-checkbox-1"><i class="fa-solid fa-chevron-down"></i></label><ul>
183+
<li class="toctree-l1 current active has-children"><a class="current reference internal" href="#">Interspeech 2025 tutorial</a><input checked="" class="toctree-checkbox" id="toctree-checkbox-1" name="toctree-checkbox-1" type="checkbox"/><label class="toctree-toggle" for="toctree-checkbox-1"><i class="fa-solid fa-chevron-down"></i></label><ul>
184184
<li class="toctree-l2"><a class="reference internal" href="representational-analyses/probing.html">Probing exercise: Does Wav2Vec2 encode vocal tract movements?</a></li>
185185

186186

@@ -207,6 +207,7 @@
207207

208208
</ul>
209209
</li>
210+
<li class="toctree-l1"><a class="reference internal" href="../reading-list.html">Reading list</a></li>
210211
</ul>
211212

212213
</div>
@@ -345,7 +346,7 @@
345346

346347

347348
<div id="jb-print-docs-body" class="onlyprint">
348-
<h1>Interspeech 2025</h1>
349+
<h1>Interspeech 2025 tutorial</h1>
349350
<!-- Table of contents -->
350351
<div id="print-main-content">
351352
<div id="jb-print-toc">
@@ -368,8 +369,8 @@ <h2> Contents </h2>
368369
<div id="searchbox"></div>
369370
<article class="bd-article">
370371

371-
<section class="tex2jax_ignore mathjax_ignore" id="interspeech-2025">
372-
<h1>Interspeech 2025<a class="headerlink" href="#interspeech-2025" title="Link to this heading">#</a></h1>
372+
<section class="tex2jax_ignore mathjax_ignore" id="interspeech-2025-tutorial">
373+
<h1>Interspeech 2025 tutorial<a class="headerlink" href="#interspeech-2025-tutorial" title="Link to this heading">#</a></h1>
373374
<p>We provide four notebooks, exemplifying the interpretability techniques we cover in the tutorial. The notebooks are designed to work on Google Colab, open them through the links below:</p>
374375
<section id="part-i-representation-understanding">
375376
<h2>Part I: Representation Understanding<a class="headerlink" href="#part-i-representation-understanding" title="Link to this heading">#</a></h2>

interspeech2025/representational-analyses/probing.html

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -63,7 +63,7 @@
6363
<link rel="index" title="Index" href="../../genindex.html" />
6464
<link rel="search" title="Search" href="../../search.html" />
6565
<link rel="next" title="Representation space comparisons: Locating acoustic and articulatory information in Wav2Vec2 with CKA" href="representation_space_comparisons.html" />
66-
<link rel="prev" title="Interspeech 2025" href="../intro.html" />
66+
<link rel="prev" title="Interspeech 2025 tutorial" href="../intro.html" />
6767
<meta name="viewport" content="width=device-width, initial-scale=1"/>
6868
<meta name="docsearch:language" content="en"/>
6969
</head>
@@ -178,9 +178,9 @@
178178
</a>
179179
</li>
180180
</ul>
181-
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Tutorial Materials</span></p>
181+
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Materials</span></p>
182182
<ul class="current nav bd-sidenav">
183-
<li class="toctree-l1 current active has-children"><a class="reference internal" href="../intro.html">Interspeech 2025</a><input checked="" class="toctree-checkbox" id="toctree-checkbox-1" name="toctree-checkbox-1" type="checkbox"/><label class="toctree-toggle" for="toctree-checkbox-1"><i class="fa-solid fa-chevron-down"></i></label><ul class="current">
183+
<li class="toctree-l1 current active has-children"><a class="reference internal" href="../intro.html">Interspeech 2025 tutorial</a><input checked="" class="toctree-checkbox" id="toctree-checkbox-1" name="toctree-checkbox-1" type="checkbox"/><label class="toctree-toggle" for="toctree-checkbox-1"><i class="fa-solid fa-chevron-down"></i></label><ul class="current">
184184
<li class="toctree-l2 current active"><a class="current reference internal" href="#">Probing exercise: Does Wav2Vec2 encode vocal tract movements?</a></li>
185185

186186

@@ -207,6 +207,7 @@
207207

208208
</ul>
209209
</li>
210+
<li class="toctree-l1"><a class="reference internal" href="../../reading-list.html">Reading list</a></li>
210211
</ul>
211212

212213
</div>
@@ -2926,7 +2927,7 @@ <h1>Outlook<a class="headerlink" href="#outlook" title="Link to this heading">#<
29262927
<i class="fa-solid fa-angle-left"></i>
29272928
<div class="prev-next-info">
29282929
<p class="prev-next-subtitle">previous</p>
2929-
<p class="prev-next-title">Interspeech 2025</p>
2930+
<p class="prev-next-title">Interspeech 2025 tutorial</p>
29302931
</div>
29312932
</a>
29322933
<a class="right-next"

interspeech2025/representational-analyses/representation_space_comparisons.html

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -178,9 +178,9 @@
178178
</a>
179179
</li>
180180
</ul>
181-
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Tutorial Materials</span></p>
181+
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Materials</span></p>
182182
<ul class="current nav bd-sidenav">
183-
<li class="toctree-l1 current active has-children"><a class="reference internal" href="../intro.html">Interspeech 2025</a><input checked="" class="toctree-checkbox" id="toctree-checkbox-1" name="toctree-checkbox-1" type="checkbox"/><label class="toctree-toggle" for="toctree-checkbox-1"><i class="fa-solid fa-chevron-down"></i></label><ul class="current">
183+
<li class="toctree-l1 current active has-children"><a class="reference internal" href="../intro.html">Interspeech 2025 tutorial</a><input checked="" class="toctree-checkbox" id="toctree-checkbox-1" name="toctree-checkbox-1" type="checkbox"/><label class="toctree-toggle" for="toctree-checkbox-1"><i class="fa-solid fa-chevron-down"></i></label><ul class="current">
184184
<li class="toctree-l2"><a class="reference internal" href="probing.html">Probing exercise: Does Wav2Vec2 encode vocal tract movements?</a></li>
185185

186186

@@ -207,6 +207,7 @@
207207

208208
</ul>
209209
</li>
210+
<li class="toctree-l1"><a class="reference internal" href="../../reading-list.html">Reading list</a></li>
210211
</ul>
211212

212213
</div>

0 commit comments

Comments
 (0)