Skip to content

Commit 85d1045

Browse files
Allakhverdov EduardAllakhverdov Eduard
authored andcommitted
intermediate results
1 parent 5ca8ec6 commit 85d1045

1 file changed

Lines changed: 15 additions & 27 deletions

File tree

project/index.html

Lines changed: 15 additions & 27 deletions
Original file line numberDiff line numberDiff line change
@@ -52,21 +52,23 @@
5252
<div class="container is-max-desktop">
5353
<div class="columns is-centered">
5454
<div class="column has-text-centered">
55-
<h1 class="title is-1 publication-title">Academic Project Page</h1>
55+
<h1 class="title is-1 publication-title">Image Reconstruction as a Tool for Feature Analysis</h1>
5656
<div class="is-size-5 publication-authors">
5757
<!-- Paper authors -->
5858
<span class="author-block">
59-
<a href="FIRST AUTHOR PERSONAL LINK" target="_blank">First Author</a><sup>*</sup>,</span>
59+
<a href="mailto:allakhverdov@2a2i.org" target="_blank">Eduard Allakhverdov</a>,</span>
6060
<span class="author-block">
61-
<a href="SECOND AUTHOR PERSONAL LINK" target="_blank">Second Author</a><sup>*</sup>,</span>
61+
<a href="mailto:d.tarasov@airi.net" target="_blank">Dmitrii Tarasov</a>,</span>
6262
<span class="author-block">
63-
<a href="THIRD AUTHOR PERSONAL LINK" target="_blank">Third Author</a>
64-
</span>
63+
<a href="mailto:goncharova@airi.net" target="_blank">Elizaveta Goncharova</a>,</span>
64+
<span class="author-block">
65+
<a href="mailto:goncharova@airi.net" target="_blank">Andrey Kuznetsov</a>
66+
</span>
6567
</div>
6668

6769
<div class="is-size-5 publication-authors">
68-
<span class="author-block">Institution Name<br>Conferance name and year</span>
69-
<span class="eql-cntrb"><small><br><sup>*</sup>Indicates Equal Contribution</small></span>
70+
<span class="author-block">AIRI<br>Moscow, Russia</span>
71+
<span class="author-block">MIPT<br>Dolgoprudny, Russia</span>
7072
</div>
7173

7274
<div class="column has-text-centered">
@@ -148,7 +150,7 @@ <h2 class="subtitle has-text-centered">
148150
<h2 class="title is-3">Abstract</h2>
149151
<div class="content has-text-justified">
150152
<p>
151-
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Proin ullamcorper tellus sed ante aliquam tempus. Etiam porttitor urna feugiat nibh elementum, et tempor dolor mattis. Donec accumsan enim augue, a vulputate nisi sodales sit amet. Proin bibendum ex eget mauris cursus euismod nec et nibh. Maecenas ac gravida ante, nec cursus dui. Vivamus purus nibh, placerat ac purus eget, sagittis vestibulum metus. Sed vestibulum bibendum lectus gravida commodo. Pellentesque auctor leo vitae sagittis suscipit.
153+
Vision encoders are increasingly used in modern applications, from vision-only models to multimodal systems such as vision-language models. Despite their remarkable success, it remains unclear how these architectures represent features internally. Here, we propose a novel approach for interpreting vision features via image reconstruction. We compare two related model families, SigLIP and SigLIP2, which differ only in their training objective, and show that encoders pre-trained on image-based tasks retain significantly more image information than those trained on non-image tasks such as contrastive learning. We further apply our method to a range of vision encoders, ranking them by the informativeness of their feature representations. Finally, we demonstrate that manipulating the feature space yields predictable changes in reconstructed images, revealing that orthogonal rotations — rather than spatial transformations — control color encoding. Our approach can be applied to any vision encoder, shedding light on the inner structure of its feature space. We also append the code of our experiments to reproduce them successfully: <a href="https://github.com/FusionBrainLab/feature_analysis">https://github.com/FusionBrainLab/feature_analysis</a>.
152154
</p>
153155
</div>
154156
</div>
@@ -165,35 +167,21 @@ <h2 class="title is-3">Abstract</h2>
165167
<div id="results-carousel" class="carousel results-carousel">
166168
<div class="item">
167169
<!-- Your image here -->
168-
<img src="static/images/carousel1.jpg" alt="MY ALT TEXT"/>
170+
<img src="static/images/v1_vs_v2.png" alt="Comparison of SigLIP and SigLIP2 reconstructions"/>
169171
<h2 class="subtitle has-text-centered">
170-
First image description.
172+
Comparison of image reconstructions from SigLIP and SigLIP2 feature spaces.
171173
</h2>
172174
</div>
173175
<div class="item">
174176
<!-- Your image here -->
175-
<img src="static/images/carousel2.jpg" alt="MY ALT TEXT"/>
177+
<img src="static/images/rb_swap.png" alt="Red-Blue channel swap visualization"/>
176178
<h2 class="subtitle has-text-centered">
177-
Second image description.
179+
Visualization of feature space manipulation through red-blue channel swap.
178180
</h2>
179181
</div>
180-
<div class="item">
181-
<!-- Your image here -->
182-
<img src="static/images/carousel3.jpg" alt="MY ALT TEXT"/>
183-
<h2 class="subtitle has-text-centered">
184-
Third image description.
185-
</h2>
186-
</div>
187-
<div class="item">
188-
<!-- Your image here -->
189-
<img src="static/images/carousel4.jpg" alt="MY ALT TEXT"/>
190-
<h2 class="subtitle has-text-centered">
191-
Fourth image description.
192-
</h2>
193182
</div>
194183
</div>
195184
</div>
196-
</div>
197185
</section>
198186
<!-- End image carousel -->
199187

@@ -291,7 +279,7 @@ <h2 class="title">BibTeX</h2>
291279
<div class="content">
292280

293281
<p>
294-
This page was built using the <a href="https://github.com/eliahuhorwitz/Academic-project-page-template" target="_blank">Academic Project Page Template</a> which was adopted from the <a href="https://nerfies.github.io" target="_blank">Nerfies</a> project page.
282+
This page was built using the <a href="https://github.com/eliahuhorwitz/Academic-project-page-template" target="_blank">Academic Project Page Template</a> which was adopted from the <a href="https://nerfies.github.io" target="_blank">Nerfies</a> project page.
295283
You are free to borrow the source code of this website, we just ask that you link back to this page in the footer. <br> This website is licensed under a <a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/" target="_blank">Creative
296284
Commons Attribution-ShareAlike 4.0 International License</a>.
297285
</p>

0 commit comments

Comments
 (0)