@@ -71,18 +71,20 @@ <h1 class="title is-1 publication-title">Image Reconstruction as a Tool for Feat
7171 </ div >
7272 < div class ="is-size-5 publication-authors ">
7373 < span class ="author-block ">
74- AIRI, Moscow, Russia< br >
75- MIPT, Dolgoprudny, Russia
74+ < a > < strong > Eduard Allakhverdov</ strong > </ a > < sup > §†</ sup > ,
7675 </ span >
7776 < span class ="author-block ">
78- AIRI, Moscow, Russia
77+ < a > < strong > Dmitrii Tarasov </ strong > </ a > < sup > § </ sup > ,
7978 </ span >
8079 < span class ="author-block ">
81- AIRI, Moscow, Russia
80+ < a > < strong > Elizaveta Goncharova </ strong > </ a > < sup > § </ sup > ,
8281 </ span >
8382 < span class ="author-block ">
84- AIRI, Moscow, Russia
83+ < a > < strong > Andrey Kuznetsov </ strong > </ a > < sup > § </ sup > ,
8584 </ span >
85+ < ul >
86+ < sup > §</ sup > AIRI, < sup > †</ sup > MIPT
87+ </ ul >
8688 </ div >
8789
8890 < div class ="column has-text-centered ">
@@ -150,41 +152,56 @@ <h2 class="title is-3">Abstract</h2>
150152 <!-- Базовые результаты: siglip vs siglip2 -->
151153 <!-- Нужно четко подчеркнуть какие различия между модельками -->
152154 <!-- И как это влияет на реконструкцию -->
153- <!-- -->
155+
156+ < div class ="columns is-centered has-text-centered ">
157+ < div class ="column is-four-fifths ">
158+ < h2 class ="title is-3 " style ="white-space: nowrap; "> Interpretability metric</ h2 >
159+ < div class ="content has-text-justified ">
160+ < div style ="text-align: center; ">
161+ < img src ="./static/images/features_reconstruction.drawio.png " alt ="Data Mixture " width ="900 ">
162+ < p class ="caption " style ="width: 100%; text-align: center; ">
163+ < b > Figure 1. Image reconstructor training.</ b > For pretrained model we train a reconstructor model that restores the image from the feature space.
164+ </ p >
165+ < img src ="./static/images/reconstruction_results.png " alt ="Data Mixture " width ="900 ">
166+ < p class ="caption " style ="width: 100%; text-align: center; ">
167+ < b > Figure 2. Reconstruction results.</ b > We show the results of the reconstruction for SigLip and SigLip2 for different image resultions.
168+ </ p >
169+ </ div >
170+ </ div >
171+ < br > < br >
172+ </ div >
173+ </ div >
154174
155175 <!-- (2) Feature-space transformations -->
156176 <!-- Текстовое объяснение -->
157177 <!-- Визуализация фреймворка: обобщил оператор в пр-ве картинок и в пр-ве фичей -->
158- <!-- Сделать видос с визуализацией фреймворка -->
159178 <!-- Примеры работы с RGB -->
160179 <!-- Примеры работы с отключением одного канала (ожелтением) -->
180+ <!-- Примеры Спектра такой м-цы, показать, что только небольшое кол-во каналов меняется -->
161181 <!-- -->
162182
163-
164- <!-- Image carousel -->
165- < section class ="hero is-small ">
166- < div class ="hero-body ">
167- < div class ="container ">
168- < div id ="results-carousel " class ="carousel results-carousel ">
169- < div class ="item ">
170- <!-- Your image here -->
171- < img src ="static/images/v1_vs_v2.png " alt ="Comparison of SigLIP and SigLIP2 reconstructions " />
172- < h2 class ="subtitle has-text-centered ">
173- Comparison of image reconstructions from SigLIP and SigLIP2 feature spaces.
174- </ h2 >
183+ < div class ="columns is-centered has-text-centered ">
184+ < div class ="column is-four-fifths ">
185+ < h2 class ="title is-3 " style ="white-space: nowrap; "> Feature-space transformations</ h2 >
186+ < div class ="content has-text-justified ">
187+ < div style ="text-align: center; ">
188+ < img src ="./static/images/features_reconstruction_manipulation.drawio.png " alt ="Data Mixture " width ="900 ">
189+ < p class ="caption " style ="width: 100%; text-align: center; ">
190+ < b > Figure 3. Feature-space transformations.</ b > We then calculate Q matrix for feature-space manupulation.
191+ </ p >
192+ < img src ="./static/images/rb_swap.png " alt ="Data Mixture " width ="900 ">
193+ < p class ="caption " style ="width: 100%; text-align: center; ">
194+ < b > Figure 4. Red-blue channel swap samples.</ b > We then calculate Q matrix for feature-space manupulation.
195+ </ p >
196+ < img src ="./static/images/rb_swap_eigenvalues.png " alt ="Data Mixture " width ="900 ">
197+ < p class ="caption " style ="width: 100%; text-align: center; ">
198+ < b > Figure 5. Eigenvalues for red-blue channel swap matrix.</ b > Majority of eigenvalues are close to 1, which means that the transformation is close to an identity matrix. While the other cluster of eigenvalues are close to -1, which means that for these channels direction is changed to the opposite.
199+ </ p >
175200 </ div >
176- < div class ="item ">
177- <!-- Your image here -->
178- < img src ="static/images/rb_swap.png " alt ="Red-Blue channel swap visualization " />
179- < h2 class ="subtitle has-text-centered ">
180- Visualization of feature space manipulation through red-blue channel swap.
181- </ h2 >
182201 </ div >
202+ < br > < br >
183203 </ div >
184204 </ div >
185- </ div >
186- </ section >
187- <!-- End image carousel -->
188205
189206
190207
0 commit comments