Skip to content

Commit 2c22fe1

Browse files
author
Dmitrii Tarasov
committed
add more text
1 parent c95160c commit 2c22fe1

3 files changed

Lines changed: 59 additions & 38 deletions

File tree

project/index.html

Lines changed: 59 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -171,7 +171,7 @@ <h4>📊 Model Family Comparison</h4>
171171
<div class="box">
172172
<div class="content">
173173
<h4>🎨 Feature Space Control</h4>
174-
<p>We demonstrate that orthogonal rotations in feature space control color encoding, enabling predictable image manipulations and revealing the structured nature of the feature representations.</p>
174+
<p>We demonstrate that linear transformations in feature space control color encoding of reconstructed images on <strong>three different tasks</strong>: colorization, red-blue channel swap, and blue channel suppression.</p>
175175
</div>
176176
</div>
177177
</div>
@@ -258,51 +258,94 @@ <h3 class="title is-4">Q Matrix: A Tool for Feature Manipulation</h3>
258258
<div class="content mt-6">
259259
<h3 class="title is-4">Color Manipulation Studies</h3>
260260
<p class="has-text-justified">
261-
Through our Q matrix framework, we demonstrate precise control over color attributes in the feature space. Our experiments reveal that color information is encoded through orthogonal rotations rather than spatial transformations.
261+
Using simple linear transformations in feature space, we demonstrate precise control over color attributes of reconstructed image. Our color manipulation studies serve as a validation of the feature interpretation hypothesis, supported by an image reconstruction approach.
262262
</p>
263-
263+
264+
<!-- Colorization -->
265+
<h4 class="title is-5 mt-4">Image Colorization</h4>
266+
267+
<p class="has-text-justified">
268+
Colorization task - transforming grayscale images to their color counterparts. This problem requires following properties:</p>
269+
270+
<p>1. <strong>Semantic Requirement</strong>: Successful colorization necessitates that the feature space geometry encodes real-world knowledge about plausible color distributions for objects and scenes.</p>
271+
272+
<p>2. <strong>Non-algorithmic Nature</strong>: Colorization cannot be achieved through simple pixel-wise transformations but requires understanding of image semantics.
273+
</p>
274+
275+
<div class="has-text-centered">
276+
<img src="./static/images/colorized_examples.png" width="80%" alt="colorization_all_transformations" class="is-rounded">
277+
<p class="caption has-text-centered mb-6">
278+
<b>Figure 5.</b> Our method enables controlled colorization through feature space manipulation, demonstrating the structured nature of color encoding.
279+
</p>
280+
</div>
281+
264282
<!-- Color Swap -->
265283
<h4 class="title is-5 mt-4">Red-Blue Channel Swap</h4>
284+
<p class="has-text-justified">
285+
286+
<p>Properties we would expect from Red-Blue Channel Swap operator:</p>
287+
<ul>
288+
<li><strong>Orthogonal</strong> — the operator should be orthogonal, meaning it should preserve the norm of the vector.</li>
289+
<li><strong>Self-inverse</strong> — double application of Red Blue color swapping is Identity transformation in image space.</li>
290+
</ul>
291+
<p><strong>Eigenvalues of the operator</strong> will be close to +1 and -1.</p>
292+
<p>As we will see further all this properties are somehow preserved even for Linear operator with no strict constraints on this properties.</p>
293+
<p></p>
294+
295+
<p>We trained three different operators:</p>
296+
<ol>
297+
<li><strong>Orthogonal self-conjugated</strong> — as a Procrustes solution with a long-range projection of the operator onto the space of self-conjugated operators.</li>
298+
<li><strong>Orthogonal</strong> — as a Procrustes solution.</li>
299+
<li><strong>Linear</strong> — as a regression problem. <em>(Note that this solution cannot be directly used with the reconstructor, as it fails to preserve vector norms. Since the reconstructor was trained exclusively on normalized vectors, we first normalize the resulting outputs before feeding them to the reconstructor.)</em></li>
300+
</ol>
301+
302+
<p>As shown in <strong>Figure 7</strong>, the eigenvalues of all operators cluster along the real axis, indicating they primarily represent either eigenvector preservation (near +1) or inversion (near -1). While small deviations from these ideal values exist — revealing noise in the feature space — these perturbations remain relatively weak. Consequently, the feature space geometry largely preserves the properties expected from the pixel-space channel permutation operator.</p>
303+
304+
</p>
266305
<div class="columns is-centered">
267306
<div class="column is-half">
268-
<img src="./static/images/rb_swap.png" alt="rb_swap" class="is-rounded">
307+
<img src="./static/images/color_swap_all_transformations.png" alt="rb_swap" class="is-rounded">
269308
<p class="caption has-text-centered mb-6">
270-
<b>Figure 5.</b> Red-blue channel swap demonstrates precise control over color channels in feature space.
309+
<b>Figure 6.</b> Red-blue channel swap demonstrates precise control over color channels in feature space.
271310
</p>
272311
</div>
273312
<div class="column is-half">
274313
<img src="./static/images/color_swap_all_eigen_values.png" alt="color_swap_all_eigen_values" class="is-rounded">
275314
<p class="caption has-text-centered mb-6">
276-
<b>Figure 6.</b> Eigenvalue analysis reveals that color transformations affect only specific feature dimensions while preserving others.
315+
<b>Figure 7.</b> Eigenvalue analysis reveals that color transformations affect only specific feature dimensions while preserving others.
277316
</p>
278317
</div>
279318
</div>
280319

281320
<!-- Blue Suppression -->
282321
<h4 class="title is-5 mt-4">Blue Channel Suppression</h4>
322+
<p class="has-text-justified">
323+
324+
<p><strong>Blue Channel Suppression operator</strong> will gradually suppress the blue channel of the image multiplying blue channel by some factor less than 1.</p>
325+
326+
<p>Properties we would expect from <strong>Blue Channel Suppression operator</strong>:</p>
327+
<ul>
328+
<li>Asymptotically this operator approaches a projection operator</li>
329+
</ul>
330+
</p>
331+
<p><strong>Eigenvalues of the operator</strong> are either 1 or complex values with magnitude strictly less than 1.</p>
332+
<p>We emperically observe this properties.</p>
333+
283334
<div class="columns is-centered">
284335
<div class="column is-half">
285336
<img src="./static/images/b_suppression_all_transformations.png" alt="b_suppression_all_transformations" class="is-rounded">
286337
<p class="caption has-text-centered mb-6">
287-
<b>Figure 7.</b> Selective suppression of the blue channel demonstrates fine-grained control over color attributes.
338+
<b>Figure 8.</b> Selective suppression of the blue channel demonstrates fine-grained control over color attributes.
288339
</p>
289340
</div>
290341
<div class="column is-half">
291342
<img src="./static/images/b_suppression_all_eigen_values.png" alt="b_suppression_all_eigen_values" class="is-rounded">
292343
<p class="caption has-text-centered mb-6">
293-
<b>Figure 8.</b> Eigenvalue distribution for blue suppression shows targeted modification of specific feature dimensions.
344+
<b>Figure 9.</b> Eigenvalue distribution for blue suppression shows targeted modification of specific feature dimensions.
294345
</p>
295346
</div>
296347
</div>
297348

298-
<!-- Colorization -->
299-
<h4 class="title is-5 mt-4">Image Colorization</h4>
300-
<div class="has-text-centered">
301-
<img src="./static/images/colorized_examples.png" alt="colorization_all_transformations" class="is-rounded">
302-
<p class="caption has-text-centered mb-6">
303-
<b>Figure 9.</b> Our method enables controlled colorization through feature space manipulation, demonstrating the structured nature of color encoding.
304-
</p>
305-
</div>
306349
</div>
307350
</div>
308351
</div>

project/static/css/index.css

Lines changed: 0 additions & 22 deletions
Original file line numberDiff line numberDiff line change
@@ -232,25 +232,3 @@ body {
232232
cursor: pointer;
233233
}
234234

235-
/* Vertical line between figures */
236-
.has-vertical-divider .column.is-half:first-child {
237-
position: relative;
238-
padding-right: 2rem;
239-
}
240-
241-
.has-vertical-divider .column.is-half:first-child::after {
242-
content: '';
243-
position: absolute;
244-
right: 0;
245-
top: 10%;
246-
height: 80%;
247-
width: 2px;
248-
background-color: #dbdbdb;
249-
}
250-
251-
.has-vertical-divider .column.is-half:last-child {
252-
padding-left: 2rem;
253-
}
254-
255-
256-
1.82 MB
Loading

0 commit comments

Comments
 (0)