Search

In real-world scenarios we often need to perform multiple tasks simultaneously. Multi-Task Learning (MTL) is an adequate method to do so, but usually requires datasets labeled for all tasks. We propose a method that can leverage datasets labeled for only some of the tasks in the MTL framework. Our work, Knowledge Assembly (KA), learns multiple tasks from disjoint datasets by leveraging the unlabeled data in a semi-supervised manner, using model augmentation for pseudo-supervision. Whilst KA can be implemented on any existing MTL networks, we test our method on jointly learning person re-identification (reID) and pedestrian attribute recognition (PAR). We surpass the single task fully-supervised performance by $4.2\%$ points for reID and $0.9\%$ points for PAR., Comment: Accepted at CVPRW'23

Significance: Multiple eye diseases such as age-related macular degeneration, diabetic retinopathy, and retinitis pigmentosa can cause photoreceptor dysfunction. Rod photoreceptors are known to be more vulnerable than cone photoreceptors. Therefore, functional assessment of rod photoreceptors is important for early detection of eye diseases. Aim: This study is to demonstrate the feasibility of using intrinsic optical signal (IOS) optoretinography (ORG) for objective detection of dark adaptation (DA) abnormality due to rod photoreceptor degeneration. Approach: Functional optical coherence tomography (OCT) was employed for IOS ORG of wild-type (WT) and retinal degeneration 10 (rd10) mice. Six WT C57BL/6J and eight rd10 B6.CXB1-Pde6brd10/J mice at postnatal day 14 (P14) were used for this study. Dynamic OCT analysis of retinal thickness and brightness changes, corresponding to light to dark transition, was implemented Results: Comparative measurement of the retina under light and dark conditions revealed significant IOS changes within the outer retina. The thickness between external limiting membrane (ELM) and retinal pigment epithelium (RPE) reduced, and the OCT brightness of inner segment ellipsoid zone (EZ) decreased during DA, compared to light adaptation (LA). Relative EZ intensity change was observed to decrease larger in rd10, compared to WT. The relative intensity of the hyporeflective band between ELM and RPE also showed significant decrease in rd10 retinas during DA. Conclusions: DA-IOS abnormalities were observed in rd10, compared to WT at P14. The ORG measurement of DA-IOS kinetics promises valuable information for noninvasive assessment of photoreceptor function.

Improving multi-view aggregation is integral for multi-view pedestrian detection, which aims to obtain a bird's-eye-view pedestrian occupancy map from images captured through a set of calibrated cameras. Inspired by the success of attention modules for deep neural networks, we first propose a Homography Attention Module (HAM) which is shown to boost the performance of existing end-to-end multiview detection approaches by utilizing a novel channel gate and spatial gate. Additionally, we propose Booster-SHOT, an end-to-end convolutional approach to multiview pedestrian detection incorporating our proposed HAM as well as elements from previous approaches such as view-coherent augmentation or stacked homography transformations. Booster-SHOT achieves 92.9% and 94.2% for MODA on Wildtrack and MultiviewX respectively, outperforming the state-of-the-art by 1.4% on Wildtrack and 0.5% on MultiviewX, achieving state-of-the-art performance overall for standard evaluation metrics used in multi-view pedestrian detection., Comment: Arxiv preprint

Deep learning models are increasingly deployed in real-world applications. These models are often deployed on the server-side and receive user data in an information-rich representation to solve a specific task, such as image classification. Since images can contain sensitive information, which users might not be willing to share, privacy protection becomes increasingly important. Adversarial Representation Learning (ARL) is a common approach to train an encoder that runs on the client-side and obfuscates an image. It is assumed, that the obfuscated image can safely be transmitted and used for the task on the server without privacy concerns. However, in this work, we find that training a reconstruction attacker can successfully recover the original image of existing ARL methods. To this end, we introduce a novel ARL method enhanced through low-pass filtering, limiting the available information amount to be encoded in the frequency domain. Our experimental results reveal that our approach withstands reconstruction attacks while outperforming previous state-of-the-art methods regarding the privacy-utility trade-off. We further conduct a user study to qualitatively assess our defense of the reconstruction attack., Comment: The IJCAI-ECAI-22 Workshop on Artificial Intelligence Safety (AISafety 2022)

Niobium is commonly used for superconducting quantum systems as readout resonators, capacitors, and interconnects. The coherence time of the superconducting qubits is mainly limited by microwave dissipation attributed to two-level system defects at interfaces, such as the Nb/Si and Nb/air interface. One way to improve the Nb/air interface quality is by thermal annealing, as shown by extensive studies in 3D superconducting radio frequency (SRF) cavities. However, it is unclear how the microstructure and chemistry of the interface structures change during heat treatment. To address this knowledge gap, we comprehensively characterized Nb films deposited on Si wafers by physical vapor deposition, including (1) an Nb film from a transmon and (2) an Nb film without any patterning step, using an aberration-corrected transmission electron microscope. Both Nb films exhibit columnar growth with strong [110] textures. There is a double layer between the Nb film and Si substrate, which are amorphous niobium silicides with different Nb and Si concentrations. After in-situ heating of the heterostructure at 360{\deg}C inside the microscope, the composition of the double layers at the Nb-Si interface remains almost the same despite different thickness changes. The initial amorphous niobium oxide layer on Nb surface decomposes into face-centered cubic Nb nanograins in the amorphous Nb-O matrix upon heating.

Intrinsic optical signal (IOS) imaging of the retina, also termed as optoretinography (ORG), promises a noninvasive method for objective assessment of retinal function. By providing unparalleled capability to differentiate individual layers of the retina, functional optical coherence tomography (OCT) has been actively investigated for intrinsic signal ORG measurements. However, clinical deployment of functional OCT for quantitative ORG is still challenging due to the lack of a standardized imaging protocol and the complication of IOS sources and mechanisms. This article aims to summarize recent developments of functional OCT for ORG measurement, OCT intensity- and phase-based IOS processing. Technical challenges and perspectives of quantitative IOS analysis and ORG interpretations are discussed.

Delayed dark adaptation due to impaired rod photoreceptor homeostasis has been reported as the earliest symptom of eye diseases such as age-related macular degeneration, diabetic retinopathy, and retinitis pigmentosa. Objective measurement of dark adaptation can facilitate early diagnosis to enable prompt intervention to prevent vision losses. However, there is a lack of noninvasive methods capable of spatiotemporal monitoring of photoreceptor changes during dark adaptation. Here we demonstrate functional optical coherence tomography (OCT) for in vivo intrinsic signal optoretinography (ORG) of dark adaptation kinetics in the C57BL/6J mouse retina. Functional OCT revealed a shortening of the outer retina, a morphological change in the cone and rod photoreceptor interdigitation zone, and a reduction in intrinsic signal amplitude at the photoreceptor inner segment ellipsoid. A strong positive correlation between morphophysiological activities was also confirmed. Functional OCT of dark adaptation kinetics promises a method for rapid ORG assessment of physiological integrity of retinal photoreceptors., Comment: 18 pages, 7 figures

This study is to characterize reflectance profiles of retinal blood vessels in optical coherence tomography (OCT), and to validate these vascular features to guide artery-vein classification in OCT angiography (OCTA) of human retina. Depth-resolved OCT reveals unique features of retinal arteries and veins. Retinal arteries show hyper-reflective boundaries at both upper (inner side towards the vitreous) and lower (outer side towards the choroid) walls. In contrary, retinal veins reveal hyper-reflectivity at the upper boundary only. Uniform lumen intensity was observed in both small and large arteries. However, the vein lumen intensity was dependent on the vessel size. Small veins exhibit a hyper-reflective zone at the bottom half of the lumen, while large veins show a hypo-reflective zone at the bottom half of the lumen, Comment: 11 pages, 4 figures