Search

Learning-based methods for underwater image enhancement (UWIE) have undergone extensive exploration. However, learning-based models are usually vulnerable to adversarial examples so as the UWIE models. To the best of our knowledge, there is no comprehensive study on the adversarial robustness of UWIE models, which indicates that UWIE models are potentially under the threat of adversarial attacks. In this paper, we propose a general adversarial attack protocol. We make a first attempt to conduct adversarial attacks on five well-designed UWIE models on three common underwater image benchmark datasets. Considering the scattering and absorption of light in the underwater environment, there exists a strong correlation between color correction and underwater image enhancement. On the basis of that, we also design two effective UWIE-oriented adversarial attack methods Pixel Attack and Color Shift Attack targeting different color spaces. The results show that five models exhibit varying degrees of vulnerability to adversarial attacks and well-designed small perturbations on degraded images are capable of preventing UWIE models from generating enhanced results. Further, we conduct adversarial training on these models and successfully mitigated the effectiveness of adversarial attacks. In summary, we reveal the adversarial vulnerability of UWIE models and propose a new evaluation dimension of UWIE models.

Punctuation and word casing prediction are necessary for automatic speech recognition (ASR). With the popularity of on-device end-to-end streaming ASR systems, the on-device punctuation and word casing prediction become a necessity while we found little discussion on this. With the emergence of Transformer, Transformer based models have been explored for this scenario. However, Transformer based models are too large for on-device ASR systems. In this paper, we propose a light-weight and efficient model that jointly predicts punctuation and word casing in real time. The model is based on Convolutional Neural Network (CNN) and Bidirectional Long Short-Term Memory (BiLSTM). Experimental results on the IWSLT2011 test set show that the proposed model obtains 9% relative improvement compared to the best of non-Transformer models on overall F1-score. Compared to the representative of Transformer based models, the proposed model achieves comparable results to the representative model while being only one-fortieth its size and 2.5 times faster in terms of inference time. It is suitable for on-device streaming ASR systems. Our code is publicly available.

Reconfigurable intelligent surfaces (RISs) have flexible and exceptional performance in manipulating electromagnetic waves and customizing wireless channels. These capabilities enable them to provide a plethora of valuable activity-related information for promoting wireless human sensing. In this article, we present a comprehensive review of passive human sensing using radio frequency signals with the assistance of RISs. Specifically, we first introduce fundamental principles and physical platform of RISs. Subsequently, based on the specific applications, we categorize the state-of-the-art human sensing techniques into three types, including human imaging,localization, and activity recognition. Meanwhile, we would also investigate the benefits that RISs bring to these applications. Furthermore, we explore the application of RISs in human micro-motion sensing, and propose a vital signs monitoring system enhanced by RISs. Experimental results are presented to demonstrate the promising potential of RISs in sensing vital signs for manipulating individuals. Finally, we discuss the technical challenges and opportunities in this field.

We demonstrate that the influence of Kerr effect on valley-Hall topological transport in graphene metasurfaces can be used to implement an all-optical switch. In particular, by taking advantage of the large Kerr coefficient of graphene, the index of refraction of a topologically-protected graphene metasurface can be tuned via a pump beam, which results in an optically controllable frequency shift of the photonic bands of the metasurface. This spectral variation can in turn be readily employed to control and switch the propagation of an optical signal in certain waveguide modes of the graphene metasurface. Importantly, our theoretical and computational analysis reveals that the threshold pump power needed to optically switch ON/OFF the signal is strongly dependent on the group velocity of the pump mode, especially when the device is operated in the slow-light regime. This study could open up new routes towards active photonic nanodevices whose underlying functionality stems from their topological characteristics., Comment: 7 pages, 6 figures

Metasurfaces are subwavelength structured thin films consisting of arrays of units that allow the controls of polarization, phase and amplitude of light over a subwavelength thickness. The recent developments in topological photonics have greatly broadened the horizon in designing the metasurfaces for novel functional applications. In this review, we summarize recent progress in the research field of topological metasurfaces, firstly from the perspectives of passive and active in the classical regime, and then in the quantum regime. More specifically, we begin by examining the passive topological phenomena in two-dimensional photonic systems, including both time-reversal broken systems and time-reversal preserved systems. Subsequently, we move to discuss the cutting-edge studies of the active topological metasurfaces, including nonlinear topological metasurfaces and reconfigurable topological metasurfaces. After overviewing the topological metasurfaces in the classical regime, we show how the topological metasurfaces could provide a new platform for quantum information and quantum many-body physics. Finally, we conclude and describe some challenges and future directions of this fast-evolving field.

Topological photonic edge states are conventionally formed at the interface between two domains of topologically trivial and nontrivial photonic crystals. Recent works exploiting photonic quantum Hall and quantum valley Hall effects have shown that large-area topological waveguide states could be created in a three-layer topological heterostructure that consists of a finite-width domain featuring Dirac cone sandwiched between two domains of photonic crystals with opposite topological properties. In this work, we show that a new kind of large-area topological waveguide states could be created employing the photonic analogs of quantum spin Hall effect. Taking the well-used Wu-Hu model in topological photonics as an example, we show that sandwiching a finite-width domain of photonic crystals featuring double Dirac cone between two domains of expanded and shrunken unit cells could lead to the emergence of large-area topological helical waveguide states distributed uniformly in the middle domain. Importantly, we unveil a power-law scaling regarding to the size of the bandgap within which the large-area helical states reside as a function of the width of the middle domain, which implies that these large-area modes in principle could exist in the middle domain with arbitrary width. Moreover, pseudospin-momentum locking unidirectional propagations and robustness of these large-area waveguide modes against sharp bends are explicitly demonstrated. Our work enlarges the photonic systems and platforms that could be utilized for large-area-mode enabled topologically waveguiding., Comment: close to published version

We derive the $\mathcal{T}$-matrix formalism tailored for the numerical analysis of second-harmonic (SH) generation from arbitrarily-shaped particles made of centrosymmetric optical materials. First, the transfer matrix of a single particle is computed \textit{via} the extended boundary condition method, in which the electromagnetic fields both at fundamental frequency and SH are expanded in vector spherical wave functions and the integral formulation is satisfied away from the surface of the scatterer. We allow for the accurate physical description of the SH sources by taking into account both local surface and nonlocal bulk polarization contributions to the nonlinear polarization density source responsible for the generation of the SH signal in a particle. This single-particle formalism is then extended to arbitrary distributions of particles by incorporating into the formalism linear and nonlinear electromagnetic wave scattering from the particles in the cluster. Importantly from a practical point of view, our method can be applied to particles of arbitrary shape made of optical materials characterized by general frequency-dispersion relations, so that it can describe the linear and nonlinear optical response of clusters of metallic, semiconductor, or polaritonic particles, as well as mixtures of such particles. The approach proposed here is faster and more memory-efficient than well-established numerical techniques, especially in the analysis of spheroidal particles, due to the favourable symmetries of spherical wave basis functions used in the wave scattering analysis., Comment: 19 pages, 12 figures

The segmentation module which precisely outlines the nodules is a crucial step in a computer-aided diagnosis(CAD) system. The most challenging part of such a module is how to achieve high accuracy of the segmentation, especially for the juxtapleural, non-solid and small nodules. In this research, we present a coarse-to-fine methodology that greatly improves the thresholding method performance with a novel self-adapting correction algorithm and effectively removes noisy pixels with well-defined knowledge-based principles. Compared with recent strong morphological baselines, our algorithm, by combining dataset features, achieves state-of-the-art performance on both the public LIDC-IDRI dataset (DSC 0.699) and our private LC015 dataset (DSC 0.760) which closely approaches the SOTA deep learning-based models' performances. Furthermore, unlike most available morphological methods that can only segment the isolated and well-circumscribed nodules accurately, the precision of our method is totally independent of the nodule type or diameter, proving its applicability and generality.

The mortality of lung cancer has ranked high among cancers for many years. Early detection of lung cancer is critical for disease prevention, cure, and mortality rate reduction. However, existing detection methods on pulmonary nodules introduce an excessive number of false positive proposals in order to achieve high sensitivity, which is not practical in clinical situations. In this paper, we propose the multi-head detection and spatial squeeze-and-attention network, MHSnet, to detect pulmonary nodules, in order to aid doctors in the early diagnosis of lung cancers. Specifically, we first introduce multi-head detectors and skip connections to customize for the variety of nodules in sizes, shapes and types and capture multi-scale features. Then, we implement a spatial attention module to enable the network to focus on different regions differently inspired by how experienced clinicians screen CT images, which results in fewer false positive proposals. Lastly, we present a lightweight but effective false positive reduction module with the Linear Regression model to cut down the number of false positive proposals, without any constraints on the front network. Extensive experimental results compared with the state-of-the-art models have shown the superiority of the MHSnet in terms of the average FROC, sensitivity and especially false discovery rate (2.98% and 2.18% improvement in terms of average FROC and sensitivity, 5.62% and 28.33% decrease in terms of false discovery rate and average candidates per scan). The false positive reduction module significantly decreases the average number of candidates generated per scan by 68.11% and the false discovery rate by 13.48%, which is promising to reduce distracted proposals for the downstream tasks based on the detection results., Comment: We have to revise the experiment results and conclusions

Noble metal nanoparticles have been utilized for a vast amount of optical applications. For the applications that used metal nanoparticles as nanosensors and optical labeling, larger radiation damping is preferred (higher optical signal). To get a deeper knowledge about the radiation damping of noble metal nanoparticles, we used gold nanorods with different geometry factors (aspect ratios) as the model system to study. We investigated theoretically how the radiation damping of a nanorod depends on the material, and shape of the particle. Surprisingly, a simple analytical equation describes radiation damping very accurately and allow to disentangle the maximal radiation damping parameter for gold nanorod with resonance energy E_res around 1.81 eV (685 nm). We found very good agreement with theoretical predictions and experimental data obtained by single-particle spectroscopy. Our results and approaches may pave the way for designing and optimizing gold nanostructure with higher optical signal and better sensing performance.

In this article, we present a $T$-matrix method for numerical computation of second-harmonic generation from clusters of arbitrarily distributed spherical particles made of centrosymmetric optical materials. The electromagnetic fields at the fundamental and second-harmonic (SH) frequencies are expanded in series of vector spherical wave functions, and the single sphere $T$-matrix entries are computed by imposing field boundary conditions at the surface of the particles. Different from previous approaches, we compute the SH fields by taking into account both local surface and nonlocal bulk polarization sources, which allows one to accurately describe the generation of SH in arbitrary clusters of spherical particles. Our numerical method can be used to efficiently analyze clusters of spherical particles made of various optical materials, including metallic, dielectric, semiconductor, and polaritonic materials., Comment: 14 pages, 11 figures

Topological photonics has revolutionized our understanding of light propagation, but most of current studies are focused on designing a static photonic structure. Developing a dynamic photonic topological platform to switch multiple topological functionalities at ultrafast speed is still a great challenge. Here we demonstrate an ultrafast reprogrammable plasmonic topological insulator, where the topological propagation route can be dynamically steered at nanosecond-level switching time, namely more than 10^7 times faster than the current state-of-the-art. This orders-of-magnitude improvement is achieved by using ultrafast electronic switches in an innovative way to implement the programmability. Due to the flexible programmability, many existing photonic topological functionalities can be integrated into this agile topological platform. Our work brings the current studies of photonic topological insulators to a digital and intelligent era, which could boost the development of intelligent and ultrafast photoelectric devices with built-in topological protection.

A novel polarized reflectarray is designed, fabricated, and experimentally characterized to show its flexibility and efficiency to control wave generation and focusing of orbital angular momentum (OAM) vortices with desirable OAM modes in the microwave frequency regime. In order to rigorously study the generation and focusing of OAM, a versatile analytical theory is proposed to theoretically study the compensation phase of reflectarray. Two prototypes of microwave reflectarrays are fabricated and experimentally characterized at 12 GHz, one for generation and one for focusing of OAM-carrying beams. Compared with the OAM-generating reflectarray, the reflectarray for focusing OAM vortex can significantly reduce the beam diameter, and this can further improve the transmission efficiency of the OAM vortex beams. We also show that the numerical and experimental results agree very well. The proposed design method and reflectarrays may spur the development of new efficient approaches to generate and focus OAM vortex waves for applications to microwave wireless communications., Comment: 10 pages, 10 figures

We propose and analyze a nonunitary variant of the continuous time Grover search algorithm based on frequent Zeno-type measurements. We show that the algorithm scales similarly to the pure quantum version by deriving tight analytical lower bounds on its efficiency for arbitrary database sizes and measurement parameters. We also study the behavior of the algorithm subject to noise, and find that under certain oracle and operational errors our measurement-based algorithm outperforms the standard algorithm, showing robustness against these noises. Our analysis is based on deriving a non-hermitian effective description of the algorithm, which yields a deeper insight into components responsible for the quantum and the classical operation of the protocol.

Nonlinear topological photonics, which explores topics common to the fields of topological phases and nonlinear optics, is expected to open up a new paradigm in topological photonics. Here, we demonstrate second-harmonic generation (SHG) via nonlinear interaction of double topological valley-Hall kink modes in all-dielectric photonic crystals (PhCs). We first show that two topological frequency bandgaps can be created around a pair of frequencies, $\omega_0$ and $2\omega_0$, by gapping out the corresponding Dirac points in two-dimensional honeycomb PhCs. Valley-Hall kink modes along a kink-type domain wall interface between two PhCs placed together in a mirror-symmetric manner are generated within the two frequency bandgaps. Importantly, through full-wave simulations and mode dispersion analysis, we demonstrate that tunable, bi-directional phase-matched SHG via nonlinear interaction of the valley-Hall kink modes inside the two bandgaps can be achieved. In particular, by using Stokes parameters associated to the magnetic part of the valley-Hall kink modes, we introduce a new concept, SHG directional dichroism, which is employed to characterize optical probes for sensing chiral molecules. Our work opens up new avenues towards topologically protected nonlinear frequency mixing and active photonic devices implemented in all-dielectric material platforms., Comment: 6 pages, 5 figures

Topologically protected plasmonic modes located inside topological bandgaps are attracting increasing attention, chiefly due to their robustness against disorder-induced backscattering. Here, we introduce a bilayer graphene metasurface that possesses plasmonic topological valley interface modes when the mirror symmetry of the metasurface is broken by horizontally shifting the lattice of holes of the top layer of the two freestanding graphene layers in opposite directions. In this configuration, light propagation along the domain-wall interface of the bilayer graphene metasurface shows unidirectional features. Moreover, we have designed a molecular sensor based on the topological properties of this metasurface using the fact that the Fermi energy of graphene varies upon chemical doping. This effect induces strong variation of the transmission of the topological guided modes, which can be employed as the underlying working principle of gas sensing devices. Our work opens up new ways of developing robust integrated plasmonic devices for molecular sensing., Comment: 4 pages, 5 figures

We demonstrate a novel scheme to dramatically enhance both the second- and third-harmonic generation in a graphene-insulator-graphene metasurface. The key underlying feature of our approach is the existence of a double-resonance phenomenon, namely the metasurface is designed to possess fundamental plasmon resonances at both the fundamental frequency and the higher harmonic. In particular, this dual resonant field enhancement at the two optical frequencies, combined with a favorable spatial overlap of the optical near-fields, lead to the increase of the generated higher harmonic by several orders of magnitude. Remarkably, we demonstrate that by tuning the Fermi energy of the graphene gratings the dual-resonance property can be locked-in over a broad spectral range of ~20 THz, and equally important, the enhanced nonlinear frequency generation process can be readily switched in the same device between the second and third harmonic. This new type of graphene metasurface could open up new avenues towards the development of novel ultra-compact and multi-frequency active photonic nanodevices., Comment: 6 pages, 5 figures

We study topologically-protected four-wave mixing (FWM) interactions in a plasmonic metasurface consisting of a periodic array of nanoholes in a graphene sheet, which exhibits a wide topological bandgap at terahertz frequencies upon the breaking of time-reversal symmetry by a static magnetic field. We demonstrate that due to the significant nonlinearity enhancement and large lifetime of graphene plasmons in specific configurations, a net gain of FWM interaction of plasmonic edge states within the topological bandgap can be achieved with pump power of less than 10 nW. In particular, we find that the effective waveguide nonlinearity coefficient is about 1.1x10^13 1/(Wm), i.e., more than ten orders of magnitude larger than that of commonly used, highly nonlinear silicon photonic nanowires. These findings could pave a new way for developing ultra-low-power-consumption, highly-integrated and robust active photonic systems at deep-subwavelength scale for applications in quantum communications and information processing., Comment: 20 pages, 6 figures

Topological photonics aims to utilize topological photonic bands and corresponding edge modes to implement robust light manipulation, which can be readily achieved in the linear regime of light-matter interaction. Importantly, unlike solid state physics, the common test bed for new ideas in topological physics, topological photonics provide an ideal platform to study wave mixing and other nonlinear interactions. These are well-known topics in classical nonlinear optics but largely unexplored in the context of topological photonics. Here, we investigate nonlinear interactions of one-way edge-modes in frequency mixing processes in topological photonic crystals. We present a detailed analysis of the band topology of two-dimensional photonic crystals with hexagonal symmetry and demonstrate that nonlinear optical processes, such as second- and third-harmonic generation can be conveniently implemented via one-way edge modes of this setup. Moreover, we demonstrate that more exotic phenomena, such as slow-light enhancement of nonlinear interactions and harmonic generation upon interaction of backward-propagating (left-handed) edge modes can also be realized. Our work opens up new avenues towards topology-protected frequency mixing processes in photonics., Comment: 16 pages, 11 figures

We demonstrate that the effective third-order nonlinear susceptibility of a graphene sheet can be enhanced by more than two orders of magnitude by patterning it into a graphene metasurface. In addition, in order to gain deeper physical insights into this phenomenon, we introduce a novel homogenization method, which is subsequently used to characterize quantitatively this nonlinearity enhancement effect by calculating the effective linear and nonlinear susceptibility of graphene metasurfaces. The accuracy of the proposed homogenization method is demonstrated by comparing its predictions with those obtained from the Kramers-Kronig relations. This work may open up new opportunities to explore novel physics pertaining to nonlinear optical interactions in graphene metasurfaces., Comment: 5 pages, 5 figures