Search

The proliferation of artificial intelligence (AI) has opened up new avenues for the modeling of power electronics with ultra-fast transient responses, such as wide-bandgap (WBG) devices. This paper highlights the significance of ultrafast transient device-level hardware emulation for the DC railway microgrid (DRM) in real-time. To this end, the proposed approach partitions the DRM power system by transmission line method (TLM) and employs gated recurrent unit (GRU) and electromagnetic transient (EMT) modeling techniques for system-level subsystems. Meanwhile, for WBG devices, gallium nitride (GaN) high electron mobility transistors (HEMT) and silicon carbide (SiC) insulated gate bipolar transistors (IGBT) are modeled using a novel physical feature neuron network (PFNN), which offers high flexibility with a variable time-step (as low as 1ns), thereby improving the accuracy, efficiency and accelerating the emulation on the field-programmable gate array (FPGA). The effectiveness of the proposed approach is confirmed by comparing the emulation results with offline simulation results obtained from PSCAD/EMTD for system-level and SaberRD for device-level transients. The proposed PFNN approach provides strong versatility, ultra-fast transient emulation capability, and significantly improved accuracy, which bodes well for the future of power electronics device-level emulation.

The proposed study will examine what type of messaging interventions are most effective in boosting men’s intentions to get vaccinated against HPV.

Maritime industries desire high speed and reliability, low lifespan cost, and environmental impact shipping for transportation. Compared to highly congested land shipments and high-cost air freight, all-electric ship (AES) can reduce the lifespan energy consumption and transport a considerable freight volume at a lower rate. Recently, the medium voltage DC (MVDC) topology, recommended by IEEE standard, pushes the AES to the next stage in considering space and weight constraints with the reduction of bulky transformers and simplified parallel connections. However, device-level modeling of this massive parallel MVDC-based ship-board microgrid (SBM) is challenging to both the state-of-the-art general-purpose compute unit and traditional electromagnetic transient (EMT) based emulation. With the rapid development of machine learning (ML) algorithm and its dedicated execution unit, accelerated parallel emulation becomes achievable in different levels of this paralleled connected SBM. Applying the ML-aided technique can help to improve the emulation execution efficiency and reduce the consumption of hardware resource on the field-programmable gate arrays (FPGAs). This work proposes a real-time hybrid ML-EMT based digital twin of the complete SBM at the subsystem-level and equipment-level with validated results from PSCAD/EMTDC, and device-level with validated results from SaberRD.

In the current project, we examine whether ChatGPT is a holistic or analytic thinker.

In this work, we have experimentally demonstrated the refractive index (RI) sensing characteristics of a S-shape taper refractometer (STR) based on modal interference theory. Our preliminary theoretical analysis reveals that there exists a critical cladding mode, which is essential for understanding the sensing characteristics. When the dominant cladding mode involved in a core-cladding interference is close to the critical cladding mode, the resulting RI sensitivity tends to reach a maximum value. Moreover, both the critical and the dominant cladding mode are dependent on ambient RI. Our sensor achieves a high RI sensitivity of 2109.7 nm/RIU for a transmission dip at around 1505 nm with a measurement range of 1.36 to 1.39.

Hyperspectral imaging has broad applications and impacts in areas including environmental science, weather, and geo/space exploration. The intrinsic spectral–spatial structures and potential multi-level features in different frequency bands make multilayer graph an intuitive model for hyperspectral images (HSI). To study the underlying characteristics of HSI and to take the advantage of graph signal processing (GSP) tools, this work proposes a multilayer graph spectral analysis for hyperspectral images based on multilayer graph signal processing (M-GSP). More specifically, we present multilayer graph (MLG) models and tensor representations for HSI. By exploring multilayer graph spectral space, we develop MLG-based methods for HSI applications, including unsupervised segmentation and supervised classification. Our experimental results demonstrate the strength of M-GSP in HSI processing and spectral–spatial information extraction.

A systematic comparison of fiber-based gas pressure sensors using different types of hollow-core photonic crystal fibers (PCFs) is conducted. The sensor was fabricated by splicing a segment of hollow-core silica capillary between a single mode fiber (SMF) and a hollow-core PCF. A Fabry-Perot (FP) cavity configuration is thus formed with the capillary tube as the sensing cavity, while the PCF acts as gas passage to the external environment. External pressure change would lead to the variation in the refractive index of air in the sensing cavity, resulting in a wavelength shift of the interference dips. The pressure sensitivity is measured to be around 4 nm/MPa, with a high linearity of 99.7% or above, regardless of the type of the PCFs we used as gas inlet. Among the four different PCFs, the large-mode-area (LMA) PCF shows the highest fringe contrast in the reflection spectrum. Modal analysis reveals that this is due to the high reflectivity caused by the solid core of LMA-PCF. Our experimental results also indicate that the length of the sensing cavity, as well as the offset fusion splice will influence the fringe contrast. The sensor has potential application in gas pressure sensing for advantages of high sensitivity, compact size and ease of fabrication.

High protein diet reduces food intake and improves glucose homeostasis in rodents and humans with obesity and diabetes, but the mechanistic site (s) of action remain unclear. Small intestinal lipid and glucose sensing regulates energy and glucose homeostasis, but the metabolic role of gut protein sensing remains elusive. In this study, we infused 8% casein hydrolysate as protein source into the upper small intestine (USI) and performed fasting-refeeding studies. We found that USI casein infusion (1.28 kcal/min) suppressed food intake up to 6h in chow but not high fat (HF) - fed rats (chow USI: sal 47±2 vs. cas 36±2 kcal, n=18, p In summary, these data illustrate that USI protein sensing increases glucose tolerance in chow and HF rats via CaSR, and lowers feeding in chow but not HF rats. Future studies are needed to dissect the metabolic role of CaSR not only for USI but also ileal protein sensing in energy balance and glucose homeostasis in obesity and diabetes. Disclosure R.J.W.Li: None. D.Barros: None. Y.Lim: None. S.Zhang: None. A.Gao: None. T.K.Lam: None.

Three-dimensional (3D) point clouds are important data representations in visualization applications. The rapidly growing utility and popularity of point cloud processing strongly motivate a plethora of research activities on large-scale point cloud processing and feature extraction. In this work, we investigate point cloud resampling based on hypergraph signal processing (HGSP). We develop a novel method to extract sharp object features and reduce the data size of point cloud representation. By directly estimating hypergraph spectrum based on hypergraph stationary processing, we design a spectral kernel-based filter to capture high-dimensional interactions among point signal nodes and to better preserve object surface outlines. Experimental results validate the effectiveness of hypergraph in representing point clouds, and demonstrate the robustness of the proposed algorithm under noise.

Transit Oriented Development (TOD) has become an urban planning and design policy and practice approach to deliver sustainable transport through the world. TOD as infrastructure contributes to urban liveability in determining way of life and well-being of the inhabitants of a city. Urban liveability can be understood as a perceived notion of well-being and social cohesion among residents of an urban area. TOD has been hypothesised to create gentrification. Does gentrification impact negatively on social cohesion in high density TOD-led cities? We address this question by deploying an exploratory difference in differences qualitative analysis of the relationships between measures of involuntary residential displacement and ‘built environment’ indicators. These are proxies for ‘gentrification’ and ‘social cohesion’ respectively. This investigation examines displacement indicators before and after the opening of three new MTR stations in 2014, using a control neighbourhood which has an existing station. It also analyses BE dimensions related to social cohesion such as ‘destinations’ and ‘public space provision’. The displacement indicators have variable trajectories when details are compared. There is limited evidence of systematic displacement, although there are other more prominent and dynamic changes in those destinations. The provision of new public space is associated with the most dynamic changes. From a placemaking point of view, further detailed study to better understand the role of development drivers of gentrification is required.

Efficient processing and feature extraction of large-scale point clouds are important in related computer vision and cyber-physical systems. This work investigates point cloud resampling based on hypergraph signal processing (HGSP) to better explore the underlying relationship among different points in the point cloud and to extract contour-enhanced features. Specifically, we design hypergraph spectral filters to capture multilateral interactions among the signal nodes of point clouds and to better preserve their surface outlines. Without the need and the computation to first construct the underlying hypergraph, our low complexity approach directly estimates hypergraph spectrum of point clouds by leveraging hypergraph stationary processes from the observed 3D coordinates. Evaluating the proposed resampling methods with several metrics, our test results validate the high efficacy of hypergraph characterization of point clouds and demonstrate the robustness of hypergraph-based resampling under noisy observations.

Unbiased SGG has achieved significant progress over recent years. However, almost all existing SGG models have overlooked the ground-truth annotation qualities of prevailing SGG datasets, i.e., they always assume: 1) all the manually annotated positive samples are equally correct; 2) all the un-annotated negative samples are absolutely background. In this paper, we argue that both assumptions are inapplicable to SGG: there are numerous "noisy" groundtruth predicate labels that break these two assumptions, and these noisy samples actually harm the training of unbiased SGG models. To this end, we propose a novel model-agnostic NoIsy label CorrEction strategy for SGG: NICE. NICE can not only detect noisy samples but also reassign more high-quality predicate labels to them. After the NICE training, we can obtain a cleaner version of SGG dataset for model training. Specifically, NICE consists of three components: negative Noisy Sample Detection (Neg-NSD), positive NSD (Pos-NSD), and Noisy Sample Correction (NSC). Firstly, in Neg-NSD, we formulate this task as an out-of-distribution detection problem, and assign pseudo labels to all detected noisy negative samples. Then, in Pos-NSD, we use a clustering-based algorithm to divide all positive samples into multiple sets, and treat the samples in the noisiest set as noisy positive samples. Lastly, in NSC, we use a simple but effective weighted KNN to reassign new predicate labels to noisy positive samples. Extensive results on different backbones and tasks have attested to the effectiveness and generalization abilities of each component of NICE., Comment: Accepted by CVPR 2022

Outdoor radio map estimation is an important tool for network planning and resource management in modern Internet of Things (IoT) and cellular systems. Radio map describes spatial signal strength distribution and provides network coverage information. A practical goal is to estimate fine-resolution radio maps from sparse radio strength measurements. However, non-uniformly positioned measurements and access obstacles can make it difficult for accurate radio map estimation (RME) and spectrum planning in many outdoor environments. In this work, we develop a two-phase learning framework for radio map estimation by integrating radio propagation model and designing a conditional generative adversarial network (cGAN). We first explore global information to extract the radio propagation patterns. We then focus on the local features to estimate the effect of shadowing on radio maps in order to train and optimize the cGAN. Our experimental results demonstrate the efficacy of the proposed framework for radio map estimation based on generative models from sparse observations in outdoor scenarios.

Hypergraph spectral analysis has emerged as an effective tool processing complex data structures in data analysis. The surface of a three-dimensional (3D) point cloud, and the multilateral relationship among their points can be naturally captured by the high-dimensional hyperedges. This work investigates the power of hypergraph spectral analysis in unsupervised segmentation of 3D point clouds. We estimate, and order the hypergraph spectrum from observed point cloud coordinates. By trimming the redundancy from the estimated hypergraph spectral space based on spectral component strengths, we develop a clustering-based segmentation method. We apply the proposed method to various point clouds, and analyze their respective spectral properties. Our experimental results demonstrate the effectiveness and efficiency of the proposed segmentation method.

YouTube, a world-famous video sharing website, maintains a list of the top trending videos on the platform. Due to its huge amount of users, it enables researchers to understand people's preference by analyzing the trending videos. Trending videos vary from country to country. By analyzing such differences and changes, we can tell how users' preferences differ over locations. Previous work focuses on analyzing such culture preferences from videos' metadata, while the culture information hidden within the visual content has not been discovered. In this study, we explore culture preferences among countries using the thumbnails of YouTube trending videos. We first process the thumbnail images of the videos using object detectors. The collected object information is then used for various statistical analysis. In particular, we examine the data from three perspectives: geographical locations, video genres and users' reactions. Experimental results indicate that the users from similar cultures shares interests in watching similar videos on YouTube. Our study demonstrates that discovering the culture preference through the thumbnails can be an effective mechanism for video social media analysis.

We address the problem of retrieving a specific moment from an untrimmed video by natural language. It is a challenging problem because a target moment may take place in the context of other temporal moments in the untrimmed video. Existing methods cannot tackle this challenge well since they do not fully consider the temporal contexts between temporal moments. In this paper, we model the temporal context between video moments by a set of predefined two-dimensional maps under different temporal scales. For each map, one dimension indicates the starting time of a moment and the other indicates the duration. These 2D temporal maps can cover diverse video moments with different lengths, while representing their adjacent contexts at different temporal scales. Based on the 2D temporal maps, we propose a Multi-Scale Temporal Adjacency Network (MS-2D-TAN), a single-shot framework for moment localization. It is capable of encoding the adjacent temporal contexts at each scale, while learning discriminative features for matching video moments with referring expressions. We evaluate the proposed MS-2D-TAN on three challenging benchmarks, i.e., Charades-STA, ActivityNet Captions, and TACoS, where our MS-2D-TAN outperforms the state of the art.

Few-shot video classification aims to learn new video categories with only a few labeled examples, alleviating the burden of costly annotation in real-world applications. However, it is particularly challenging to learn a class-invariant spatial-temporal representation in such a setting. To address this, we propose a novel matching-based few-shot learning strategy for video sequences in this work. Our main idea is to introduce an implicit temporal alignment for a video pair, capable of estimating the similarity between them in an accurate and robust manner. Moreover, we design an effective context encoding module to incorporate spatial and feature channel context, resulting in better modeling of intra-class variations. To train our model, we develop a multi-task loss for learning video matching, leading to video features with better generalization. Extensive experimental results on two challenging benchmarks, show that our method outperforms the prior arts with a sizable margin on Something-Something-V2 and competitive results on Kinetics.

Transferring the sentiment of an image is an unexplored research topic in the area of computer vision. This work proposes a novel framework consisting of a reference image retrieval step and a global sentiment transfer step to transfer sentiments of images according to a given sentiment tag. The proposed image retrieval algorithm is based on the SSIM index. The retrieved reference images by the proposed algorithm are more content-related against the algorithm based on the perceptual loss. Therefore can lead to a better image sentiment transfer result. In addition, we propose a global sentiment transfer step, which employs an optimization algorithm to iteratively transfer sentiment of images based on feature maps produced by the Densenet121 architecture. The proposed sentiment transfer algorithm can transfer the sentiment of images while ensuring the content structure of the input image intact. The qualitative and quantitative experiments demonstrate that the proposed sentiment transfer framework outperforms existing artistic and photorealistic style transfer algorithms in making reliable sentiment transfer results with rich and exact details.

Scene graph generation is an important visual understanding task with a broad range of vision applications. Despite recent tremendous progress, it remains challenging due to the intrinsic long-tailed class distribution and large intra-class variation. To address these issues, we introduce a novel confidence-aware bipartite graph neural network with adaptive message propagation mechanism for unbiased scene graph generation. In addition, we propose an efficient bi-level data resampling strategy to alleviate the imbalanced data distribution problem in training our graph network. Our approach achieves superior or competitive performance over previous methods on several challenging datasets, including Visual Genome, Open Images V4/V6, demonstrating its effectiveness and generality., Comment: Accepted by CVPR2021

This article is mainly aimed at defining and verifying whether the project involves environmentally sensitive areas in the process of environmental intelligent survey, calculating the position coordinate information of the target GPS position in the aerial image map under the condition of Gaussian projection, and further calculating the four corners of the image and the position of other target points under the WGS84 coordinate system. First of all, based on the POS data information of aerial equipment, this paper calculates the corresponding Gaussian projection and POS data information, then the pseudo-position information of image center coordinates is further calculated; Second, Based on the coordinates information of gauss projection, this paper calculates the heading open angle and side open angle of the camera, then calculate the width and height of the image for pose correction, and finally get the coordinate position of the corrected image center point. Finally, the GPS positions of other target points can be calculated by pixel coordinates of images, and the calculated results are pasted on Google earth for precision comparison. Experimental results show that the proposed method can accurately calculate the GPS positions of targets in aerial images.

Incremental learning of semantic segmentation has emerged as a promising strategy for visual scene interpretation in the open- world setting. However, it remains challenging to acquire novel classes in an online fashion for the segmentation task, mainly due to its continuously-evolving semantic label space, partial pixelwise ground-truth annotations, and constrained data availability. To ad- dress this, we propose an incremental learning strategy that can fast adapt deep segmentation models without catastrophic forgetting, using a streaming input data with pixel annotations on the novel classes only. To this end, we develop a uni ed learning strategy based on the Expectation-Maximization (EM) framework, which integrates an iterative relabeling strategy that lls in the missing labels and a rehearsal-based incremental learning step that balances the stability-plasticity of the model. Moreover, our EM algorithm adopts an adaptive sampling method to select informative train- ing data and a class-balancing training strategy in the incremental model updates, both improving the e cacy of model learning. We validate our approach on the PASCAL VOC 2012 and ADE20K datasets, and the results demonstrate its superior performance over the existing incremental methods., Comment: Accepted by ACM MM'21

The transmeridian flight required pilots to perform tasks that are high in mental workload for long periods. Consequently, they are likely to experience fatigue and have difficulty in concentrating, which could lead to flight safety risks since pilots’ emergency response ability would be weakened. This study proposes a system to help pilots maintain attention on tasks over time to reduce air accidents. The neuroimaging method functional near-infrared spectroscopy (fNIRS) would be used to assess the attention level and mental workload in this system. Based on the results, appropriate feedback, such as a reminder to re-engage the pilot if disengagement detected, would be provided. For testing the effectiveness of this system on sustained attention, an experiment was designed to examine whether using this system could reduce pilots’ missed instructions when communicating with ground control.

Along with increasingly popular virtual reality applications, the three-dimensional (3D) point cloud has become a fundamental data structure to characterize 3D objects and surroundings. To process 3D point clouds efficiently, a suitable model for the underlying structure and outlier noises is always critical. In this work, we propose a hypergraph-based new point cloud model that is amenable to efficient analysis and processing. We introduce tensor-based methods to estimate hypergraph spectrum components and frequency coefficients of point clouds in both ideal and noisy settings. We establish an analytical connection between hypergraph frequencies and structural features. We further evaluate the efficacy of hypergraph spectrum estimation in two common applications of sampling and denoising of point clouds for which we provide specific hypergraph filter design and spectral properties. Experimental results demonstrate the strength of hypergraph signal processing as a tool in characterizing the underlying properties of 3D point clouds.

Short-form video social media shifts away from the traditional media paradigm by telling the audience a dynamic story to attract their attention. In particular, different combinations of everyday objects can be employed to represent a unique scene that is both interesting and understandable. Offered by the same company, TikTok and Douyin are popular examples of such new media that has become popular in recent years, while being tailored for different markets (e.g. the United States and China). The hypothesis that they express cultural differences together with media fashion and social idiosyncrasy is the primary target of our research. To that end, we first employ the Faster Regional Convolutional Neural Network (Faster R-CNN) pre-trained with the Microsoft Common Objects in COntext (MS-COCO) dataset to perform object detection. Based on a suite of objects detected from videos, we perform statistical analysis including label statistics, label similarity, and label-person distribution. We further use the Two-Stream Inflated 3D ConvNet (I3D) pre-trained with the Kinetics dataset to categorize and analyze human actions. By comparing the distributional results of TikTok and Douyin, we uncover a wealth of similarity and contrast between the two closely related video social media platforms along the content dimensions of object quantity, object categories, and human action categories., Accepted by IEEE Big Data 2020

Attention-based models have made tremendous progress on end-to-end automatic speech recognition(ASR) recently. However, the conventional transformer-based approaches usually generate the sequence results token by token from left to right, leaving the right-to-left contexts unexploited. In this work, we introduce a bidirectional speech transformer to utilize the different directional contexts simultaneously. Specifically, the outputs of our proposed transformer include a left-to-right target, and a right-to-left target. In inference stage, we use the introduced bidirectional beam search method, which can not only generate left-to-right candidates but also generate right-to-left candidates, and determine the best hypothesis by the score. To demonstrate our proposed speech transformer with a bidirectional decoder(STBD), we conduct extensive experiments on the AISHELL-1 dataset. The results of experiments show that STBD achieves a 3.6\% relative CER reduction(CERR) over the unidirectional speech transformer baseline. Besides, the strongest model in this paper called STBD-Big can achieve 6.64\% CER on the test set, without language model rescoring and any extra data augmentation strategies., Comment: Accepted by InterSpeech 2020

Even video telephony services have been pervasively applied, it is still a challenge to provide satisfactory quality of experience to users. Multipath transmission is a promising solution ...

Learning and processing of signals over hypergraph models have gained substantial traction owing to the ability of hypergraphs in characterizing multilateral interactions. In this work, we explore hypergraph spectral analysis and provide alternative definitions of frequency domain operations that are practically useful in image processing. We analyze hypergraph spectral properties and present several application examples, including compression, edge detection and segmentation. Successful experiment results demonstrate the effectiveness and the future prospect of the proposed hypergraph frequency operations in image processing.