Search

In this paper we present a new machine learning workflow with unsupervised learning techniques to identify domains within atomic force microscopy images obtained from polymer films. The goal of the workflow is to identify the spatial location of the two types of polymer domains with little to no manual intervention and calculate the domain size distributions which in turn can help qualify the phase separated state of the material as macrophase or microphase ordered or disordered domains. We briefly review existing approaches used in other fields, computer vision and signal processing that can be applicable for the above tasks that happen frequently in the field of polymer science and engineering. We then test these approaches from computer vision and signal processing on the AFM image dataset to identify the strengths and limitations of each of these approaches for our first task. For our first domain segmentation task, we found that the workflow using discrete Fourier transform or discrete cosine transform with variance statistics as the feature works the best. The popular ResNet50 deep learning approach from computer vision field exhibited relatively poorer performance in the domain segmentation task for our AFM images as compared to the DFT and DCT based workflows. For the second task, for each of 144 input AFM images, we then used an existing porespy python package to calculate the domain size distribution from the output of that image from DFT based workflow. The information and open source codes we share in this paper can serve as a guide for researchers in the polymer and soft materials fields who need ML modeling and workflows for automated analyses of AFM images from polymer samples that may have crystalline or amorphous domains, sharp or rough interfaces between domains, or micro or macrophase separated domains., Comment: 39 pages, 13 figures, 4 tables

We introduces Crimson, a system that enhances the strategic reasoning capabilities of Large Language Models (LLMs) within the realm of cybersecurity. By correlating CVEs with MITRE ATT&CK techniques, Crimson advances threat anticipation and strategic defense efforts. Our approach includes defining and evaluating cybersecurity strategic tasks, alongside implementing a comprehensive human-in-the-loop data-synthetic workflow to develop the CVE-to-ATT&CK Mapping (CVEM) dataset. We further enhance LLMs' reasoning abilities through a novel Retrieval-Aware Training (RAT) process and its refined iteration, RAT-R. Our findings demonstrate that an LLM fine-tuned with our techniques, possessing 7 billion parameters, approaches the performance level of GPT-4, showing markedly lower rates of hallucination and errors, and surpassing other models in strategic reasoning tasks. Moreover, domain-specific fine-tuning of embedding models significantly improves performance within cybersecurity contexts, underscoring the efficacy of our methodology. By leveraging Crimson to convert raw vulnerability data into structured and actionable insights, we bolster proactive cybersecurity defenses., Comment: 9 pages, 7 figures

Quantum machine learning, which involves running machine learning algorithms on quantum devices, has garnered significant attention in both academic and business circles. In this paper, we offer a comprehensive and unbiased review of the various concepts that have emerged in the field of quantum machine learning. This includes techniques used in Noisy Intermediate-Scale Quantum (NISQ) technologies and approaches for algorithms compatible with fault-tolerant quantum computing hardware. Our review covers fundamental concepts, algorithms, and the statistical learning theory pertinent to quantum machine learning., Comment: 28 pages. Invited review

Magnetic refrigeration (MR) based on the magnetocaloric effect (MCE) is a promising alternative to conventional vapor compression refrigeration techniques. The cooling efficiency of a magnetic refrigerator depends on its refrigeration capacity and operation frequency. Existing refrigerators possess limited cooling efficiency due to the low operating frequency (around tens of Hz). Theory predicts that reducing geometrical effects can increase the operation frequency by reducing the relaxation time of a magnetic material. As compared to other shapes, magnetocaloric wires transfer heat most effectively to a surrounding environment, due to their enhanced surface area. The wire shape also yields a good mechanical response, reducing the relaxation time and consequently increasing the operation frequency of the cooling device. Experiments have validated the theoretical predictions. By assembling microwires with different magnetocaloric properties and Curie temperatures into a laminate structure, a table-like magnetocaloric bed can be created and used as an active cooling device for micro-electro-mechanical system (MEMS) and nano-electro-mechanical system (NEMS). This paper assesses recent progress in the development of magnetocaloric microwires and sheds light on the important factors affecting the magnetocaloric behavior and cooling efficiency in microwire systems. Challenges, opportunities, and strategies regarding the development of advanced magnetocaloric microwires are also discussed.

In Conversational Recommendation Systems (CRS), the central question is how the conversational agent can naturally ask for user preferences and provide suitable recommendations. Existing works mainly follow the hierarchical architecture, where a higher policy decides whether to invoke the conversation module (to ask questions) or the recommendation module (to make recommendations). This architecture prevents these two components from fully interacting with each other. In contrast, this paper proposes a novel architecture, the long short-term feedback architecture, to connect these two essential components in CRS. Specifically, the recommendation predicts the long-term recommendation target based on the conversational context and the user history. Driven by the targeted recommendation, the conversational model predicts the next topic or attribute to verify if the user preference matches the target. The balance feedback loop continues until the short-term planner output matches the long-term planner output, that is when the system should make the recommendation., Comment: 14 pages, 3 figures. Accepted by ICONIP 2023

Quantum information processing in the presence of continuous symmetry is of wide importance and exhibits many novel physical and mathematical phenomena. SU(d) is a continuous symmetry group of particular interest since it represents a fundamental type of non-Abelian symmetry and also plays a vital role in quantum computation. Here, we explicate the applications of SU(d)-symmetric random unitaries in three different contexts ranging from physics to quantum computing: information scrambling with non-Abelian conserved quantities, covariant quantum error correcting random codes, and geometric quantum machine learning. First, we show that, in the presence of SU(d) symmetry, the local conserved quantities would exhibit residual values even at $t \rightarrow \infty$ which decays as $\Omega(1/n^{3/2})$ under local Pauli basis for qubits and $\Omega(1/n^{(d+2)^2/2})$ under local symmetric basis for general qudits with respect to the system size, in contrast to $O(1/n)$ decay for U(1) case and the exponential decay for no-symmetry case in the sense of out-of-time ordered correlator (OTOC). Second, we show that SU(d)-symmetric unitaries can be used to construct asymptotically optimal (in the sense of saturating the fundamental limits on the code error that have been called the approximate Eastin-Knill theorems) SU(d)-covariant codes that encodes any constant $k$ logical qudits, extending [Kong \& Liu; PRXQ 3, 020314 (2022)]. Finally, we derive an overpartameterization threshold via the quantum neural tangent kernel (QNTK) required for exponential convergence guarantee of generic ansatz for geometric quantum machine learning, which reveals that the number of parameters required scales only with the dimension of desired subspaces rather than that of the entire Hilbert space. We expect that our work invites further research on quantum information with continuous symmetries., Comment: 10+38 pages

Quantum interference between identical single particles reveals the intrinsic quantum statistic nature of particles, which could not be interpreted through classical physics. Here, we demonstrate quantum interference between non-identical bosons using a generalized beam splitter based on a quantum memory. The Hong-Ou-Mandel type interference between single photons and single magnons with high visibility is demonstrated, and the crossover from the bosonic to fermionic quantum statistics is observed by tuning the beam splitter to be non-Hermitian. Moreover, multi-particle interference that simulates the behavior of three fermions by three input photons is realized. Our work extends the understanding of the quantum interference effects and demonstrates a versatile experimental platform for studying and engineering quantum statistics of particles., Comment: 6 pages, 4 figures

Quantum devices should operate in adherence to quantum physics principles. Quantum random access memory (QRAM), a fundamental component of many essential quantum algorithms for tasks such as linear algebra, data search, and machine learning, is often proposed to offer $\mathcal{O}(\log N)$ circuit depth for $\mathcal{O}(N)$ data size, given $N$ qubits. However, this claim appears to breach the principle of relativity when dealing with a large number of qubits in quantum materials interacting locally. In our study we critically explore the intrinsic bounds of rapid quantum memories based on causality, employing the relativistic quantum field theory and Lieb-Robinson bounds in quantum many-body systems. In this paper, we consider a hardware-efficient QRAM design in hybrid quantum acoustic systems. Assuming clock cycle times of approximately $10^{-3}$ seconds and a lattice spacing of about 1 micrometer, we show that QRAM can accommodate up to $\mathcal{O}(10^7)$ logical qubits in 1 dimension, $\mathcal{O}(10^{15})$ to $\mathcal{O}(10^{20})$ in various 2D architectures, and $\mathcal{O}(10^{24})$ in 3 dimensions. We contend that this causality bound broadly applies to other quantum hardware systems. Our findings highlight the impact of fundamental quantum physics constraints on the long-term performance of quantum computing applications in data science and suggest potential quantum memory designs for performance enhancement., Comment: 8+24=32 pages, many figures

Heterogeneous Information Networks (HINs) are information networks with multiple types of nodes and edges. The concept of meta-path, i.e., a sequence of entity types and relation types connecting two entities, is proposed to provide the meta-level explainable semantics for various HIN tasks. Traditionally, meta-paths are primarily used for schema-simple HINs, e.g., bibliographic networks with only a few entity types, where meta-paths are often enumerated with domain knowledge. However, the adoption of meta-paths for schema-complex HINs, such as knowledge bases (KBs) with hundreds of entity and relation types, has been limited due to the computational complexity associated with meta-path enumeration. Additionally, effectively assessing meta-paths requires enumerating relevant path instances, which adds further complexity to the meta-path learning process. To address these challenges, we propose SchemaWalk, an inductive meta-path learning framework for schema-complex HINs. We represent meta-paths with schema-level representations to support the learning of the scores of meta-paths for varying relations, mitigating the need of exhaustive path instance enumeration for each relation. Further, we design a reinforcement-learning based path-finding agent, which directly navigates the network schema (i.e., schema graph) to learn policies for establishing meta-paths with high coverage and confidence for multiple relations. Extensive experiments on real data sets demonstrate the effectiveness of our proposed paradigm.

The principle of least action is arguably the most fundamental principle in physics as it can be used to derive the equations of motion in various branches of physics. However, this principle has not been experimentally demonstrated at the quantum level because the propagators for Feymann's path integrals have never been observed. The propagator is a fundamental concept and contains various significant properties of a quantum system in path integral formulation, so its experimental observation is itself essential in quantum mechanics. Here we theoretically propose and experimentally observe single photons' propagators based on the method of directly measuring quantum wave-functions. Furthermore, we obtain the classical trajectories of the single photons in free space and in a harmonic trap based on the extremum of the observed propagators, thereby experimentally demonstrating the quantum principle of least action. Our work paves the way for experimentally exploring fundamental problems of quantum theory in the formulation of path integrals.

Large machine learning models are revolutionary technologies of artificial intelligence whose bottlenecks include huge computational expenses, power, and time used both in the pre-training and fine-tuning process. In this work, we show that fault-tolerant quantum computing could possibly provide provably efficient resolutions for generic (stochastic) gradient descent algorithms, scaling as O(T^2 polylog(n)), where n is the size of the models and T is the number of iterations in the training, as long as the models are both sufficiently dissipative and sparse, with small learning rates. Based on earlier efficient quantum algorithms for dissipative differential equations, we find and prove that similar algorithms work for (stochastic) gradient descent, the primary algorithm for machine learning. In practice, we benchmark instances of large machine learning models from 7 million to 103 million parameters. We find that, in the context of sparse training, a quantum enhancement is possible at the early stage of learning after model pruning, motivating a sparse parameter download and re-upload scheme. Our work shows solidly that fault-tolerant quantum algorithms could potentially contribute to most state-of-the-art, large-scale machine-learning problems., Comment: 7+40 pages, 3+10 figures, replaced with final version providing substantial detail

In holographic duality, boundary states that have semiclassical bulk duals must obey inequalities, which bound their subsystems' von Neumann entropies. Hitherto known inequalities constrain entropies of reduced states on up to $N=5$ disjoint subsystems. Here we report one new such inequality, which involves $N=7$ disjoint regions. Our work supports a recent conjecture on the structure of holographic inequalities, which predicted the existence and schematic form of the new inequality. We explain the logic and educated guesses by which we arrived at the inequality, and comment on the feasibility of employing similar tactics in a more exhaustive search., Comment: 15 pages plus appendices, 2 figures

Deep neural networks (DNNs) have been widely adopted in brain lesion detection and segmentation. However, locating small lesions in 2D MRI slices is challenging, and requires to balance between the granularity of 3D context aggregation and the computational complexity. In this paper, we propose a novel view-disentangled transformer to enhance the extraction of MRI features for more accurate tumour detection. First, the proposed transformer harvests long-range correlation among different positions in a 3D brain scan. Second, the transformer models a stack of slice features as multiple 2D views and enhance these features view-by-view, which approximately achieves the 3D correlation computing in an efficient way. Third, we deploy the proposed transformer module in a transformer backbone, which can effectively detect the 2D regions surrounding brain lesions. The experimental results show that our proposed view-disentangled transformer performs well for brain lesion detection on a challenging brain MRI dataset., Comment: International Symposium on Biomedical Imaging (ISBI) 2022, code: https://github.com/lhaof/ISBI-VDFormer

Mobility edge, a critical energy separating localized and extended excitations, is a key concept for understanding quantum localization. Aubry-Andr\'{e} (AA) model, a paradigm for exploring quantum localization, does not naturally allow mobility edges due to self-duality. Using the momentum-state lattice of quantum gas of Cs atoms to synthesize a nonlinear AA model, we provide experimental evidence for mobility edge induced by interactions. By identifying the extended-to-localized transition of different energy eigenstates, we construct a mobility-edge phase diagram. The location of mobility edge in the low- or high-energy region is tunable via repulsive or attractive interactions. Our observation is in good agreement with the theory, and supports an interpretation of such interaction-induced mobility edge via a generalized AA model. Our work also offers new possibilities to engineer quantum transport and phase transitions in disordered systems., Comment: 7+4 pages, 8 figures