Search

The past decade has witnessed the rapid development and adoption of ML & DL methodologies in agricultural systems, showcased by great successes in agricultural applications. However, these conventional ML/DL models have certain limitations: they heavily rely on large, costly-to-acquire labeled datasets for training, require specialized expertise for development and maintenance, and are mostly tailored for specific tasks, thus lacking generalizability. Recently, large pre-trained models, also known as FMs, have demonstrated remarkable successes in language, vision, and decision-making tasks across various domains. These models are trained on a large amount of data from multiple domains and modalities. Once trained, they can accomplish versatile tasks with just minor fine-tuning and minimal task-specific labeled data. Despite their proven effectiveness and huge potential, there has been little exploration of applying FMs to agriculture AI. Thus, this study aims to explore the potential of FMs in the field of smart agriculture. In particular, conceptual tools and technical background are presented to help the understanding of the problem space and uncover new research directions. To this end, recent FMs in the general CS domain are reviewed, and the models are categorized into four categories: language FMs, vision FMs, multimodal FMs, and reinforcement learning FMs. Then, the steps of developing agriculture FMs (AFMs) are outlined and potential applications in smart agriculture are discussed. Moreover, challenges and risks associated with developing AFMs are discussed, including model training, validation, and deployment. In summary, the advancement of AI in agriculture is explored by introducing AFMs as a promising paradigm that can significantly mitigate the reliance on extensive labeled datasets and enhance the efficiency, effectiveness, and generalization of agricultural AI systems., Comment: 18 pages, 3 figures

Connected and autonomous vehicles (CAVs) promise next-gen transportation systems with enhanced safety, energy efficiency, and sustainability. One typical control strategy for CAVs is the so-called cooperative adaptive cruise control (CACC) where vehicles drive in platoons and cooperate to achieve safe and efficient transportation. In this study, we formulate CACC as a multi-agent reinforcement learning (MARL) problem. Diverging from existing MARL methods that use centralized training and decentralized execution which require not only a centralized communication mechanism but also dense inter-agent communication during training and online adaptation, we propose a fully decentralized MARL framework for enhanced efficiency and scalability. In addition, a quantization-based communication scheme is proposed to reduce the communication overhead without significantly degrading the control performance. This is achieved by employing randomized rounding numbers to quantize each piece of communicated information and only communicating non-zero components after quantization. Extensive experimentation in two distinct CACC settings reveals that the proposed MARL framework consistently achieves superior performance over several contemporary benchmarks in terms of both communication efficiency and control efficacy. In the appendix, we show that our proposed framework's applicability extends beyond CACC, showing promise for broader intelligent transportation systems with intricate action and state spaces., Comment: 14 pages, 11 figures

Recently, the giant intrinsic anomalous Hall effect (AHE) has been observed in the materials with kagome lattice. In this study, we systematically investigate the influence of high pressure on the AHE in the ferromagnet LiMn6Sn6 with clean Mn kagome lattice. Our in-situ high-pressure Raman spectroscopy indicates that the crystal structure of LiMn6Sn6 maintains a hexagonal phase under high pressures up to 8.51 GPa. The anomalous Hall conductivity (AHC) {\sigma}xyA remains around 150 {\Omega}-1 cm-1, dominated by the intrinsic mechanism. Combined with theoretical calculations, our results indicate that the stable AHE under pressure in LiMn6Sn6 originates from the robust electronic and magnetic structure., Comment: 11 pages 5 figures

The screening response of vortices in kagome superconductor CsV$_3$Sb$_5$ was measured using the ac mutual inductance technique. Besides confirming the absence of gapless quasiparticles in zero external magnetic field, we observe the peak effect, manifested in enhanced vortex pinning strength and critical current, in a broad intermediate range of magnetic field. The peaks are followed by another crossover from strong to weak pinning, unlike the usual peak effect that diminishes smoothly at $H_{c2}$. Hysteresis in the screening response allows the identification of a vortex glass phase which strongly correlates with the onset of the peaks. A variety of features in the temperature- and field-dependence of the screening response, corroborated by resistance and dc magnetization measurements, have allowed us to extract an $H$-$T$ phase diagram of the vortex states and to infer the irreversibility line $H_\text{irr}(T)$., Comment: Main text: 6 pages, 4 figures; supplementary: 10 pages, 8 figures

Momentum-matched type II van der Waals heterostructures (vdWHs) have been designed by assembling layered two-dimensional semiconductors (2DSs) with special band-structure combinations - that is, the valence band edge at the Gamma point (the Brillouin-zone center) for one 2DS and the conduction band edge at the Gamma point for the other [Ubrig et al., Nat. Mater. 19, 299 (2020)]. However, the band offset sizes, band-alignment types, and whether momentum matched or not, all are affected by the interfacial effects between the component 2DSs, such as the quasichemical-bonding (QB) interaction between layers and the electrical dipole moment formed around the vdW interface. Here, based on density-functional theory calculations, first we probe the interfacial effects (including different QBs for valence and conduction bands, interface dipole, and, the synergistic effects of these two aspects) on band-edge evolution in energy and valley (location in the Brillouin zone) and the resulting changes in band alignment and momentum matching for a typical vdWH of monolayer InSe and bilayer WS2, in which the band edges of subsystems satisfy the special band-structure combination for a momentum-matched type II vdWH. Then, based on the conclusions of the studied interfacial effects, we propose a practical screening method for robust momentum-matched type II vdWHs. This practical screening method can also be applied to other band alignment types. Our current study opens a way for practical screening and designing of vdWHs with robust momentum-matching and band alignment type.

Serverless computing has become increasingly popular for machine learning inference. However, current serverless platforms lack efficient support for GPUs, limiting their ability to deliver low-latency inference. In this paper, we propose FaaSwap, a GPU-efficient serverless inference platform. FaaSwap employs a holistic approach to system and algorithm design. It maintains models in main memory and dynamically swaps them onto GPUs upon request arrivals (i.e., late binding), thereby enabling a large number of inference functions to efficiently share a node's GPUs. FaaSwap uses various techniques, including asynchronous API redirection, GPU runtime sharing, pipelined model execution, and efficient GPU memory management, to achieve the optimal performance. We also develop an interference-aware request scheduling algorithm that allows FaaSwap to meet the latency SLOs for individual inference functions. We have implemented FaaSwap as a prototype on a leading commercial serverless platform. Experimental evaluations demonstrate that, with model swapping, FaaSwap can concurrently serve hundreds of functions on a single worker node with 4 V100 GPUs, while achieving inference performance comparable to native execution (where each function runs on a dedicated GPU). When deployed on a 6-node production testbed, FaaSwap meets the latency SLOs for over 1k functions, the maximum that the testbed can handle concurrently.

The kagome metals AV$_3$Sb$_5$ (A=K,Rb,Cs) present an ideal sandbox to study the interrelation between multiple coexisting correlated phases such as charge order and superconductivity. So far, no consensus on the microscopic nature of these states has been reached as the proposals struggle to explain all their exotic physical properties. Among these, field-switchable electric magneto-chiral anisotropy (eMChA) in CsV$_3$Sb$_5$ provides intriguing evidence for a rewindable electronic chirality, yet the other family members have not been likewise investigated. Here, we present a comparative study of magneto-chiral transport between CsV$_3$Sb$_5$ and KV$_3$Sb$_5$. Despite their similar electronic structure, KV$_3$Sb$_5$ displays negligible eMChA, if any, and with no field switchability. This is in stark contrast to the non-saturating eMChA in CsV$_3$Sb$_5$ even in high fields up to 35 T. In light of their similar band structures, the stark difference in eMChA suggests its origin in the correlated states. Clearly, the V kagome nets alone are not sufficient to describe the physics and the interactions with their environment are crucial in determining the nature of their low-temperature state.

The past decade has witnessed many great successes of machine learning (ML) and deep learning (DL) applications in agricultural systems, including weed control, plant disease diagnosis, agricultural robotics, and precision livestock management. Despite tremendous progresses, one downside of such ML/DL models is that they generally rely on large-scale labeled datasets for training, and the performance of such models is strongly influenced by the size and quality of available labeled data samples. In addition, collecting, processing, and labeling such large-scale datasets is extremely costly and time-consuming, partially due to the rising cost in human labor. Therefore, developing label-efficient ML/DL methods for agricultural applications has received significant interests among researchers and practitioners. In fact, there are more than 50 papers on developing and applying deep-learning-based label-efficient techniques to address various agricultural problems since 2016, which motivates the authors to provide a timely and comprehensive review of recent label-efficient ML/DL methods in agricultural applications. To this end, we first develop a principled taxonomy to organize these methods according to the degree of supervision, including weak supervision (i.e., active learning and semi-/weakly- supervised learning), and no supervision (i.e., un-/self- supervised learning), supplemented by representative state-of-the-art label-efficient ML/DL methods. In addition, a systematic review of various agricultural applications exploiting these label-efficient algorithms, such as precision agriculture, plant phenotyping, and postharvest quality assessment, is presented. Finally, we discuss the current problems and challenges, as well as future research directions. A well-classified paper list can be accessed at https://github.com/DongChen06/Label-efficient-in-Agriculture., Comment: 34 pages, 23 figures

High-dimensional quantum systems offer many advantages over low-dimensional quantum systems. Meanwhile, unitary transformations on quantum states are important parts in various quantum information tasks, whereas they become technically infeasible as the dimensionality increases. The photonic orbital angular momentum (OAM), which is inherit in the transverse spatial mode of photons, offers a natural carrier to encode information in high-dimensional spaces. However, it's even more challenging to realize arbitrary unitary transformations on the photonic OAM states. Here, by combining the path and OAM degrees of freedom of a single photon, an efficient scheme to realize arbitrary unitary transformations on the path-OAM coupled quantum states is proposed. The proposal reduces the number of required interferometers by approximately one quarter compared with previous works, while maintaining the symmetric structure. It is shown that by using OAM-to-path interfaces, this scheme can be utilized to realize arbitrary unitary transformations on the OAM states of photons. This work facilitates the development of high-dimension quantum state transformations, and opens a new door to the manipulation of the photonic OAM states., Comment: 10 pages, 8 figures

Spontaneously broken symmetries are at the heart of many phenomena of quantum matter and physics more generally. However, determining the exact symmetries broken can be challenging due to imperfections such as strain, in particular when multiple electronic orders form complex interactions. This is exemplified by charge order in some kagome systems, which are speculated to show nematicity and flux order from orbital currents. We fabricated highly symmetric samples of a member of this family, CsV$_3$Sb$_5$, and measured their transport properties. We find the absence of measurable anisotropy at any temperature in the unperturbed material, however, a striking in-plane transport anisotropy appears when either weak magnetic fields or strains are present. A symmetry analysis indicates that a perpendicular magnetic field can indeed lead to in-plane anisotropy by inducing a flux order coexisting with more conventional bond order. Our results provide a unifying picture for the controversial charge order in kagome metals and highlight the need for microscopic materials control in the identification of broken symmetries.

Hypergraphs are useful mathematical models for describing complex relationships among members of a structured graph, while hyperdigraphs serve as a generalization that can encode asymmetric relationships in the data. However, obtaining topological information directly from hyperdigraphs remains a challenge. To address this issue, we introduce hyperdigraph homology in this work. We also propose topological hyperdigraph Laplacians, which can extract both harmonic spectra and non-harmonic spectra from directed and internally organized data. Moreover, we introduce persistent hyperdigraph homology and persistent hyperdigraph Laplacians through filtration, enabling the capture of topological persistence and homotopic shape evolution of directed and structured data across multiple scales. The proposed methods offer new multiscale algebraic topology tools for topological data analysis., Comment: 37 pages, 6 figures, 52 conferences

In this work, we investigate the problem of creating high-fidelity 3D content from only a single image. This is inherently challenging: it essentially involves estimating the underlying 3D geometry while simultaneously hallucinating unseen textures. To address this challenge, we leverage prior knowledge from a well-trained 2D diffusion model to act as 3D-aware supervision for 3D creation. Our approach, Make-It-3D, employs a two-stage optimization pipeline: the first stage optimizes a neural radiance field by incorporating constraints from the reference image at the frontal view and diffusion prior at novel views; the second stage transforms the coarse model into textured point clouds and further elevates the realism with diffusion prior while leveraging the high-quality textures from the reference image. Extensive experiments demonstrate that our method outperforms prior works by a large margin, resulting in faithful reconstructions and impressive visual quality. Our method presents the first attempt to achieve high-quality 3D creation from a single image for general objects and enables various applications such as text-to-3D creation and texture editing., Comment: 17 pages, 18 figures, Project page: https://make-it-3d.github.io/

This work focuses on sign language retrieval-a recently proposed task for sign language understanding. Sign language retrieval consists of two sub-tasks: text-to-sign-video (T2V) retrieval and sign-video-to-text (V2T) retrieval. Different from traditional video-text retrieval, sign language videos, not only contain visual signals but also carry abundant semantic meanings by themselves due to the fact that sign languages are also natural languages. Considering this character, we formulate sign language retrieval as a cross-lingual retrieval problem as well as a video-text retrieval task. Concretely, we take into account the linguistic properties of both sign languages and natural languages, and simultaneously identify the fine-grained cross-lingual (i.e., sign-to-word) mappings while contrasting the texts and the sign videos in a joint embedding space. This process is termed as cross-lingual contrastive learning. Another challenge is raised by the data scarcity issue-sign language datasets are orders of magnitude smaller in scale than that of speech recognition. We alleviate this issue by adopting a domain-agnostic sign encoder pre-trained on large-scale sign videos into the target domain via pseudo-labeling. Our framework, termed as domain-aware sign language retrieval via Cross-lingual Contrastive learning or CiCo for short, outperforms the pioneering method by large margins on various datasets, e.g., +22.4 T2V and +28.0 V2T R@1 improvements on How2Sign dataset, and +13.7 T2V and +17.1 V2T R@1 improvements on PHOENIX-2014T dataset. Code and models are available at: https://github.com/FangyunWei/SLRT., Comment: Accepted by CVPR 2023. Code and models are available at: https://github.com/FangyunWei/SLRT

While generative modeling has become prevalent across numerous research fields, its integration into the realm of image retrieval remains largely unexplored and underjustified. In this paper, we present a novel methodology, reframing image retrieval as a variant of generative modeling and employing a sequence-to-sequence model. This approach is harmoniously aligned with the current trend towards unification in research, presenting a cohesive framework that allows for end-to-end differentiable searching. This, in turn, facilitates superior performance via direct optimization techniques. The development of our model, dubbed IRGen, addresses the critical technical challenge of converting an image into a concise sequence of semantic units, which is pivotal for enabling efficient and effective search. Extensive experiments demonstrate that our model achieves state-of-the-art performance on three widely-used image retrieval benchmarks as well as two million-scale datasets, yielding significant improvement compared to prior competitive retrieval methods. In addition, the notable surge in precision scores facilitated by generative modeling presents the potential to bypass the reranking phase, which is traditionally indispensable in practical retrieval workflows., Comment: Accepted by ECCV 2024

Denoising diffusion models have been a mainstream approach for image generation, however, training these models often suffers from slow convergence. In this paper, we discovered that the slow convergence is partly due to conflicting optimization directions between timesteps. To address this issue, we treat the diffusion training as a multi-task learning problem, and introduce a simple yet effective approach referred to as Min-SNR-$\gamma$. This method adapts loss weights of timesteps based on clamped signal-to-noise ratios, which effectively balances the conflicts among timesteps. Our results demonstrate a significant improvement in converging speed, 3.4$\times$ faster than previous weighting strategies. It is also more effective, achieving a new record FID score of 2.06 on the ImageNet $256\times256$ benchmark using smaller architectures than that employed in previous state-of-the-art. The code is available at https://github.com/TiankaiHang/Min-SNR-Diffusion-Training.

Automated apple harvesting has attracted significant research interest in recent years due to its potential to revolutionize the apple industry, addressing the issues of shortage and high costs in labor. One key technology to fully enable efficient automated harvesting is accurate and robust apple detection, which is challenging due to complex orchard environments that involve varying lighting conditions and foliage/branch occlusions. Furthermore, clustered apples are common in the orchard, which brings additional challenges as the clustered apples may be identified as one apple. This will cause issues in localization for subsequent robotic operations. In this paper, we present the development of a novel deep learning-based apple detection framework, Occluder-Occludee Relational Network (O2RNet), for robust detection of apples in such clustered environments. This network exploits the occuluder-occludee relationship modeling head by introducing a feature expansion structure to enable the combination of layered traditional detectors to split clustered apples and foliage occlusions. More specifically, we collect a comprehensive apple orchard image dataset under different lighting conditions (overcast, front lighting, and back lighting) with frequent apple occlusions. We then develop a novel occlusion-aware network for apple detection, in which a feature expansion structure is incorporated into the convolutional neural networks to extract additional features generated by the original network for occluded apples. Comprehensive evaluations are performed, which show that the developed O2RNet outperforms state-of-the-art models with a higher accuracy of 94\% and a higher F1-score of 0.88 on apple detection.