Search

The orbital Hall effect (OHE) is attracting recent interest due to its fundamental science implications and potential applications in orbitronics and spintronics. Unlike the spin Hall effect, the connection between the OHE and band topology is not well understood. Here we present a novel approach for understanding the OHE based on analyzing the projected orbital angular momentum (POAM) spectrum. By considering monolayers of group IV elements, we demonstrate that the Wannier charge centers of the POAM spectrum display topologically nontrivial windings. The orbital Hall conductivity is found to form a plateau within the band gap as a direct consequence of the Chern number carried by the POAM spectrum. The topological orbital Hall phase is shown to yield a new form of bulk-boundary correspondence, which features gapless states in the POAM spectrum and induces nonzero orbital textures at the boundaries that should be amenable to experimental verification through ARPES measurements. Our study presents a systematic method for investigating the topological OHE and provides a pathway for its broader exploration in two-dimensional materials.

In recent years, there have been significant advances in efficiently solving $\ell_s$-regression using linear system solvers and $\ell_2$-regression [Adil-Kyng-Peng-Sachdeva, J. ACM'24]. Would efficient $\ell_p$-norm solvers lead to even faster rates for solving $\ell_s$-regression when $2 \leq p < s$? In this paper, we give an affirmative answer to this question and show how to solve $\ell_s$-regression using $\tilde{O}(n^{\frac{\nu}{1+\nu}})$ iterations of solving smoothed $\ell_s$ regression problems, where $\nu := \frac{1}{p} - \frac{1}{s}$. To obtain this result, we provide improved accelerated rates for convex optimization problems when given access to an $\ell_p^s(\lambda)$-proximal oracle, which, for a point $c$, returns the solution of the regularized problem $\min_{x} f(x) + \lambda \|x-c\|_p^s$. Additionally, we show that the rates we establish for the $\ell_p^s(\lambda)$-proximal oracle are near-optimal., Comment: 26 pages

Recent advancements in Large Language Model (LLM)-based frameworks have extended their capabilities to complex real-world applications, such as interactive web navigation. These systems, driven by user commands, navigate web browsers to complete tasks through multi-turn dialogues, offering both innovative opportunities and significant challenges. Despite the introduction of benchmarks for conversational web navigation, a detailed understanding of the key contextual components that influence the performance of these agents remains elusive. This study aims to fill this gap by analyzing the various contextual elements crucial to the functioning of web navigation agents. We investigate the optimization of context management, focusing on the influence of interaction history and web page representation. Our work highlights improved agent performance across out-of-distribution scenarios, including unseen websites, categories, and geographic locations through effective context management. These findings provide insights into the design and optimization of LLM-based agents, enabling more accurate and effective web navigation in real-world applications., Comment: 10 pages, 3 figures, 5 tables

Human image datasets used to develop and evaluate technology should represent the diversity of human phenotypes, including skin tone. Datasets that include skin tone information frequently rely on manual skin tone ratings based on the Fitzpatrick Skin Type (FST) or the Monk Skin Tone (MST) scales in lieu of the actual measured skin tone of the image dataset subjects. However, perceived skin tone is subject to known biases and skin tone appearance in digital images can vary substantially depending on the capture camera and environment, confounding manual ratings. Surprisingly, the relationship between skin-tone ratings and measured skin tone has not been explored. To close this research gap, we measured the relationship between skin tone ratings from existing scales (FST, MST) and skin tone values measured by a calibrated colorimeter. We also propose and assess a novel Colorimetric Skin Tone (CST) scale developed based on prior colorimetric measurements. Using experiments requiring humans to rate their own skin tone and the skin tone of subjects in images, we show that the new CST scale is more sensitive, consistent, and colorimetrically accurate. While skin tone ratings appeared to correct for some color variation across images, they introduced biases related to race and other factors. These biases must be considered before using manual skin-tone ratings in technology evaluations or for engineering decisions.

This study presents a novel approach to modelling economic agents as analogous to spin states in physics, particularly the Ising model. By associating economic activity with spin orientations (up for inactivity, down for activity), the study delves into optimizing market dynamics using concepts from statistical mechanics. Utilizing Monte Carlo simulations, the aim is to maximize surplus by allowing the market to evolve freely toward equilibrium. The introduction of temperature represents the frequency of economic activities, which is crucial for optimizing consumer and producer surplus. The government's role as a temperature regulator (raising temperature to stimulate economic activity) is explored. Results from simulations and policy interventions, such as introducing a "magnetic field," are discussed, showcasing complexities in optimizing economic systems while avoiding undue control that may destabilize markets. The study provides insights into bridging concepts from physics and economics, paving the way for a deeper understanding of economic dynamics and policy interventions.

We design and analyse an energy stable, structure preserving and well-balanced scheme for the Ripa system of shallow water equations. The energy stability of the numerical solutions is achieved by introducing appropriate stabilisation terms in the discretisation of the convective fluxes of mass and momenta, the pressure gradient and the topography source term. A diligent choice of the interface values of the water height and the temperature ensures the well-balancing property of the scheme for three physically relevant hydrostatic steady states. The explicit in time and finite volume in space scheme preserves the positivity of the water height and the temperature, and it is weakly consistent with the continuous model equations in the sense of Lax-Wendroff. The results of extensive numerical case studies on benchmark test problems are presented to confirm the theoretical findings., Comment: 25 pages

Mobile health (mHealth) programs face a critical challenge in optimizing the timing of automated health information calls to beneficiaries. This challenge has been formulated as a collaborative multi-armed bandit problem, requiring online learning of a low-rank reward matrix. Existing solutions often rely on heuristic combinations of offline matrix completion and exploration strategies. In this work, we propose a principled Bayesian approach using Thompson Sampling for this collaborative bandit problem. Our method leverages prior information through efficient Gibbs sampling for posterior inference over the low-rank matrix factors, enabling faster convergence. We demonstrate significant improvements over state-of-the-art baselines on a real-world dataset from the world's largest maternal mHealth program. Our approach achieves a $16\%$ reduction in the number of calls compared to existing methods and a $47$\% reduction compared to the deployed random policy. This efficiency gain translates to a potential increase in program capacity by $0.5-1.4$ million beneficiaries, granting them access to vital ante-natal and post-natal care information. Furthermore, we observe a $7\%$ and $29\%$ improvement in beneficiary retention (an extremely hard metric to impact) compared to state-of-the-art and deployed baselines, respectively. Synthetic simulations further demonstrate the superiority of our approach, particularly in low-data regimes and in effectively utilizing prior information. We also provide a theoretical analysis of our algorithm in a special setting using Eluder dimension.

We consider the problem of high-dimensional heavy-tailed statistical estimation in the streaming setting, which is much harder than the traditional batch setting due to memory constraints. We cast this problem as stochastic convex optimization with heavy tailed stochastic gradients, and prove that the widely used Clipped-SGD algorithm attains near-optimal sub-Gaussian statistical rates whenever the second moment of the stochastic gradient noise is finite. More precisely, with $T$ samples, we show that Clipped-SGD, for smooth and strongly convex objectives, achieves an error of $\sqrt{\frac{\mathsf{Tr}(\Sigma)+\sqrt{\mathsf{Tr}(\Sigma)\|\Sigma\|_2}\log(\frac{\log(T)}{\delta})}{T}}$ with probability $1-\delta$, where $\Sigma$ is the covariance of the clipped gradient. Note that the fluctuations (depending on $\frac{1}{\delta}$) are of lower order than the term $\mathsf{Tr}(\Sigma)$. This improves upon the current best rate of $\sqrt{\frac{\mathsf{Tr}(\Sigma)\log(\frac{1}{\delta})}{T}}$ for Clipped-SGD, known only for smooth and strongly convex objectives. Our results also extend to smooth convex and lipschitz convex objectives. Key to our result is a novel iterative refinement strategy for martingale concentration, improving upon the PAC-Bayes approach of Catoni and Giulini., Comment: Accepted at NeurIPS 2024

This paper develops the theory of Macdonald-Koornwinder polynomials in parallel analogy with the work done for the $GL_n$ case in [CR22]. In the context of the type $CC_n$ affine root system the Macdonald polynomials of other root systems of classical type are specializations of the Koornwinder polynomials. We derive $c$-function formulas for symmetrizers and use them to give $E$-expansions, principal specializations and norm formulas for bosonic, mesonic and fermionic Koornwinder polynomials. Finally, we explain the proof of the norm conjectures and constant term conjectures for the Koornwinder case.

This Paper presents an advanced approach for fine-tuning BiomedCLIP PubMedBERT, a multimodal model, to classify abnormalities in Video Capsule Endoscopy (VCE) frames, aiming to enhance diagnostic efficiency in gastrointestinal healthcare. By integrating the PubMedBERT language model with a Vision Transformer (ViT) to process endoscopic images, our method categorizes images into ten specific classes: angioectasia, bleeding, erosion, erythema, foreign body, lymphangiectasia, polyp, ulcer, worms, and normal. Our workflow incorporates image preprocessing and fine-tunes the BiomedCLIP model to generate high-quality embeddings for both visual and textual inputs, aligning them through similarity scoring for classification. Performance metrics, including classification, accuracy, recall, and F1 score, indicate the models strong ability to accurately identify abnormalities in endoscopic frames, showing promise for practical use in clinical diagnostics., Comment: 11 Pages, 2 Figures, Capsule Vision 2024 Challenge

Dual-arm manipulation is an area of growing interest in the robotics community. Enabling robots to perform tasks that require the coordinated use of two arms, is essential for complex manipulation tasks such as handling large objects, assembling components, and performing human-like interactions. However, achieving effective dual-arm manipulation is challenging due to the need for precise coordination, dynamic adaptability, and the ability to manage interaction forces between the arms and the objects being manipulated. We propose a novel pipeline that combines the advantages of policy learning based on environment feedback and gradient-based optimization to learn controller gains required for the control outputs. This allows the robotic system to dynamically modulate its impedance in response to task demands, ensuring stability and dexterity in dual-arm operations. We evaluate our pipeline on a trajectory-tracking task involving a variety of large, complex objects with different masses and geometries. The performance is then compared to three other established methods for controlling dual-arm robots, demonstrating superior results.

Deep learning (DL) methods have emerged as a powerful tool for the inversion of geophysical data. When applied to field data, these models often struggle without additional fine-tuning of the network. This is because they are built on the assumption that the statistical patterns in the training and test datasets are the same. To address this, we propose a DL-based inversion scheme for Radio Magnetotelluric data where the subsurface resistivity models are generated using Gaussian Random Fields (GRF). The network's generalization ability was tested with an out-of-distribution (OOD) dataset comprising a homogeneous background and various rectangular-shaped anomalous bodies. After end-to-end training with the GRF dataset, the pre-trained network successfully identified anomalies in the OOD dataset. Synthetic experiments confirmed that the GRF dataset enhances generalization compared to a homogeneous background OOD dataset. The network accurately recovered structures in a checkerboard resistivity model, and demonstrated robustness to noise, outperforming traditional gradient-based methods. Finally, the developed scheme is tested using exemplary field data from a waste site near Roorkee, India. The proposed scheme enhances generalization in a data-driven supervised learning framework, suggesting a promising direction for OOD generalization in DL methods.

Given coarser-resolution projections from global climate models or satellite data, the downscaling problem aims to estimate finer-resolution regional climate data, capturing fine-scale spatial patterns and variability. Downscaling is any method to derive high-resolution data from low-resolution variables, often to provide more detailed and local predictions and analyses. This problem is societally crucial for effective adaptation, mitigation, and resilience against significant risks from climate change. The challenge arises from spatial heterogeneity and the need to recover finer-scale features while ensuring model generalization. Most downscaling methods \cite{Li2020} fail to capture the spatial dependencies at finer scales and underperform on real-world climate datasets, such as sea-level rise. We propose a novel Kriging-informed Conditional Diffusion Probabilistic Model (Ki-CDPM) to capture spatial variability while preserving fine-scale features. Experimental results on climate data show that our proposed method is more accurate than state-of-the-art downscaling techniques.

Weak-line T Tauri stars (WTTS) exhibit X-ray flares, likely resulting from magnetic reconnection that heats the stellar plasma to very high temperatures. These flares are difficult to identify through targeted observations. Here, we report the serendipitous detection of the brightest X-ray flaring state of KM Ori in the eROSITA DR1 survey. Observations from SRG/eROSITA, Chandra X-ray Observatory, and XMM-Newton are analysed to assess the X-ray properties of KM Ori, thereby establishing its flaring state at the eROSITA epoch. The long-term (1999-2020) X-ray light curve generated for the Chandra observations confirmed that eROSITA captured the source at its highest X-ray flaring state recorded to date. Multi-instrument observations support the X-ray flaring state of the source, with time-averaged X-ray luminosity ($L_{0.2-5keV}$) reaching $\sim 1.9\times10^{32}{erg~s^{-1}}$ at the eROSITA epoch, marking it the brightest and possibly the longest flare observed to date. Such intense X-ray flares have been detected only in a few WTTS. The X-ray spectral analysis unveils the presence of multiple thermal plasma components at all epochs. The notably high luminosity ($L_{0.5-8~keV}\sim10^{32}{erg~s}^{-1}$), energy ($E_{0.5-8~keV}\sim10^{37}$erg), and the elevated emission measures of the thermal components in the eROSITA epoch indicate a superflare/megaflare state of KM Ori. Additionally, the H$\alpha$ line equivalent width of $\sim$-5\AA from our optical spectral analysis, combined with the lack of infrared excess in the spectral energy distribution, were used to re-confirm the WTTS (thin disk/disk-less) classification of the source. The long-duration flare of KM Ori observed by eROSITA indicates the possibility of a slow-rise top-flat flare. The detection demonstrates the potential of eROSITA to uncover such rare, transient events, thereby providing new insights into the X-ray activity of WTTS., Comment: 11 pages, 6 figures, 2 tables. This paper has been accepted for publication in PASA

Active droplets undergoing micellar solubilization can self-propel themselves by emitting filled micelles from their surface and are by nature anti-chemotactic. These droplets get repelled by their own trail of filled micelles or by other neighbouring droplets. We experimentally study the various types of scattering events between two such active droplets. We define different collision parameters to characterize the scattering events and monitor the time evolution of these parameters about the closest approach between the droplets. For generic oblique collisions of the droplets, we find four major types of scattering events in our experimental studies depending on the initial angle of approach, the initial Peclet numbers, the delay time, and the initial distance between the droplets. For higher Peclet number droplets, the existence of a bound state was also found., Comment: 7 pages, 2 figures, 4 tables

We present Movie Gen, a cast of foundation models that generates high-quality, 1080p HD videos with different aspect ratios and synchronized audio. We also show additional capabilities such as precise instruction-based video editing and generation of personalized videos based on a user's image. Our models set a new state-of-the-art on multiple tasks: text-to-video synthesis, video personalization, video editing, video-to-audio generation, and text-to-audio generation. Our largest video generation model is a 30B parameter transformer trained with a maximum context length of 73K video tokens, corresponding to a generated video of 16 seconds at 16 frames-per-second. We show multiple technical innovations and simplifications on the architecture, latent spaces, training objectives and recipes, data curation, evaluation protocols, parallelization techniques, and inference optimizations that allow us to reap the benefits of scaling pre-training data, model size, and training compute for training large scale media generation models. We hope this paper helps the research community to accelerate progress and innovation in media generation models. All videos from this paper are available at https://go.fb.me/MovieGenResearchVideos.

Under-canopy agricultural robots can enable various applications like precise monitoring, spraying, weeding, and plant manipulation tasks throughout the growing season. Autonomous navigation under the canopy is challenging due to the degradation in accuracy of RTK-GPS and the large variability in the visual appearance of the scene over time. In prior work, we developed a supervised learning-based perception system with semantic keypoint representation and deployed this in various field conditions. A large number of failures of this system can be attributed to the inability of the perception model to adapt to the domain shift encountered during deployment. In this paper, we propose a self-supervised online adaptation method for adapting the semantic keypoint representation using a visual foundational model, geometric prior, and pseudo labeling. Our preliminary experiments show that with minimal data and fine-tuning of parameters, the keypoint prediction model trained with labels on the source domain can be adapted in a self-supervised manner to various challenging target domains onboard the robot computer using our method. This can enable fully autonomous row-following capability in under-canopy robots across fields and crops without requiring human intervention.

We propose a novel framework, Stable Diffusion-based Momentum Integrated Adversarial Examples (SD-MIAE), for generating adversarial examples that can effectively mislead neural network classifiers while maintaining visual imperceptibility and preserving the semantic similarity to the original class label. Our method leverages the text-to-image generation capabilities of the Stable Diffusion model by manipulating token embeddings corresponding to the specified class in its latent space. These token embeddings guide the generation of adversarial images that maintain high visual fidelity. The SD-MIAE framework consists of two phases: (1) an initial adversarial optimization phase that modifies token embeddings to produce misclassified yet natural-looking images and (2) a momentum-based optimization phase that refines the adversarial perturbations. By introducing momentum, our approach stabilizes the optimization of perturbations across iterations, enhancing both the misclassification rate and visual fidelity of the generated adversarial examples. Experimental results demonstrate that SD-MIAE achieves a high misclassification rate of 79%, improving by 35% over the state-of-the-art method while preserving the imperceptibility of adversarial perturbations and the semantic similarity to the original class label, making it a practical method for robust adversarial evaluation., Comment: 10 pages, 12 figures. To be published in IEEE TPS 2024 Proceedings. Code available on GitHub: https://github.com/nashrahhaque/SD-MIAE

Speech forensic tasks (SFTs), such as automatic speaker recognition (ASR), speech emotion recognition (SER), gender recognition (GR), and age estimation (AE), find use in different security and biometric applications. Previous works have applied various techniques, with recent studies focusing on applying speech foundation models (SFMs) for improved performance. However, most prior efforts have centered on building individual models for each task separately, despite the inherent similarities among these tasks. This isolated approach results in higher computational resource requirements, increased costs, time consumption, and maintenance challenges. In this study, we address these challenges by employing a multi-task learning strategy. Firstly, we explore the various state-of-the-art (SOTA) SFMs by extracting their representations for learning these SFTs and investigating their effectiveness at each task specifically. Secondly, we analyze the performance of the extracted representations on the SFTs in a multi-task learning framework. We observe a decline in performance when SFTs are modeled together compared to individual task-specific models, and as a remedy, we propose multi-view learning (MVL). Views are representations from different SFMs transformed into distinct abstract spaces by characteristics unique to each SFM. By leveraging MVL, we integrate these diverse representations to capture complementary information across tasks, enhancing the shared learning process. We introduce a new framework called TANGO (Task Alignment with iNter-view Gated Optimal transport) to implement this approach. With TANGO, we achieve the topmost performance in comparison to individual SFM representations as well as baseline fusion techniques across benchmark datasets such as CREMA-D, emo-DB, and BAVED.

Alternative dark energy models were proposed to address the limitation of the standard concordance model. Though different phenomenological considerations of such models are widely studied, scenarios where they interact with each other remain unexplored. In this context, we study interacting dark energy scenarios (IDEs), incorporating alternative dark energy models. The three models that are considered in this study are time-varying \Lambda, Generalized Chaplygin Gas (GCG), and K-essence. Each model includes an interaction rate \Gamma to quantify energy density transfer between dark energy and matter. Among them, GCG coupled with an interaction term shows promising agreement with the observed TT power spectrum, particularly for l < 70, when \Gamma falls within a specific range. The K-essence model (\Gamma <= 0.1) is more sensitive to \Gamma due to its non-canonical kinetic term, while GCG (\Gamma >= 1.02) and the time-varying \Lambda (\Gamma <= 0.01) models are less sensitive, as they involve different parameterizations. We then derive a general condition when the non-canonical scalar field {\phi} (with a kinetic term Xn) interacts with GCG. This has not been investigated in general form before. We find that current observational constraints on IDEs suggest a unified scalar field with a balanced regime, where it mimics quintessence behavior at n < 1 and phantom behavior at n > 1. We outline a strong need to consider alternative explanations and fewer parameter dependencies while addressing potential interactions in the dark sector.

Despite being trained exclusively on speech data, speech foundation models (SFMs) like Whisper have shown impressive performance in non-speech tasks such as audio classification. This is partly because speech shares some common traits with audio, enabling SFMs to transfer effectively. In this study, we push the boundaries by evaluating SFMs on a more challenging out-of-domain (OOD) task: classifying physiological time-series signals. We test two key hypotheses: first, that SFMs can generalize to physiological signals by capturing shared temporal patterns; second, that multilingual SFMs will outperform others due to their exposure to greater variability during pre-training, leading to more robust, generalized representations. Our experiments, conducted for stress recognition using ECG (Electrocardiogram), EMG (Electromyography), and EDA (Electrodermal Activity) signals, reveal that models trained on SFM-derived representations outperform those trained on raw physiological signals. Among all models, multilingual SFMs achieve the highest accuracy, supporting our hypothesis and demonstrating their OOD capabilities. This work positions SFMs as promising tools for new uncharted domains beyond speech.

In this work, we introduce SeQuiFi, a novel approach for mitigating catastrophic forgetting (CF) in speech emotion recognition (SER). SeQuiFi adopts a sequential class-finetuning strategy, where the model is fine-tuned incrementally on one emotion class at a time, preserving and enhancing retention for each class. While various state-of-the-art (SOTA) methods, such as regularization-based, memory-based, and weight-averaging techniques, have been proposed to address CF, it still remains a challenge, particularly with diverse and multilingual datasets. Through extensive experiments, we demonstrate that SeQuiFi significantly outperforms both vanilla fine-tuning and SOTA continual learning techniques in terms of accuracy and F1 scores on multiple benchmark SER datasets, including CREMA-D, RAVDESS, Emo-DB, MESD, and SHEMO, covering different languages.

Rapid adoption of machine learning (ML) technologies has led to a surge in power consumption across diverse systems, from tiny IoT devices to massive datacenter clusters. Benchmarking the energy efficiency of these systems is crucial for optimization, but presents novel challenges due to the variety of hardware platforms, workload characteristics, and system-level interactions. This paper introduces MLPerf Power, a comprehensive benchmarking methodology with capabilities to evaluate the energy efficiency of ML systems at power levels ranging from microwatts to megawatts. Developed by a consortium of industry professionals from more than 20 organizations, MLPerf Power establishes rules and best practices to ensure comparability across diverse architectures. We use representative workloads from the MLPerf benchmark suite to collect 1,841 reproducible measurements from 60 systems across the entire range of ML deployment scales. Our analysis reveals trade-offs between performance, complexity, and energy efficiency across this wide range of systems, providing actionable insights for designing optimized ML solutions from the smallest edge devices to the largest cloud infrastructures. This work emphasizes the importance of energy efficiency as a key metric in the evaluation and comparison of the ML system, laying the foundation for future research in this critical area. We discuss the implications for developing sustainable AI solutions and standardizing energy efficiency benchmarking for ML systems., Comment: 14 pages, 11 figures, 1 table

In this article, we employ physics-informed residual learning (PIRL) and propose a pricing method for European options under a regime-switching framework, where closed-form solutions are not available. We demonstrate that the proposed approach serves an efficient alternative to competing pricing techniques for regime-switching models in the literature. Specifically, we demonstrate that PIRLs eliminate the need for retraining and become nearly instantaneous once trained, thus, offering an efficient and flexible tool for pricing options across a broad range of specifications and parameters.

Understanding the evolution of galaxies cannot exclude the important role played by the central supermassive black hole and the circumgalactic medium (CGM). Simulations have strongly suggested the negative feedback of AGN Jet/wind/outflows on the ISM/CGM of a galaxy leading to the eventual decline of star formation. However, no "smoking gun" evidence exists so far where relics of feedback, observed in any band, are consistent with the time scale of a major decline in star formation, in any sample of galaxies. Relics of any AGN-driven outflows will be observed as a faint and fuzzy structure which may be difficult to characterise by automated algorithms but trained citizen scientists can possibly perform better through their intuitive vision with additional heterogeneous data available anywhere on the Internet. RAD@home, launched on 15th April 2013, is not only the first Indian Citizen Science Research (CSR) platform in astronomy but also the only CSR publishing discoveries using any Indian telescope. We briefly report 11 CSR discoveries collected over the last eleven years. While searching for such relics we have spotted cases of offset relic lobes from elliptical and spiral, episodic radio galaxies with overlapping lobes as the host galaxy is in motion, large diffuse spiral-shaped emission, cases of jet-galaxy interaction, kinks and burls on the jets, a collimated synchrotron thread etc. Such exotic sources push the boundaries of our understanding of classical Seyferts and radio galaxies with jets and the process of discovery prepares the next generation for science with the upgraded GMRT and Square Kilometre Array Observatory (SKAO)., Comment: 14 pages, 8 figures. Accepted for publication in the Springer-Nature conference proceedings for "ISRA 2023: The Relativistic Universe: From Classical to Quantum Proceedings of the International Symposium on Recent Developments in Relativistic Astrophysics". Comments and collaborations, most welcome! Please visit #RADatHomeIndia website at radathomeindia.org

Domain-specific adaptation is critical to maximizing the performance of pre-trained language models (PLMs) on one or multiple targeted tasks, especially under resource-constrained use cases, such as edge devices. However, existing methods often struggle to balance domain-specific performance, retention of general knowledge, and efficiency for training and inference. To address these challenges, we propose Modular Domain Experts (MoDE). MoDE is a mixture-of-experts architecture that augments a general PLMs with modular, domain-specialized experts. These experts are trained independently and composed together via a lightweight training process. In contrast to standard low-rank adaptation methods, each MoDE expert consists of several transformer layers which scale better with more training examples and larger parameter counts. Our evaluation demonstrates that MoDE achieves comparable target performances to full parameter fine-tuning while achieving 1.65% better retention performance. Moreover, MoDE's architecture enables flexible sharding configurations and improves training speeds by up to 38% over state-of-the-art distributed training configurations., Comment: 14 pages, 5 figures, 3 tables

Large Language Models (LLMs) often generate incorrect or outdated information, especially in low-resource settings or when dealing with private data. To address this, Retrieval-Augmented Generation (RAG) uses external knowledge bases (KBs), but these can also suffer from inaccuracies. We introduce STACKFEED, a novel Structured Textual Actor-Critic Knowledge base editing with FEEDback approach that iteratively refines the KB based on expert feedback using a multi-actor, centralized critic reinforcement learning framework. Each document is assigned to an actor, modeled as a ReACT agent, which performs structured edits based on document-specific targeted instructions from a centralized critic. Experimental results show that STACKFEED significantly improves KB quality and RAG system performance, enhancing accuracy by up to 8% over baselines.

We investigate the stability of weak symmetry-protected topological phases (SPTs) in the presence of short-range interactions, focusing on the tenfold way classification. Using Atiyah's Real $\mathit{KR}$-theory and Anderson-dualized bordism, we classify free and interacting weak phases across all Altland-Zirnbauer symmetry classes in low dimensions. Extending the free-to-interacting map of Freed-Hopkins, we mathematically compute how the behavior of free weak SPTs changes when interactions are introduced as well as predict intrinsically-interacting weak phases in certain classes. Our mathematical techniques involve T-duality and the James splitting of the torus. Our results provide a mathematical framework for understanding the persistence of weak SPTs under interactions, with potential implications for experimental and theoretical studies of these phases., Comment: 48 pages. Comments welcome!

UniGlyph is a constructed language (conlang) designed to create a universal transliteration system using a script derived from seven-segment characters. The goal of UniGlyph is to facilitate cross-language communication by offering a flexible and consistent script that can represent a wide range of phonetic sounds. This paper explores the design of UniGlyph, detailing its script structure, phonetic mapping, and transliteration rules. The system addresses imperfections in the International Phonetic Alphabet (IPA) and traditional character sets by providing a compact, versatile method to represent phonetic diversity across languages. With pitch and length markers, UniGlyph ensures accurate phonetic representation while maintaining a small character set. Applications of UniGlyph include artificial intelligence integrations, such as natural language processing and multilingual speech recognition, enhancing communication across different languages. Future expansions are discussed, including the addition of animal phonetic sounds, where unique scripts are assigned to different species, broadening the scope of UniGlyph beyond human communication. This study presents the challenges and solutions in developing such a universal script, demonstrating the potential of UniGlyph to bridge linguistic gaps in cross-language communication, educational phonetics, and AI-driven applications., Comment: This submission includes 23 pages and tables. No external funding has been received for this research. Acknowledgments to Jeseentha V. for contributions to the phonetic study

As the need for large-scale data processing grows, distributed programming frameworks like PySpark have become increasingly popular. However, the task of converting traditional, sequential code to distributed code remains a significant hurdle, often requiring specialized knowledge and substantial time investment. While existing tools have made strides in automating this conversion, they often fall short in terms of speed, flexibility, and overall applicability. In this paper, we introduce ROOP, a groundbreaking tool designed to address these challenges. Utilizing a BERT-based Natural Language Processing (NLP) model, ROOP automates the translation of Python code to its PySpark equivalent, offering a streamlined solution for leveraging distributed computing resources. We evaluated ROOP using a diverse set of 14 Python programs comprising 26 loop fragments. Our results are promising: ROOP achieved a near-perfect translation accuracy rate, successfully converting 25 out of the 26 loop fragments. Notably, for simpler operations, ROOP demonstrated remarkable efficiency, completing translations in as little as 44 seconds. Moreover, ROOP incorporates a built-in testing mechanism to ensure the functional equivalence of the original and translated code, adding an extra layer of reliability. This research opens up new avenues for automating the transition from sequential to distributed programming, making the process more accessible and efficient for developers.

Recent advances in text-to-speech (TTS) systems, particularly those with voice cloning capabilities, have made voice impersonation readily accessible, raising ethical and legal concerns due to potential misuse for malicious activities like misinformation campaigns and fraud. While synthetic speech detectors (SSDs) exist to combat this, they are vulnerable to ``test domain shift", exhibiting decreased performance when audio is altered through transcoding, playback, or background noise. This vulnerability is further exacerbated by deliberate manipulation of synthetic speech aimed at deceiving detectors. This work presents the first systematic study of such active malicious attacks against state-of-the-art open-source SSDs. White-box attacks, black-box attacks, and their transferability are studied from both attack effectiveness and stealthiness, using both hardcoded metrics and human ratings. The results highlight the urgent need for more robust detection methods in the face of evolving adversarial threats.

Diabetic macular edema (DME) is a severe complication of diabetes, characterized by thickening of the central portion of the retina due to accumulation of fluid. DME is a significant and common cause of visual impairment in diabetic patients. Center-involved DME (ci-DME) is the highest risk form of disease as fluid extends close to the fovea which is responsible for sharp central vision. Earlier diagnosis or prediction of ci-DME may improve treatment outcomes. Here, we propose an ensemble method to predict ci-DME onset within a year using ultra-wide-field color fundus photography (UWF-CFP) images provided by the DIAMOND Challenge. We adopted a variety of baseline state-of-the-art classification networks including ResNet, DenseNet, EfficientNet, and VGG with the aim of enhancing model robustness. The best performing models were Densenet 121, Resnet 152 and EfficientNet b7, and these were assembled into a definitive predictive model. The final ensemble model demonstrates a strong performance with an Area Under Curve (AUC) of 0.7017, an F1 score of 0.6512, and an Expected Calibration Error (ECE) of 0.2057 when deployed on a synthetic dataset. The performance of this ensemble model is comparable to previous studies despite training and testing in a more realistic setting, indicating the potential of UWF-CFP combined with a deep learning classification system to facilitate earlier diagnosis, better treatment decisions, and improved prognostication in ci-DME.

We study the problem of computing the privacy parameters for DP machine learning when using privacy amplification via random batching and noise correlated across rounds via a correlation matrix $\textbf{C}$ (i.e., the matrix mechanism). Past work on this problem either only applied to banded $\textbf{C}$, or gave loose privacy parameters. In this work, we give a framework for computing near-exact privacy parameters for any lower-triangular, non-negative $\textbf{C}$. Our framework allows us to optimize the correlation matrix $\textbf{C}$ while accounting for amplification, whereas past work could not. Empirically, we show this lets us achieve smaller RMSE on prefix sums than the previous state-of-the-art (SOTA). We also show that we can improve on the SOTA performance on deep learning tasks. Our two main technical tools are (i) using Monte Carlo accounting to bypass composition, which was the main technical challenge for past work, and (ii) a "balls-in-bins" batching scheme that enables easy privacy analysis and is closer to practical random batching than Poisson sampling.

We propose a simple heuristic privacy analysis of noisy clipped stochastic gradient descent (DP-SGD) in the setting where only the last iterate is released and the intermediate iterates remain hidden. Namely, our heuristic assumes a linear structure for the model. We show experimentally that our heuristic is predictive of the outcome of privacy auditing applied to various training procedures. Thus it can be used prior to training as a rough estimate of the final privacy leakage. We also probe the limitations of our heuristic by providing some artificial counterexamples where it underestimates the privacy leakage. The standard composition-based privacy analysis of DP-SGD effectively assumes that the adversary has access to all intermediate iterates, which is often unrealistic. However, this analysis remains the state of the art in practice. While our heuristic does not replace a rigorous privacy analysis, it illustrates the large gap between the best theoretical upper bounds and the privacy auditing lower bounds and sets a target for further work to improve the theoretical privacy analyses. We also empirically support our heuristic and show existing privacy auditing attacks are bounded by our heuristic analysis in both vision and language tasks.

Ammonia is a key component of fertilizer and a potential clean fuel and hydrogen carrier. The Haber-Bosch process for ammonia synthesis consumes more than half of industrial hydrogen and contributes up to ~3% of global greenhouse gas emissions. Light-driven reactions via surface plasmon resonances offer a less energy-intensive pathway for ammonia production by altering reaction intermediates. Here, we report gold-ruthenium plasmonic bimetallic alloys for ammonia synthesis at room temperature and pressure, driven by visible light. We use colloidal synthesis to create AuRu$_x$ alloys (x=0.1, 0.2, 0.3) and disperse these nanoparticles on MgO supports for gas-phase ammonia synthesis. We observe a ~60 $\mu$mol/g/h reactivity and ~0.12% external quantum efficiency on a AuRu$_0$$_.$$_2$ sample under 100 mW/cm$^2$ visible light. In-situ diffuse reflective infrared Fourier transform spectroscopic measurements show that hydrogenation of nitrogen adsorbates is accelerated under light compared to thermocatalysis. Combining wavelength-dependent reactivity and spectroscopic findings with semi-classical electromagnetic modeling, we show plasmonic bimetallic alloys expedite ammonia synthesis by aiding hydrogenation of adsorbed nitrogen species via plasmon-mediated hot electrons. Quantum mechanical calculations reveal hydrogen-assisted N$_2$ splitting in the excited state is key to activating the reaction under ambient conditions. Therefore, light or H$_2$ alone cannot dissociate N$_2$ -- the key bottleneck to breaking N$_2$'s triple bond. Our findings are consistent with recent hypotheses on how nitrogenase enzymes catalyze ammonia production at mild conditions and provide insights for sustainable photochemical transformations., Comment: 21 pages, 4 figures, journal article submission soon

In this work, we explore the possibility of using synthetically generated data for video-based gesture recognition with large pre-trained models. We consider whether these models have sufficiently robust and expressive representation spaces to enable "training-free" classification. Specifically, we utilize various state-of-the-art video encoders to extract features for use in k-nearest neighbors classification, where the training data points are derived from synthetic videos only. We compare these results with another training-free approach -- zero-shot classification using text descriptions of each gesture. In our experiments with the RoCoG-v2 dataset, we find that using synthetic training videos yields significantly lower classification accuracy on real test videos compared to using a relatively small number of real training videos. We also observe that video backbones that were fine-tuned on classification tasks serve as superior feature extractors, and that the choice of fine-tuning data has a substantial impact on k-nearest neighbors performance. Lastly, we find that zero-shot text-based classification performs poorly on the gesture recognition task, as gestures are not easily described through natural language., Comment: Synthetic Data for Artificial Intelligence and Machine Learning: Tools, Techniques, and Applications II (SPIE Defense + Commercial Sensing, 2024)

Large ASR models can inadvertently leak sensitive information, which can be mitigated by formal privacy measures like differential privacy (DP). However, traditional DP training is computationally expensive, and can hurt model performance. Our study explores DP parameter-efficient fine-tuning as a way to mitigate privacy risks with smaller computation and performance costs for ASR models. Through extensive experimentation and progressive optimization, we achieve 4.6%/8.1% word error rate on LibriSpeech clean/other test-sets, setting a new performance benchmark while maintaining (10, 3.52e-6)-DP in fine-tuning a large ASR model with over 600M parameters.

We present the Merian Survey, an optical imaging survey optimized for studying the physical properties of bright star-forming dwarf galaxies. Merian is carried out with two medium-band filters ($N708$ and $N540$, centered at $708$ and $540$ nm), custom-built for the Dark Energy Camera (DECam) on the Blanco telescope. Merian covers $\sim 750\,\mathrm{deg}^2$ of equatorial fields, overlapping with the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP) wide, deep, and ultra-deep fields. When combined with the HSC-SSP imaging data ($grizy$), the new Merian DECam medium-band imaging allows for photometric redshift measurements via the detection of H$\rm\alpha$ and [OIII] line emission flux excess in the $N708$ and $N540$ filters, respectively, at $0.06

While many astrophysical plasmas can be modelled successfully assuming ionisation and thermal equilibrium, in some cases this is not appropriate and a non-equilibrium approach is required. In nebulae around evolved stars the local elemental abundances may also strongly vary in space and time. Here we present a non-equilibrium multi-ion module developed for the fluid-dynamics code \textsc{pion}, describing the physical processes included and demonstrating its capabilities with some test calculations. A non-equilbrium ionisation solver is developed that allows arbitrary elemental abundances for neutral and ionised (but not molecular) gas, for the elements H, He, C, N, O, Ne, Si, S and Fe. Collisional ionisation and recombination, photoionisation and charge-exchange reactions are included, and ion-by-ion non-equilibrium radiative cooling is calculated based on the instantaneous ion fractions of each element. Element and ion mass-fractions are advected using passive scalars, operator-split from the microphysical processes. The module is validated by comparing with equilibrium and non-equilibrium calculations in the literature. Effects of charge exchange on ion abundances in cooling plasmas are discussed. Application to modelling shocks and photoionised H~\textsc{ii} regions is demonstrated. The time-dependent expansion of a Wolf-Rayet nebula is studied, including photoionisation and collisional processes, and spectral-line luminosities calculated for non-equilibrium and equilibrium plasma states. The multi-ion module enables simulation of ionised plasmas with spatially varying elemental abundances using self-consistent ion abundances and thermal evolution. This allows prediction of spectral lines in UV, optical, IR and X-ray even in cases where the plasma is out of ionisation equilibrium.

Coherent radio emission with properties similar to planetary auroral signals has been reported from GJ 1151, a quiescent, slow-rotating mid-M star, by the LOFAR Two-metre (120-170 MHz) Sky Survey (LoTSS). The observed {LOFAR} emission is fairly bright at 0.89 mJy with 64% circular polarization, and the emission characteristics are consistent with the interaction between an Earth-sized planet with an orbital period of 1-5 days and the magnetic field of the host star. However, no short-period planet has been detected around GJ 1151. To confirm the reported radio emission caused by the putative planet around GJ 1151 and to investigate the nature of this emission, we carried out uGMRT observations of GJ 1151 at 150, 218, and 400 MHz over 33 hours across ten epochs. No emission was detected at any frequency. While at 150 MHz and 218 MHz, non-detection could be due to the low sensitivity of our observations, at 400 MHz, the rms sensitivities achieved were sufficient to detect the emission observed with LOFAR at $\sim$ 20$\sigma$ level. Our findings suggest that the radio emission is highly time-variable, likely influenced by the star-planet system's phase and the host star's magnetic field. Additional observations below 170 MHz, at more frequent epochs (as the periodicity of the emission is unknown), especially during periods of high stellar magnetic field strength, are needed to confirm the emission., Comment: Accepted at AJ, 8 pages, 2 figures

In this work, we have carried out a systematic analysis of the VLASS quick look catalogs together with \textit{Gaia DR3} to identify the optical counterparts of 3~GHz radio emitters within 500~pc to obtain a homogeneous statistical sample of stellar radio sources. We have identified distinct populations of 3 GHz emitters across the \textit{Gaia DR3} color-magnitude diagram. We also present candidate sources (transient, highly variable or background artifacts) which can be confirmed by follow-up observations. A majority of the detected sources constitute main sequence G, K and M-type stars including ultra-cool dwarfs. Pinning down the origin of radio emission from these populations can help us gain further insights into the origin of stellar and planetary magnetic fields. By analyzing the variation of brightness temperature of the sources with their spectral type, we have tentatively associated possible emission mechanisms with different object types. We inspected the correlation between quiescent radio and X-ray emission for our sample that can provide crucial insights into the current understanding of the Gudel-Benz relationship, which is essential for modeling steady radio emission and coronal heating. This VLASS-\textit{\textit{Gaia DR3}} analysis acts as a pilot study for follow-up observations at multiple wavelengths to better understand stellar structure, model flaring activities and detect radio emission caused by star-planet interactions., Comment: 19 pages, 10 figures, 1 table. Accepted to the Astronomical Journal

Navigation amongst densely packed crowds remains a challenge for mobile robots. The complexity increases further if the environment layout changes, making the prior computed global plan infeasible. In this paper, we show that it is possible to dramatically enhance crowd navigation by just improving the local planner. Our approach combines generative modelling with inference time optimization to generate sophisticated long-horizon local plans at interactive rates. More specifically, we train a Vector Quantized Variational AutoEncoder to learn a prior over the expert trajectory distribution conditioned on the perception input. At run-time, this is used as an initialization for a sampling-based optimizer for further refinement. Our approach does not require any sophisticated prediction of dynamic obstacles and yet provides state-of-the-art performance. In particular, we compare against the recent DRL-VO approach and show a 40% improvement in success rate and a 6% improvement in travel time.

The adaptation of foundation models has significantly advanced environmental audio deepfake detection (EADD), a rapidly growing area of research. These models are typically fine-tuned or utilized in their frozen states for downstream tasks. However, the dimensionality of their representations can substantially lead to a high parameter count of downstream models, leading to higher computational demands. So, a general way is to compress these representations by leveraging state-of-the-art (SOTA) unsupervised dimensionality reduction techniques (PCA, SVD, KPCA, GRP) for efficient EADD. However, with the application of such techniques, we observe a drop in performance. So in this paper, we show that representation vectors contain redundant information, and randomly selecting 40-50% of representation values and building downstream models on it preserves or sometimes even improves performance. We show that such random selection preserves more performance than the SOTA dimensionality reduction techniques while reducing model parameters and inference time by almost over half., Comment: Submitted to ICASSP 2025

Nucleon structure functions, as measured in lepton-nucleon scattering, have historically provided a critical observable in the study of partonic dynamics within the nucleon. However, at very large parton momenta it is both experimentally and theoretically challenging to extract parton distributions due to the probable onset of non-perturbative contributions and the unavailability of high precision data at critical kinematics. Extraction of the neutron structure and the d-quark distribution have been further challenging due to the necessity of applying nuclear corrections when utilizing scattering data from a deuteron target to extract free neutron structure. However, a program of experiments has been carried out recently at the energy-upgraded Jefferson Lab electron accelerator aimed at significantly reducing the nuclear correction uncertainties on the d-quark distribution function at large partonic momentum. This allows leveraging the vast body of deuterium data covering a large kinematic range to be utilized for d-quark parton distribution function extraction. We present new data from experiment E12-10-002 carried out in Jefferson Lab Hall C on the deuteron to proton cross-section ratio at large BJorken-x. These results significantly improve the precision of existing data, and provide a first look at the expected impact on quark distributions extracted from global parton distribution function fits.

Large Language Models (LLMs) show promise in generating code comments for novice programmers, but their educational effectiveness remains under-evaluated. This study assesses the instructional quality of code comments produced by GPT-4, GPT-3.5-Turbo, and Llama2, compared to expert-developed comments, focusing on their suitability for novices. Analyzing a dataset of ``easy'' level Java solutions from LeetCode, we find that GPT-4 exhibits comparable quality to expert comments in aspects critical for beginners, such as clarity, beginner-friendliness, concept elucidation, and step-by-step guidance. GPT-4 outperforms Llama2 in discussing complexity (chi-square = 11.40, p = 0.001) and is perceived as significantly more supportive for beginners than GPT-3.5 and Llama2 with Mann-Whitney U-statistics = 300.5 and 322.5, p = 0.0017 and 0.0003). This study highlights the potential of LLMs for generating code comments tailored to novice programmers.

In this study, we address the challenge of depression detection from speech, focusing on the potential of non-semantic features (NSFs) to capture subtle markers of depression. While prior research has leveraged various features for this task, NSFs-extracted from pre-trained models (PTMs) designed for non-semantic tasks such as paralinguistic speech processing (TRILLsson), speaker recognition (x-vector), and emotion recognition (emoHuBERT)-have shown significant promise. However, the potential of combining these diverse features has not been fully explored. In this work, we demonstrate that the amalgamation of NSFs results in complementary behavior, leading to enhanced depression detection performance. Furthermore, to our end, we introduce a simple novel framework, FuSeR, designed to effectively combine these features. Our results show that FuSeR outperforms models utilizing individual NSFs as well as baseline fusion techniques and obtains state-of-the-art (SOTA) performance in E-DAIC benchmark with RMSE of 5.51 and MAE of 4.48, establishing it as a robust approach for depression detection., Comment: Submitted to ICASSP 2025

One of the standard composite insulation systems for cryogenic applications consists of a layer of hollow glass microspheres (HGMs) followed by a layer of variable density multilayer insulation (VDMLI) comprised of various internal combinations of reflectors and spacers. Microstructural effects of the HGM assembly and convection between the vessel and its surroundings are unaccounted for in existing calculations, which the current study incorporates in the unit cell-based HGM analytical model. Building on it, the insulation performance of the HGM layer with increasing thickness is studied for a Dewar insulation system containing liquid nitrogen (boiling point 78 K) based on pressures ranging from high vacuum (0.0133 Pa) to atmospheric (105 Pa) for two benchmark cryogenic vessel sizes. A suitable range of thickness for both systems is suggested. Further, the performance of four arithmetic progression-based VDMLI profiles in combination with an optimal HGM layer is studied. A VDMLI configuration with repeating spacer layers is found to perform best in high-pressure conditions. Finally, based on heat transfer performance within the given range of pressures and warm boundary temperatures up to 393 K, optimal thickness values of 120-130mm for the HGM layer and 125mm for the best VDMLI configuration are reported., Comment: 17 pages, 8 figures

In this study, we investigate multimodal foundation models (MFMs) for emotion recognition from non-verbal sounds. We hypothesize that MFMs, with their joint pre-training across multiple modalities, will be more effective in non-verbal sounds emotion recognition (NVER) by better interpreting and differentiating subtle emotional cues that may be ambiguous in audio-only foundation models (AFMs). To validate our hypothesis, we extract representations from state-of-the-art (SOTA) MFMs and AFMs and evaluated them on benchmark NVER datasets. We also investigate the potential of combining selected foundation model representations to enhance NVER further inspired by research in speech recognition and audio deepfake detection. To achieve this, we propose a framework called MATA (Intra-Modality Alignment through Transport Attention). Through MATA coupled with the combination of MFMs: LanguageBind and ImageBind, we report the topmost performance with accuracies of 76.47%, 77.40%, 75.12% and F1-scores of 70.35%, 76.19%, 74.63% for ASVP-ESD, JNV, and VIVAE datasets against individual FMs and baseline fusion techniques and report SOTA on the benchmark datasets., Comment: Submitted to ICASSP 2025

In this study, for the first time, we extensively investigate whether music foundation models (MFMs) or speech foundation models (SFMs) work better for singing voice deepfake detection (SVDD), which has recently attracted attention in the research community. For this, we perform a comprehensive comparative study of state-of-the-art (SOTA) MFMs (MERT variants and music2vec) and SFMs (pre-trained for general speech representation learning as well as speaker recognition). We show that speaker recognition SFM representations perform the best amongst all the foundation models (FMs), and this performance can be attributed to its higher efficacy in capturing the pitch, tone, intensity, etc, characteristics present in singing voices. To our end, we also explore the fusion of FMs for exploiting their complementary behavior for improved SVDD, and we propose a novel framework, FIONA for the same. With FIONA, through the synchronization of x-vector (speaker recognition SFM) and MERT-v1-330M (MFM), we report the best performance with the lowest Equal Error Rate (EER) of 13.74 %, beating all the individual FMs as well as baseline FM fusions and achieving SOTA results., Comment: Submitted to ICASSP 2025

Self-supervised learning (SSL) methods for large speech models have proven to be highly effective at ASR. With the interest in public deployment of large pre-trained models, there is a rising concern for unintended memorization and leakage of sensitive data points from the training data. In this paper, we apply differentially private (DP) pre-training to a SOTA Conformer-based encoder, and study its performance on a downstream ASR task assuming the fine-tuning data is public. This paper is the first to apply DP to SSL for ASR, investigating the DP noise tolerance of the BEST-RQ pre-training method. Notably, we introduce a novel variant of model pruning called gradient-based layer freezing that provides strong improvements in privacy-utility-compute trade-offs. Our approach yields a LibriSpeech test-clean/other WER (%) of 3.78/ 8.41 with ($10$, 1e^-9)-DP for extrapolation towards low dataset scales, and 2.81/ 5.89 with (10, 7.9e^-11)-DP for extrapolation towards high scales., Comment: In proceedings of the IEEE Spoken Language Technologies Workshop, 2024