Search

Perovskite oxides such as LaFeO$_3$ are a well-studied family of materials that possess a wide range of useful and novel properties. Successfully synthesizing perovskite oxide samples usually requires a significant number of growth attempts and a detailed film characterization on each sample to find the optimal growth window of a material. The most common real-time \textit{in situ} diagnostic technique available during molecular beam epitaxy (MBE) synthesis is reflection high-energy electron diffraction (RHEED). Conventional use of RHEED allows a highly experienced operator to determine growth rate by monitoring intensity osciallations and make some qualitative observations during growth, such as recognizing the sample has become amorphous or recognizing that large islands have formed on the surface. However, due to a lack of theoretical understanding of the diffraction patterns, finer, more precise levels of observations are challenging. To address these limitations, we implement new data analytics techniques in the growth of three LaFeO$_3$ samples on Nb-doped SrTiO$_3$ by MBE. These techniques improve our ability to perform unsupervised machine learning using principal component analysis (PCA) and k-means clustering by using drift correction to overcome sample or stage motion during growth and intensity transformations that highlight more subtle features in the images such as Kikuchi bands. With this approach, we enable the first demonstration of PCA and k-means across multiple samples, allowing for quantitative comparison of RHEED videos for two LaFeO$_3$ film samples. These capabilities set the stage for real-time processing of RHEED data during growth to enable machine learning-accelerated film synthesis., Comment: 8 pages, 7 figures; Supplemental materials available on Zenodo at DOI: 10.5281/zenodo.14649215

The rapid validation of newly predicted materials through autonomous synthesis requires real-time adaptive control methods that exploit physics knowledge, a capability that is lacking in most systems. Here, we demonstrate an approach to enable the real-time control of thin film synthesis by combining in situ optical diagnostics with a Bayesian state estimation method. We developed a physical model for film growth and applied the Direct Filter (DF) method for real-time estimation of nucleation and growth rates during pulsed laser deposition (PLD) of transition metal dichalcogenides. We validated the approach on simulated and previously acquired reflectivity data for WSe$_2$ growth and ultimately deployed the algorithm on an autonomous PLD system during growth of 1T$^\prime$-MoTe$_2$ under various synthesis conditions. We found that the DF robustly estimates growth parameters in real-time at early stages of growth, down to 15% percent monolayer area coverage. This approach opens new opportunities for adaptive film growth control based on a fusion of in situ diagnostics, modern data assimilation methods, and physical models which promises to enable control of synthesis trajectories towards desired material states.

Noncollinear ferroic materials are sought after as testbeds to explore the intimate connections between topology and symmetry, which result in electronic, optical and magnetic functionalities not observed in collinear ferroic materials. For example, ferroaxial materials have ordered rotational structural distortions that break mirror symmetry and induce chirality. When ferroaxial order is coupled with ferroelectricity arising from a broken inversion symmetry, it offers the prospect of electric-field-control of the ferroaxial distortions and opens up new tunable functionalities. However, chiral multiferroics, especially ones stable at room temperature, are rare. We report the discovery of a strain-stabilized, room-temperature chiral multiferroic phase in single crystals of BaTiS$_3$, a quasi-one-dimensional (1D) hexagonal chalcogenide. Using first-principles calculations, we predict the stabilization of this multiferroic phase having $P6_3$ space group for biaxial tensile strains exceeding 1.5% applied on the basal ab-plane of the room temperature $P6_3cm$ phase of BaTiS$_3$. The chiral multiferroic phase is characterized by rotational distortions of select TiS$_6$ octahedra around the long $c$-axis and polar displacement of Ti atoms along the $c$-axis. We used an innovative approach using focused ion beam milling to make appropriately strained samples of BaTiS$_3$. The ferroaxial and ferroelectric distortions, and their domains in $P6_3$-BaTiS$_3$ were directly resolved using atomic resolution scanning transmission electron microscopy. Landau-based phenomenological modeling predicts a strong coupling between the ferroelectric and the ferroaxial order making $P6_3$-BaTiS$_3$ an attractive test bed for achieving electric-field control of chirality-related phenomena such as circular photo-galvanic current and the Rashba effect., Comment: 20 pages, 4 figures

Scientific advancement is universally based on the dynamic interplay between theoretical insights, modelling, and experimental discoveries. However, this feedback loop is often slow, including delayed community interactions and the gradual integration of experimental data into theoretical frameworks. This challenge is particularly exacerbated in domains dealing with high-dimensional object spaces, such as molecules and complex microstructures. Hence, the integration of theory within automated and autonomous experimental setups, or theory in the loop automated experiment, is emerging as a crucial objective for accelerating scientific research. The critical aspect is not only to use theory but also on-the-fly theory updates during the experiment. Here, we introduce a method for integrating theory into the loop through Bayesian co-navigation of theoretical model space and experimentation. Our approach leverages the concurrent development of surrogate models for both simulation and experimental domains at the rates determined by latencies and costs of experiments and computation, alongside the adjustment of control parameters within theoretical models to minimize epistemic uncertainty over the experimental object spaces. This methodology facilitates the creation of digital twins of material structures, encompassing both the surrogate model of behavior that includes the correlative part and the theoretical model itself. While demonstrated here within the context of functional responses in ferroelectric materials, our approach holds promise for broader applications, the exploration of optical properties in nanoclusters, microstructure-dependent properties in complex materials, and properties of molecular systems. The analysis code that supports the funding is publicly available at https://github.com/Slautin/2024_Co-navigation/tree/main, Comment: 23 pages, 10 figures

With the advent of large language models (LLMs), in both the open source and proprietary domains, attention is turning to how to exploit such artificial intelligence (AI) systems in assisting complex scientific tasks, such as material synthesis, characterization, analysis and discovery. Here, we explore the utility of LLM, particularly ChatGPT4, in combination with application program interfaces (APIs) in tasks of experimental design, programming workflows, and data analysis in scanning probe microscopy, using both in-house developed API and API given by a commercial vendor for instrument control. We find that the LLM can be especially useful in converting ideations of experimental workflows to executable code on microscope APIs. Beyond code generation, we find that the GPT4 is capable of analyzing microscopy images in a generic sense. At the same time, we find that GPT4 suffers from inability to extend beyond basic analyses or more in-depth technical experimental design. We argue that a LLM specifically fine-tuned for individual scientific domains can potentially be a better language interface for converting scientific ideations from human experts to executable workflows, such a synergy between human expertise and LLM efficiency in experimentation can open new door for accelerating scientific research, enabling effective experimental protocols archive and sharing in scientific community., Comment: 16 pages; 7 figures

Microscopy, in particular scanning probe and electron microscopy, has been pivotal in improving our understanding of structure-function relationships at the nanoscale and is by now ubiquitous in most research characterization labs and facilities. However, traditional microscopy operations are still limited largely by a human-centric click-and-go paradigm utilizing vendor-provided software, which necessarily limits the scope, utility, efficiency, effectiveness, and at times reproducibility of microscopy experiments. Here, we develop a coupled hardware-software platform that consists of a field-programmable gate array (FPGA) device, with LabView-built customized acquisition scripts, along with a software package termed AEcroscoPy (short for Automated Experiments in Microscopy driven by Python) that overcome these limitations and provide the necessary abstractions towards full automation of microscopy platforms. The platform works across multiple vendor devices on scanning probe microscopes and scanning transmission electron microscopes. It enables customized scan trajectories, processing functions that can be triggered locally or remotely on processing servers, user-defined excitation waveforms, standardization of data models, and completely seamless operation through simple Python commands to enable a plethora of microscopy experiments to be performed in a reproducible, automated manner. This platform can be readily coupled with existing machine learning libraries as well as simulations, to provide automated decision-making and active theory-experiment optimization loops to turn microscopes from characterization tools to instruments capable of autonomous model refinement and physics discovery., Comment: 19 pages, 9 figures

Materials synthesis platforms that are designed for autonomous experimentation are capable of collecting multimodal diagnostic data that can be utilized for feedback to optimize material properties. Pulsed laser deposition (PLD) is emerging as a viable autonomous synthesis tool, and so the need arises to develop machine learning (ML) techniques that are capable of extracting information from in situ diagnostics. Here, we demonstrate that intensified-CCD image sequences of the plasma plume generated during PLD can be used for anomaly detection and the prediction of thin film growth kinetics. We developed a multi-output (2$+$1)D convolutional neural network regression model that extracts deep features from plume dynamics that not only correlate with the measured chamber pressure and incident laser energy, but more importantly, predict parameters of an auto-catalytic film growth model derived from in situ laser reflectivity experiments. Our results are the first demonstration of how ML with in situ plume diagnostics data in PLD can be utilized to maintain deposition conditions in an optimal regime. Further, the predictive capabilities of plume dynamics on the kinetics of film growth or other film properties prior to deposition provides a means for rapid pre-screening of growth conditions for the non-expert, which promises to accelerate materials optimization with PLD.

Upgrades to advanced scientific user facilities such as next-generation x-ray light sources, nanoscience centers, and neutron facilities are revolutionizing our understanding of materials across the spectrum of the physical sciences, from life sciences to microelectronics. However, these facility and instrument upgrades come with a significant increase in complexity. Driven by more exacting scientific needs, instruments and experiments become more intricate each year. This increased operational complexity makes it ever more challenging for domain scientists to design experiments that effectively leverage the capabilities of and operate on these advanced instruments. Large language models (LLMs) can perform complex information retrieval, assist in knowledge-intensive tasks across applications, and provide guidance on tool usage. Using x-ray light sources, leadership computing, and nanoscience centers as representative examples, we describe preliminary experiments with a Context-Aware Language Model for Science (CALMS) to assist scientists with instrument operations and complex experimentation. With the ability to retrieve relevant information from facility documentation, CALMS can answer simple questions on scientific capabilities and other operational procedures. With the ability to interface with software tools and experimental hardware, CALMS can conversationally operate scientific instruments. By making information more accessible and acting on user needs, LLMs could expand and diversify scientific facilities' users and accelerate scientific output.

Synthesis of thin films has traditionally relied upon slow, sequential processes carried out with substantial human intervention, frequently utilizing a mix of experience and serendipity to optimize material structure and properties. With recent advances in autonomous systems which combine synthesis, characterization, and decision making with artificial intelligence (AI), large parameter spaces can be explored autonomously at rates beyond what is possible by human experimentalists, greatly accelerating discovery, optimization, and understanding in materials synthesis which directly address the grand challenges in synthesis science. Here, we demonstrate autonomous synthesis of a contemporary 2D material by combining the highly versatile pulsed laser deposition (PLD) technique with automation and machine learning (ML). We incorporated in situ and real-time spectroscopy, a high-throughput methodology, and cloud connectivity to enable autonomous synthesis workflows with PLD. Ultrathin WSe2 films were grown using co-ablation of two targets and showed a 10x increase in throughput over traditional PLD workflows. Gaussian process regression and Bayesian optimization were used with in situ Raman spectroscopy to autonomously discover two distinct growth windows and the process-property relationship after sampling only 0.25% of a large 4D parameter space. Any material that can be grown with PLD could be autonomously synthesized with our platform and workflows, enabling accelerated discovery and optimization of a vast number of materials.

Developing methods to understand and control defect formation in nanomaterials offers a promising route for materials discovery. Monolayer MX2 phases represent a particularly compelling case for defect engineering of nanomaterials due to the large variability in their physical properties as different defects are introduced into their structure. However, effective identification and quantification of defects remains a challenge even as high-throughput scanning tunneling electron microscopy (STEM) methods improve. This study highlights the benefits of employing first principles calculations to produce digital twins for training deep learning segmentation models for defect identification in monolayer MX2 phases. Around 600 defect structures were obtained using density functional theory calculations, with each monolayer MX2 structure being subjected to multislice simulations for the purpose of generating the digital twins. Several deep learning segmentation architectures were trained on this dataset, and their performances evaluated under a variety of conditions such as recognizing defects in the presence of unidentified impurities, beam damage, grain boundaries, and with reduced image quality from low electron doses. This digital twin approach allows benchmarking different deep learning architectures on a theory dataset, which enables the study of defect classification under a broad array of finely controlled conditions. It thus opens the door to resolving the underpinning physical reasons for model shortcomings, and potentially chart paths forward for automated discovery of materials defect phases in experiments., Comment: 17 pages, 7 figures

Optimization of experimental materials synthesis and characterization through active learning methods has been growing over the last decade, with examples ranging from measurements of diffraction on combinatorial alloys at synchrotrons, to searches through chemical space with automated synthesis robots for perovskites. In virtually all cases, the target property of interest for optimization is defined apriori with limited human feedback during operation. In contrast, here we present the development of a new type of human in the loop experimental workflow, via a Bayesian optimized active recommender system (BOARS), to shape targets on the fly, employing human feedback. We showcase examples of this framework applied to pre-acquired piezoresponse force spectroscopy of a ferroelectric thin film, and then implement this in real time on an atomic force microscope, where the optimization proceeds to find symmetric piezoresponse amplitude hysteresis loops. It is found that such features appear more affected by subsurface defects than the local domain structure. This work shows the utility of human-augmented machine learning approaches for curiosity-driven exploration of systems across experimental domains. The analysis reported here is summarized in Colab Notebook for the purpose of tutorial and application to other data: https://github.com/arpanbiswas52/varTBO, Comment: 7 figures in main text, 3 figures in Supp Material

The ability of deep learning methods to perform classification and regression tasks relies heavily on their capacity to uncover manifolds in high-dimensional data spaces and project them into low-dimensional representation spaces. In this study, we investigate the structure and character of the manifolds generated by classical variational autoencoder (VAE) approaches and deep kernel learning (DKL). In the former case, the structure of the latent space is determined by the properties of the input data alone, while in the latter, the latent manifold forms as a result of an active learning process that balances the data distribution and target functionalities. We show that DKL with active learning can produce a more compact and smooth latent space which is more conducive to optimization compared to previously reported methods, such as the VAE. We demonstrate this behavior using a simple cards data set and extend it to the optimization of domain-generated trajectories in physical systems. Our findings suggest that latent manifolds constructed through active learning have a more beneficial structure for optimization problems, especially in feature-rich target-poor scenarios that are common in domain sciences, such as materials synthesis, energy storage, and molecular discovery. The jupyter notebooks that encapsulate the complete analysis accompany the article., Comment: 8 Figures, 26 pages

Reducing the dimensions of ferroelectric materials down to the nanoscale has strong implications on the ferroelectric polarization pattern and on the ability to switch the polarization. As the size of ferroelectric domains shrinks to nanometer scale, the heterogeneity of the polarization pattern becomes increasingly pronounced, enabling a large variety of possible polar textures in nanocrystalline and nanocomposite materials. Critical to the understanding of fundamental physics of such materials and hence their applications in electronic nanodevices, is the ability to investigate their ferroelectric polarization at the nanoscale in a non-destructive way. We show that contact Kelvin probe force microscopy (cKPFM) combined with a k-means response clustering algorithm enables to measure the ferroelectric response at a mapping resolution of 8 nm. In a BaTiO3 thin film on silicon composed of tetragonal and hexagonal nanocrystals, we determine a nanoscale lateral distribution of discrete ferroelectric response clusters, fully consistent with the nanostructure determined by transmission electron microscopy. Moreover, we apply this data clustering method to the cKPFM responses measured at different temperatures, which allows us to follow the corresponding change in polarization pattern as the Curie temperature is approached and across the phase transition. This work opens up perspectives for mapping complex ferroelectric polarization textures such as curled/swirled polar textures that can be stabilized in epitaxial heterostructures and more generally mapping the polar domain distribution of any spatially-highly-heterogeneous ferroelectric materials.

Experimental science is enabled by the combination of synthesis, imaging, and functional characterization. Synthesis of a new material is typically followed by a set of characterization methods aiming to provide feedback for optimization or discover fundamental mechanisms. However, the sequence of synthesis and characterization methods and their interpretation, or research workflow, has traditionally been driven by human intuition and is highly domain specific. Here we explore concepts of scientific workflows that emerge at the interface between theory, characterization, and imaging. We discuss the criteria by which these workflows can be constructed for special cases of multi-resolution structural imaging and structural and functional characterization. Some considerations for theory-experiment workflows are provided. We further pose that the emergence of user facilities and cloud labs disrupt the classical progression from ideation, orchestration, and execution stages of workflow development and necessitate development of universal frameworks for workflow design, including universal hyper-languages describing laboratory operation, reward functions and their integration between domains, and policy development for workflow optimization. These tools will enable knowledge-based workflow optimization, enable lateral instrumental networks, sequential and parallel orchestration of characterization between dissimilar facilities, and empower distributed research., Comment: 33 pages; 8 figures

Electronic transport and hysteresis in metal halide perovskites (MHPs) are key to the applications in photovoltaics, light emitting devices, and light and chemical sensors. These phenomena are strongly affected by the materials microstructure including grain boundaries, ferroic domain walls, and secondary phase inclusions. Here, we demonstrate an active machine learning framework for 'driving' an automated scanning probe microscope (SPM) to discover the microstructures responsible for specific aspects of transport behavior in MHPs. In our setup, the microscope can discover the microstructural elements that maximize the onset of conduction, hysteresis, or any other characteristic that can be derived from a set of current-voltage spectra. This approach opens new opportunities for exploring the origins of materials functionality in complex materials by SPM and can be integrated with other characterization techniques either before (prior knowledge) or after (identification of locations of interest for detail studies) functional probing., Comment: 19 pages; 7 figures

The advent of modern, high-speed electron detectors has made the collection of multidimensional hyperspectral transmission electron microscopy datasets, such as 4D-STEM, a routine. However, many microscopists find such experiments daunting since such datasets' analysis, collection, long-term storage, and networking remain challenging. Some common issues are the large and unwieldy size of the said datasets, often running into several gigabytes, non-standardized data analysis routines, and a lack of clarity about the computing and network resources needed to utilize the electron microscope fully. However, the existing computing and networking bottlenecks introduce significant penalties in each step of these experiments, and thus, real-time analysis-driven automated experimentation for multidimensional TEM is exceptionally challenging. One solution is integrating microscopy with edge computing, where moderately powerful computational hardware performs the preliminary analysis before handing off the heavier computation to HPC systems. In this perspective, we trace the roots of computation in modern electron microscopy, demonstrate deep learning experiments running on an edge system, and discuss the networking requirements for tying together microscopes, edge computers, and HPC systems., Comment: Perspective on automated microscopy. 3 figures

We report the development and experimental implementation of the automated experiment workflows for the identification of the best predictive channel for a phenomenon of interest in spectroscopic measurements. The approach is based on the combination of ensembled deep kernel learning for probabilistic predictions and a basic reinforcement learning policy for channel selection. It allows the identification of which of the available observational channels, sampled sequentially, are most predictive of selected behaviors, and hence have the strongest correlations. We implement this approach for multimodal imaging in Piezoresponse Force Microscopy (PFM), with the behaviors of interest manifesting in piezoresponse spectroscopy. We illustrate the best predictive channel for polarization-voltage hysteresis loop and frequency-voltage hysteresis loop areas is amplitude in the model samples. The same workflow and code are universal and applicable for any multimodal imaging and local characterization methods., Comment: 17 pages, 5 figures

We develop and implement an automated experiment in multimodal imaging to probe structural, chemical, and functional behaviors in complex materials and elucidate the dominant physical mechanisms that control device function. Here the emergence of non-linear electromechanical responses in piezoresponse force microscopy (PFM) is explored. Non-linear responses in PFM can originate from multiple mechanisms, including intrinsic material responses often controlled by domain structure, surface topography that affects the mechanical phenomena at the tip-surface junction, and, potentially, the presence of surface contaminants. Using an automated experiment to probe the origins of non-linear behavior in model ferroelectric lead titanate (PTO) and ferroelectric Al0.93B0.07N films, it was found that PTO showed asymmetric nonlinear behavior across a/c domain walls and a broadened high nonlinear response region around c/c domain walls. In contrast, for Al0.93B0.07N, well-poled regions showed high linear piezoelectric responses paired with low non-linear responses and regions that were multidomain indicated low linear responses and high nonlinear responses. We show that formulating dissimilar exploration strategies in deep kernel learning as alternative hypotheses allows for establishing the preponderant physical mechanisms behind the non-linear behaviors, suggesting that this approach automated experiments can potentially discern between competing physical mechanisms. This technique can also be extended to electron, probe, and chemical imaging., Comment: 18 pages, 5 figures

Automated chemical synthesis, materials fabrication, and spectroscopic physical measurements often bring forth the challenge of process trajectory optimization, i.e., discovering the time dependence of temperature, electric field, or pressure that gives rise to optimal properties. Due to the high dimensionality of the corresponding vectors, these problems are not directly amenable to Bayesian Optimization (BO). Here we propose an approach based on the combination of the generative statistical models, specifically variational autoencoders, and Bayesian optimization. Here, the set of potential trajectories is formed based on best practices in the field, domain intuition, or human expertise. The variational autoencoder is used to encode the thus generated trajectories as a latent vector, and also allows for the generation of trajectories via sampling from latent space. In this manner, Bayesian Optimization of the process is realized in the latent space of the system, reducing the problem to a low-dimensional one. Here we apply this approach to a ferroelectric lattice model and demonstrate that this approach allows discovering the field trajectories that maximize curl in the system. The analysis of the corresponding polarization and curl distributions allows the relevant physical mechanisms to be decoded., Comment: 22 pages and 9 figures

The design of materials structure for optimizing functional properties and potentially, the discovery of novel behaviors is a keystone problem in materials science. In many cases microstructural models underpinning materials functionality are available and well understood. However, optimization of average properties via microstructural engineering often leads to combinatorically intractable problems. Here, we explore the use of the reinforcement learning (RL) for microstructure optimization targeting the discovery of the physical mechanisms behind enhanced functionalities. We illustrate that RL can provide insights into the mechanisms driving properties of interest in a 2D discrete Landau ferroelectrics simulator. Intriguingly, we find that non-trivial phenomena emerge if the rewards are assigned to favor physically impossible tasks, which we illustrate through rewarding RL agents to rotate polarization vectors to energetically unfavorable positions. We further find that strategies to induce polarization curl can be non-intuitive, based on analysis of learned agent policies. This study suggests that RL is a promising machine learning method for material design optimization tasks, and for better understanding the dynamics of microstructural simulations., Comment: 5 figures

Emergent functionalities of structural and topological defects in ferroelectric materials underpin an extremely broad spectrum of applications ranging from domain wall electronics to high dielectric and electromechanical responses. Many of these have been discovered and quantified via local scanning probe microscopy methods. However, the search for these functionalities has until now been based by either trial and error or using auxiliary information such as topography or domain wall structure to identify potential objects of interest based on the intuition of operator or preexisting hypotheses, with subsequent manual exploration. Here, we report the development and implementation of a machine learning framework that actively discovers relationships between local domain structure and polarization switching characteristics in ferroelectric materials encoded in the hysteresis loop. The latter and descriptors such as nucleation bias, coercive bias, hysteresis loop area, or more complex functionals of hysteresis loop shape and corresponding uncertainties are used to guide the discovery via automated piezoresponse force microscopy (PFM) and spectroscopy experiments. As such, this approach combines the power of machine learning methods to learn the correlative relationships between high dimensional data, and human-based physics insights encoded in the acquisition function. For ferroelectric, this automated workflow demonstrates that the discovery path and sampling points of on-field and off-field hysteresis loops are largely different, indicating the on-field and off-field hysteresis loops are dominated by different mechanisms. The proposed approach is universal and can be applied to a broad range of modern imaging and spectroscopy methods ranging from other scanning probe microscopy modalities to electron microscopy and chemical imaging., Comment: 23 pages, 6 figures

Scanning transmission electron microscopy (STEM) is now the primary tool for exploring functional materials on the atomic level. Often, features of interest are highly localized in specific regions in the material, such as ferroelectric domain walls, extended defects, or second phase inclusions. Selecting regions to image for structural and chemical discovery via atomically resolved imaging has traditionally proceeded via human operators making semi-informed judgements on sampling locations and parameters. Recent efforts at automation for structural and physical discovery have pointed towards the use of "active learning" methods that utilize Bayesian optimization with surrogate models to quickly find relevant regions of interest. Yet despite the potential importance of this direction, there is a general lack of certainty in selecting relevant control algorithms and how to balance a priori knowledge of the material system with knowledge derived during experimentation. Here we address this gap by developing the automated experiment workflows with several combinations to both illustrate the effects of these choices and demonstrate the tradeoffs associated with each in terms of accuracy, robustness, and susceptibility to hyperparameters for structural discovery. We discuss possible methods to build descriptors using the raw image data and deep learning based semantic segmentation, as well as the implementation of variational autoencoder based representation. Furthermore, each workflow is applied to a range of feature sizes including NiO pillars within a La:SrMnO$_3$ matrix, ferroelectric domains in BiFeO$_3$, and topological defects in graphene. The code developed in this manuscript are open sourced and will be released at github.com/creangnc/AE_Workflows., Comment: 18 pages, 8 figures, manuscript being submitted to MLST

Atom-by-atom assembly of functional materials and devices is perceived as one of the ultimate targets of nanoscience and nanotechnology. While traditionally implemented via scanning probe microscopy techniques, recently it has been shown that the beam of a scanning transmission electron microscope can be used for targeted manipulation of individual atoms. However, the process is highly dynamic in nature and proceeds via a large number of weakly-understood individual steps. Hence, harnessing an electron beam towards atomic assembly requires automated methods to control the parameters and positioning of the beam in such a way as to fabricate atomic-scale structures reliably. Here, we create a molecular dynamics environment wherein individual atom velocities can be modified, effectively simulating a beam-induced interaction, and apply reinforcement learning to model construction of specific atomic units consisting of Si dopant atoms on a graphene lattice. We find that it is possible to engineer the reward function of the agent in such a way as to encourage formation of local clusters of dopants, whilst at the same time minimizing the amplitude of momentum changes. Inspection of the learned policies indicates that of fundamental importance is the component of velocity perpendicular to the material plane, and further, that the high stochasticity of the environment leads to conservative policies. This study shows the potential for reinforcement learning agents trained in simulated environments for potential use as atomic scale fabricators, and further, that the dynamics learned by agents encode specific elements of important physics that can be learned., Comment: 17 pages, 5 figures

A shift-invariant variational autoencoder (shift-VAE) is developed as an unsupervised method for the analysis of spectral data in the presence of shifts along the parameter axis, disentangling the physically-relevant shifts from other latent variables. Using synthetic data sets, we show that the shift-VAE latent variables closely match the ground truth parameters. The shift VAE is extended towards the analysis of band-excitation piezoresponse force microscopy (BE-PFM) data, disentangling the resonance frequency shifts from the peak shape parameters in a model-free unsupervised manner. The extensions of this approach towards denoising of data and model-free dimensionality reduction in imaging and spectroscopic data are further demonstrated. This approach is universal and can also be extended to analysis of X-ray diffraction, photoluminescence, Raman spectra, and other data sets., Comment: 17 pages, 7 figures

Machine learning and artificial intelligence (ML/AI) are rapidly becoming an indispensable part of physics research, with domain applications ranging from theory and materials prediction to high-throughput data analysis. In parallel, the recent successes in applying ML/AI methods for autonomous systems from robotics through self-driving cars to organic and inorganic synthesis are generating enthusiasm for the potential of these techniques to enable automated and autonomous experiment (AE) in imaging. Here, we aim to analyze the major pathways towards AE in imaging methods with sequential image formation mechanisms, focusing on scanning probe microscopy (SPM) and (scanning) transmission electron microscopy ((S)TEM). We argue that automated experiments should necessarily be discussed in a broader context of the general domain knowledge that both informs the experiment and is increased as the result of the experiment. As such, this analysis should explore the human and ML/AI roles prior to and during the experiment, and consider the latencies, biases, and knowledge priors of the decision-making process. Similarly, such discussion should include the limitations of the existing imaging systems, including intrinsic latencies, non-idealities and drifts comprising both correctable and stochastic components. We further pose that the role of the AE in microscopy is not the exclusion of human operators (as is the case for autonomous driving), but rather automation of routine operations such as microscope tuning, etc., prior to the experiment, and conversion of low latency decision making processes on the time scale spanning from image acquisition to human-level high-order experiment planning.

Piezoelectrics interconvert mechanical energy and electric charge and are widely used in actuators and sensors. The best performing materials are ferroelectrics at a morphotropic phase boundary (MPB), where several phases can intimately coexist. Switching between these phases by electric field produces a large electromechanical response. In the ferroelectric BiFeO$_3$, strain can be used to create an MPB-like phase mixture and thus to generate large electric field dependent strains. However, this enhanced response occurs at localized, randomly positioned regions of the film, which potentially complicates nanodevice design. Here, we use epitaxial strain and orientation engineering in tandem - anisotropic epitaxy - to craft a hitherto unavailable low-symmetry phase of BiFeO$_3$ which acts as a structural bridge between the rhombohedral-like and tetragonal-like polymorphs. Interferometric displacement sensor measurements and first-principle calculations reveal that under external electric bias, this phase undergoes a transition to the tetragonal-like polymorph, generating a piezoelectric response enhanced by over 200%, and associated giant field-induced reversible strain. These results offer a new route to engineer giant electromechanical properties in thin films, with broader perspectives for other functional oxide systems., Comment: 20 pages, 4 figures

The advent of high-resolution electron and scanning probe microscopy imaging has opened the floodgates for acquiring atomically resolved images of bulk materials, 2D materials, and surfaces. This plethora of data contains an immense volume of information on materials structures, structural distortions, and physical functionalities. Harnessing this knowledge regarding local physical phenomena necessitates the development of the mathematical frameworks for extraction of relevant information. However, the analysis of atomically resolved images is often based on the adaptation of concepts from macroscopic physics, notably translational and point group symmetries and symmetry lowering phenomena. Here, we explore the bottom-up definition of structural units and symmetry in atomically resolved data using a Bayesian framework. We demonstrate the need for a Bayesian definition of symmetry using a simple toy model and demonstrate how this definition can be extended to the experimental data using deep learning networks in a Bayesian setting, namely rotationally invariant variational autoencoders., Comment: Combined Paper and Supplementary Information. 40 pages. 8 Figures plus 12 Supplementary figures

Polarization dynamics in ferroelectric materials are explored via the automated experiment in Piezoresponse Force Spectroscopy. A Bayesian Optimization framework for imaging is developed and its performance for a variety of acquisition and pathfinding functions is explored using previously acquired data. The optimized algorithm is then deployed on an operational scanning probe microscope (SPM) for finding areas of large electromechanical response in a thin film of PbTiO3, with metrics showing gains of ~3x in the sampling efficiency. This approach opens the pathway to perform more complex spectroscopies in SPM that were previously not possible due to time constraints and sample stability, tip wear, and/or stochastic sample damage that occurs at specific, a priori unknown spatial positions. Potential improvements to the framework to enable the incorporation of more prior information and improve efficiency further are discussed.

Atomic-scale materials synthesis via layer deposition techniques present a unique opportunity to control material structures and yield systems that display unique functional properties that cannot be stabilized using traditional bulk synthetic routes. However, the deposition process itself presents a large, multidimensional space that is traditionally optimized via intuition and trial and error, slowing down progress. Here, we present an application of deep reinforcement learning to a simulated materials synthesis problem, utilizing the Stein variational policy gradient (SVPG) approach to train multiple agents to optimize a stochastic policy to yield desired functional properties. Our contributions are (1) A fully open source simulation environment for layered materials synthesis problems, utilizing a kinetic Monte-Carlo engine and implemented in the OpenAI Gym framework, (2) Extension of the Stein variational policy gradient approach to deal with both image and tabular input, and (3) Developing a parallel (synchronous) implementation of SVPG using Horovod, distributing multiple agents across GPUs and individual simulation environments on CPUs. We demonstrate the utility of this approach in optimizing for a material surface characteristic, surface roughness, and explore the strategies used by the agents as compared with a traditional actor-critic (A2C) baseline. Further, we find that SVPG stabilizes the training process over traditional A2C. Such trained agents can be useful to a variety of atomic-scale deposition techniques, including pulsed laser deposition and molecular beam epitaxy, if the implementation challenges are addressed., Comment: 3 figures

Traditionally, phase transitions are explored using a combination of macroscopic functional characterization and scattering techniques, providing insight into average properties and symmetries of the lattice but local atomic level mechanisms during phase transitions generally remain unknown. Here we explore the mechanisms of a phase transition between the trigonal prismatic and distorted octahedral phases of layered chalogenides in the MoS2 ReS2 system from the observations of local degrees of freedom, namely atomic positions by Scanning Transmission Electron Microscopy (STEM). We employ local crystallographic analysis based on machine learning of atomic environments to build a picture of the transition from the atomic level up and determine local and global variables controlling the local symmetry breaking. In particular, we argue that the dependence of the average symmetry breaking distortion amplitude on global and local concentration can be used to separate local chemical and global electronic effects on transition. This approach allows exploring atomic mechanisms beyond the traditional macroscopic descriptions, utilizing the imaging of compositional fluctuations in solids to explore phase transitions over a range of realized and observed local stoichiometries and atomic configurations., Comment: 5 figures, 20 pages including supplementary

Polarization switching mechanisms in ferroelectric materials are fundamentally linked to local domain structure and presence of the structural defects, which both can act as nucleation and pinning centers and create local electrostatic and mechanical depolarization fields affecting wall dynamics. However, the general correlative mechanisms between domain structure and polarization dynamics are only weakly explored, precluding insight into the associated physical mechanisms. Here, the correlation between local domain structures and switching behavior in ferroelectric materials is explored using the convolutional encoder-decoder networks, enabling the image to spectral (im2spec) and spectral to image (spec2im) translations via encoding latent variables. The latter reflects the assumption that the relationship between domain structure and polarization switching is parsimonious, i.e. is based upon a small number of local mechanisms. The analysis of latent variables distributions and their real space representations provides insight into the predictability of the local switching behavior, and hence associated physical mechanisms. We further pose that the regions where these correlative relationships are violated, i.e. predictability of the polarization dynamics from domain structure is reduced, represent the obvious target for detailed studies, e.g. in the context of automated experiments. This approach provides a workflow to establish the presence of correlation between local spectral responses and local structure and can be universally applied to spectral imaging techniques such as PFM, scanning tunneling microscopy (STM) and spectroscopy, and electron energy loss spectroscopy (EELS) in scanning transmission electron microscopy (STEM)., Comment: Upload accepted version

Advances in hyperspectral imaging modes including electron energy loss spectroscopy (EELS) in scanning transmission electron microscopy (STEM) bring forth the challenges of exploratory and subsequently physics-based analysis of multidimensional data sets. The (by now common) multivariate unsupervised linear unmixing methods and their nonlinear analogs generally explore similarities in the energy dimension but ignore correlations in the spatial domain. At the same time, Gaussian process (GP) methods that explicitly incorporate spatial correlations in the form of kernel functions tend to be extremely computationally intensive, while the use of inducing point-based sparse methods often leads to reconstruction artefacts. Here, we suggest and implement a parallel GP method operating on the full spatial domain and reduced representations in the energy domain. In this parallel GP, the information between the components is shared via a common spatial kernel structure while allowing for variability in the relative noise magnitude or image morphology. We explore the role of common spatial structures and kernel constraints on the quality of the reconstruction and suggest an approach for estimating these factors from the experimental data. Application of this method to an example EELS dataset demonstrates that spatial information contained in higher-order components can be reconstructed and spatially localized. This approach can be further applied to other hyperspectral and multimodal imaging modes. The notebooks developed in this manuscript are freely available as part of a GPim package (https://github.com/ziatdinovmax/GPim).

Deep neural networks ("deep learning") have emerged as a technology of choice to tackle problems in natural language processing, computer vision, speech recognition and gameplay, and in just a few years has led to superhuman level performance and ushered in a new wave of "AI." Buoyed by these successes, researchers in the physical sciences have made steady progress in incorporating deep learning into their respective domains. However, such adoption brings substantial challenges that need to be recognized and confronted. Here, we discuss both opportunities and roadblocks to implementation of deep learning within materials science, focusing on the relationship between correlative nature of machine learning and causal hypothesis driven nature of physical sciences. We argue that deep learning and AI are now well positioned to revolutionize fields where causal links are known, as is the case for applications in theory. When confounding factors are frozen or change only weakly, this leaves open the pathway for effective deep learning solutions in experimental domains. Similarly, these methods offer a pathway towards understanding the physics of real-world systems, either via deriving reduced representations, deducing algorithmic complexity, or recovering generative physical models. However, extending deep learning and "AI" for models with unclear causal relationship can produce misleading and potentially incorrect results. Here, we argue the broad adoption of Bayesian methods incorporating prior knowledge, development of DL solutions with incorporated physical constraints, and ultimately adoption of causal models, offers a path forward for fundamental and applied research. Most notably, while these advances can change the way science is carried out in ways we cannot imagine, machine learning is not going to substitute science any time soon., Comment: 3 figures, 12 pages

Advances in predictive modeling across multiple disciplines have yielded generative models capable of high veracity in predicting macroscopic functional responses of materials. Correspondingly, of interest is the inverse problem of finding the model parameter that will yield desired macroscopic responses, such as stress-strain curves, ferroelectric hysteresis loops, etc. Here we suggest and implement a Gaussian Process based methods that allow to effectively sample the degenerate parameter space of a complex non-local model to output regions of parameter space which yield desired functionalities. We discuss the specific adaptation of the acquisition function and sampling function to make the process efficient and balance the efficient exploration of parameter space for multiple possible minima and exploitation to densely sample the regions of interest where target behaviors are optimized. This approach is illustrated via the hysteresis loop engineering in ferroelectric materials, but can be adapted to other functionalities and generative models. The code is open-sourced and available at [github.com/ramav87/Ferrosim]., Comment: Update title to match the journal one

Fast scanning probe microscopy enabled via machine learning allows for a broad range of nanoscale, temporally resolved physics to be uncovered. However, such examples for functional imaging are few in number. Here, using piezoresponse force microscopy (PFM) as a model application, we demonstrate a factor of 5.8 improvement in imaging rate using a combination of sparse spiral scanning with compressive sensing and Gaussian processing reconstruction. It is found that even extremely sparse scans offer strong reconstructions with less than 6 % error for Gaussian processing reconstructions. Further, we analyze the error associated with each reconstructive technique per reconstruction iteration finding the error is similar past approximately 15 iterations, while at initial iterations Gaussian processing outperforms compressive sensing. This study highlights the capabilities of reconstruction techniques when applied to sparse data, particularly sparse spiral PFM scans, with broad applications in scanning probe and electron microscopies.

The physics of ferroelectric domain walls is explored using the Bayesian inference analysis of atomically resolved STEM data. We demonstrate that domain wall profile shapes are ultimately sensitive to the nature of the order parameter in the material, including the functional form of Ginzburg-Landau-Devonshire expansion, and numerical value of the corresponding parameters. The preexisting materials knowledge naturally folds in the Bayesian framework in the form of prior distributions, with the different order parameters forming competing (or hierarchical) models. Here, we explore the physics of the ferroelectric domain walls in BiFeO3 using this method, and derive the posterior estimates of relevant parameters. More generally, this inference approach both allows learning materials physics from experimental data with associated uncertainty quantification, and establishing guidelines for instrumental development answering questions on what resolution and information limits are necessary for reliable observation of specific physical mechanisms of interest., Comment: Upload the accepted version

Statistical physics models ranging from simple lattice to complex quantum Hamiltonians are one of the mainstays of modern physics, that have allowed both decades of scientific discovery and provided a universal framework to understand a broad range of phenomena from alloying to frustrated and phase-separated materials to quantum systems. Traditionally, exploration of the phase diagrams corresponding to multidimensional parameter spaces of Hamiltonians was performed using a combination of basic physical principles, analytical approximations, and extensive numerical modeling. However, exploration of complex multidimensional parameter spaces is subject to the classic dimensionality problem, and the behaviors of interest concentrated on low dimensional manifolds can remain undiscovered. Here, we demonstrate that a combination of exploration and exploration-exploitation with Gaussian process modeling and Bayesian optimization allows effective exploration of the parameter space for lattice Hamiltonians, and effectively maps the regions at which specific macroscopic functionalities or local structures are maximized. We argue that this approach is general and can be further extended well beyond the lattice Hamiltonians to effectively explore parameter space of more complex off-lattice and dynamic models., Comment: Added GP exploration of a priori unknown Hamiltonian. Updated references

The predictability of a certain effect or phenomenon is often equated with the knowledge of relevant physical laws, typically understood as a functional or numerically derived relationship between the observations and known states of the system. Correspondingly, observations inconsistent with prior knowledge can be used to derive new knowledge on the nature of the system or indicate the presence of yet unknown mechanisms. Here we explore the applicability of Gaussian Processes (GP) to establish predictability and uncertainty of local behaviors from multimodal observations, providing an alternative to this classical paradigm. Using atomic-resolution Scanning Transmission Electron Microscopy (STEM) of multiferroic Sm-doped BiFeO3 across a broad composition range, we directly visualize the atomic structure and structural, physical, and chemical order parameter fields for the material. GP regression is used to establish the predictability of the local polarization field from different groups of parameters, including the adjacent polarization values and several combinations of physical and chemical descriptors, including lattice parameters, column intensities, etc. We observe that certain elements of microstructure including charged and uncharged domain walls and interfaces with the substrate are best predicted with specific combinations of descriptors, and this predictability and their associated uncertainties are consistent across the composition series. The associated generative physical mechanisms are discussed. We argue that predictability and uncertainty in observational data offers a new pathway to probe the physics of condensed matter systems from multimodal local observations., Comment: Update the accepted version

Interface structures in complex oxides remain one of the active areas of condensed matter physics research, largely enabled by recent advances in scanning transmission electron microscopy (STEM). Yet the nature of the STEM contrast in which the structure is projected along the given direction precludes separation of possible structural models. Here, we utilize deep convolutional neural networks (DCNN) trained on simulated 4D scanning transmission electron microscopy (STEM) datasets to predict structural descriptors of interfaces. We focus on the widely studied interface between LaAlO3 and SrTiO3, using dynamical diffraction theory and leveraging high performance computing to simulate thousands of possible 4D STEM datasets to train the DCNN to learn properties of the underlying structures on which the simulations are based. We validate the DCNN on simulated data and show that it is possible (with >95% accuracy) to identify a physically rough from a chemically diffuse interface and achieve 85% accuracy in determination of buried step positions within the interface. The method shown here is general and can be applied for any inverse imaging problem where forward models are present., Comment: 18 pages, 4 figures

The universal tendency in scanning probe microscopy (SPM) over the last two decades is to transition from simple 2D imaging to complex detection and spectroscopic imaging modes. The emergence of complex SPM engines brings forth the challenge of reliable data interpretation, i.e. conversion from detected signal to descriptors specific to tip-surface interactions and subsequently to materials properties. Here, we implemented a Bayesian inference approach for the analysis of the image formation mechanisms in band excitation (BE) SPM. Compared to the point estimates in classical functional fit approaches, Bayesian inference allows for the incorporation of extant knowledge of materials and probe behavior in the form of corresponding prior distribution and return the information on the material functionality in the form of readily interpretable posterior distributions. We note that in application of Bayesian methods, special care should be made for proper setting on the problem as model selection vs. establishing practical parameter equivalence. We further explore the non-linear mechanical behaviors at topological defects in a classical ferroelectric material, PbTiO3. We observe the non-trivial evolution of Duffing resonance frequency and the nonlinearity of the sample surface, suggesting the presence of the hidden elements of domain structure. These observations suggest that the spectrum of anomalous behaviors at the ferroelectric domain walls can be significantly broader than previously believed and can extend to non-conventional mechanical properties in addition to static and microwave conductance., Comment: Supplementary materials is located at the end of the manuscript

Imaging mechanisms in contact Kelvin Probe Force Microscopy (cKPFM) are explored via information theory-based methods. Gaussian Processes are used to achieve super-resolution in the cKPFM signal, effectively extrapolating across the spatial and parameter space. Tensor matrix factorization is applied to reduce the multidimensional signal to the tensor convolution of the scalar functions that show clear trending behavior with the imaging parameters. These methods establish a workflow for the analysis of the multidimensional data sets, that can then be related to the relevant physical mechanisms. We also provide an interactive Google Colab notebook (http://bit.ly/39kMtuR) that goes through all the analysis discussed in the paper., Comment: Update with accepted version

The emergence of scanning probe and electron beam imaging techniques have allowed quantitative studies of atomic structure and minute details of electronic and vibrational structure on the level of individual atomic units. These microscopic descriptors in turn can be associated with the local symmetry breaking phenomena, representing stochastic manifestation of underpinning generative physical model. Here, we explore the reconstruction of exchange integrals in the Hamiltonian for the lattice model with two competing interactions from the observations of the microscopic degrees of freedom and establish the uncertainties and reliability of such analysis in a broad parameter-temperature space. As an ancillary task, we develop a machine learning approach based on histogram clustering to predict phase diagrams efficiently using a reduced descriptor space. We further demonstrate that reconstruction is possible well above the phase transition and in the regions of the parameter space when the macroscopic ground state of the system is poorly defined due to frustrated interactions. This suggests that this approach can be applied to the traditionally complex problems of condensed matter physics such as ferroelectric relaxors and morphotropic phase boundary systems, spin and cluster glasses, quantum systems once the local descriptors linked to the relevant physical behaviors are known., Comment: 20 pages and 9 figures

Domains walls and topological defects in ferroelectric materials have emerged as a powerful new paradigm for functional electronic devices including memory and logic. Similarly, wall interactions and dynamics underpin a broad range of mesoscale phenomena ranging from giant electromechanical responses to memory effects. Exploring the functionalities of individual domain walls, their interactions, and controlled modifications of the domain structures is crucial for applications and fundamental physical studies. However, the dynamic nature of these features severely limits studies of their local physics since application of local biases or pressures in piezoresponse force microscopy induce wall displacement as a primary response. Here, we introduce a fundamentally new approach for the control and modification of domain structures based on automated experimentation whereby real space image-based feedback is used to control the tip bias during ferroelectric switching, allowing for modification routes conditioned on domain states under the tip. This automated experiment approach is demonstrated for the exploration of domain wall dynamics and creation of metastable phases with large electromechanical response.