Search

Crew time in space is precious – every hour could yield immense scientific discoveries and exploration milestones. However, overhead tasks such as logistics, maintenance, and assembly take a large portion of crew time. Remotely operated robotics capabilities offer a way to free the crew from many overhead tasks, but operating mobile dexterous robots in human-centered environments presents many unknowns and challenges for potential technology providers, limiting adoption for flight missions. iMETRO is a NASA JSC robotics test facility for terrestrial robotic technology adaptation to space exploration use cases, including logistics, maintenance, and science utilization. iMETRO focuses on Intra-Vehicular (IVA) environments, such as surface habitats, pressurized rover cabins, and space station modules (both Gateway & LEO). Its goal is to advance the Technology Readiness Levels (TRL) of integrated technologies for missions requiring remote space robotics operations.

This research and development project leverages generative-AI to assist in the generation of software process documentation based on NASA standards. By utilizing fine-tuned AI models, the proposed system will analyze NASA's software guidelines, helping to translate them into well-structured, compliant process documents. This assistance can reduce the manual effort required to produce such documentation, enhance consistency, and assure alignment with NASA's stringent software development and operational requirements. In addition to assisting in the generation of software process documentation, the project explores how generative-AI can help create audit checklists as well as assess the compliance of NASA provider documentation against applicable NASA standards. This approach would support the compliance auditing process, providing real-time insights and assessments. The intended result will be a streamlined process, potentially including a Python-based tool and database, that improves audit efficiency, reduces human error, lowers manpower costs and required manhours, and assures continuous compliance with NASA and industry evolving standards for safety-critical software development. Future task might be to investigate the software industry approach and standards for potential collaboration.

Performance of medical procedures in spaceflight beyond low Earth orbit (LEO) requires novel solutions to replace real-time ground support because as distance from Earth increases, communication latencies increase, hampering remote guidance. The Autonomous Medical Officer Support Software (AMOS) Technology Demonstrations on the International Space Station (ISS) trialed a novel software tool that shifts the emphasis from preflight training and real-time remote guidance (current ISS paradigm) to a new standard of multi-dimensional in-flight just-in-time (JIT) instruction. The AMOS platform is a skill management tool for all mission phases and currently features comprehensive training and guidance modules for urinary bladder and renal ultrasound examinations. Variability in Subject anatomy, Operator experience, and Operator receptiveness to instruction during autonomous exams are persistent but manageable limitations. Here we report the first successful demonstrations of autonomous imaging activities in the operational setting of spaceflight, validating this autonomous guidance proof of concept.

Deep learning-based methods have been widely researched in the areas of language and vision, demonstrating their capacity to understand long sequences of data and their usefulness in numerous helio-physics applications. Foundation models (FMs), which are pre-trained on a large-scale datasets, form the basis fora variety of downstream tasks. These models, especially those based on trans-formers in vision and language, show exceptional potential for adapting to a wide range of downstream applications. In this paper, we provide our perspective on the criteria for designing a FM for heliophysic and associated challenges and applications using the Solar Dynamics Observatory (SDO) dataset. We believe that this is the first study to design a foundation model in the domain of heliophysics.

This video is a mov video with a run time of 3 min. 39 sec.; color, with sound.

A video demonstrating a Pressurized Rover (PR) robotic logistics scenario utilizing Intra-Vehicular Robotics (IVR) hardware and software in the Integrated Mobile Evaluation Testbed for Robotics Operations (iMETRO) lab.

An overview of the UAM chatbot application.

Time lapse of the Tall Lunar Tower (TLT) Ground EDU Demonstration performed at the Langley Research Center. The demonstration focused on using commercial off-the-shelf robotic manipulator arms with specialized end-effectors to place and join components in a jigging and lifting frame. The frame allows the assembly of a tower by the 6 degree-of-freedom manipulator arms in a work cell configuration by lifting the completed tower segments upward to allow new tower segments to be appended to the bottom of the structure. The demonstration took place from September 28th to 30th 2023.

A video that provides an automated tool grasp industrial scenario for the NASA Valkyrie Robot from the NASA Dexterous Robotics Team. The scenario is where the Valkyrie uses externally mounted sensors and tools to investigate a room for objects of interest and removes any hazards. Video running time is 4 min., 56 sec.; in color with no sound.

An aspiration for EIMO datascope is to realize artificial intelligence-enhanced solutions for analysis of crew health & performance data and to facilitate clinical decision support for autonomous medical operations. A vision proposed to the meeting participants was that of a “system of systems,” whereby EIMO will utilize AI-supported natural language processing and machine learning techniques to synthesize embedded reference databases and real-time data streams [input vectors] from multiple data sources to continuously and seamlessly assess crew health & performance. Constituent input vectors may include environmental controls, countermeasures data, behavioral data, physiologic wearables, point-of-care laboratory tests, personalized medical records, inventory trade space risk assessments, COTS medical databases, and ground support inputs. An ideal AI capability would possess trained fusion algorithms to cross reference input vectors with medical ‘knowledge’ [cultivated database] to stratify relevant data streams for predictive and actionable capabilities. In addition, EIMO will ideally have a degree of mobility, in that it can be accessed and can push/pull data within and between multiple vehicles/habitats.

Autonomous systems are being used in a multitude of areas at an increasing rate and require a high level of adaptivity and intelligence to operate safely, especially under faulty conditions. This paper introduces a novel genetic algorithm tailored for UAV trajectory replanning, with an improved execution time via search space reduction based on the operating conditions of the UAV and its remaining mission. A unique characteristic of the replanning agent is its fast-start and adaptive properties, pre-seeding candidates with partial solutions and dynamically tuning elitism, crossover, and mutation rates in correspondence to the average fitness and diversity of the population. A population restart mechanism and early stopping mechanism are evaluated as well to assess their effect on solution quality and runtime. Previous work on genetic algorithms for UAV replanning were conducted with short trajectories in a small state space. Our UAV operates in a 56,000 square meter simulated urban environment, with static obstacles and a total of 53 possible waypoints. The agent increases the safety and reliability of UAV autonomy when operating under faulty conditions and when replanning is required.

Data flows and storage/retrieval capacity are severely constrained during missions in space and challenges will become even greater during exploration class missions. There is a need for an artificial intelligence (AI)-based clinical decision support system (CDSS) to monitor and analyze data to provide real-time consultative support for crew medical officer (CMO) decision-making. EIMO is defined as the gradual transition of medical care and decision making from terrestrial to space-based assets, enabling support of astronaut health and performance and reducing overall mission risk. While a hallmark of this paradigm shift from low-earth orbit is that on-board care will increasingly become the responsibility of the astronauts for primary management and decision making, terrestrial assets will continue to be paramount in pre-mission screening and planning, as well as prevention, health maintenance and long-term care contingencies. New capabilities and systems that enable progressively more robust and resilient systems and crews will be necessary to reduce risk and increase probability of deep space exploration mission success. An aspiration for EIMO is to develop AI-enhanced solutions for analysis of crew health & performance data and to facilitate clinical decision support for autonomous medical operations. A “system of systems” approach is envisioned whereby EIMO will deploy AI-supported natural language processing and machine learning (ML) techniques to utilize embedded reference databases and real-time data streams [input vectors] from multiple data sources. Constituent input vectors may include environmental controls, countermeasures data, behavioral data, physiologic wearables, point-of-care laboratory tests, personalized medical records, inventory trade space risk assessments, COTS medical databases, and ground support inputs. An ideal AI capability would possess trained fusion algorithms to cross reference input vectors with medical ‘knowledge’ [cultivated database] to stratify relevant data streams for predictive and actionable capabilities. In addition, EIMO will feature mobility, in that it can be accessed and can push/pull data within and between multiple vehicles/habitats. Large amounts and variable sources of data can be leveraged to diagnose, inform treatment strategies, and potentially predict medical events and performance decrements. Inclusion of advanced training tools using extended reality will enable increasingly autonomous medical care to aid a CMO when ground support is unavailable or time-delayed beyond required action window, e.g., emergent medical situations. EIMO CDSS would require very large datasets to train pre-flight and significant amounts of data are needed to support ML via in-flight CDSS operations. An additional challenge will be to find sufficient data to train a model relevant to astronaut demographics. The rapid, accelerating evolution of this field creates a propitious solution space to leverage multi-modal AI through public-private partnership(s). The status of multi-modal AI systems today would preclude their use for long duration missions as they remain unreliable and are subject to “digital hallucinations” and other errors that could pose operational risk. A federated labs structure is being considered to test and optimize data flow from the multiple input vectors leading to field testing in suitable ground/flight analogs. Critical to the success of an EIMO CDSS will be integration and interoperability and success will be defined by a system that can serve as an in-flight medical consult for the CMO providing critical support during medical contingencies. Benefits to terrestrial medicine may be significant as an outflow of the EIMO medical system, particularly for remote areas and communities lacking significant infrastructure, personnel and resources.

The MAGIK Robotic analysis team provides kinematic feasibility assessments for the ISS and has produced an animation to evaluate Extravehicular Robotics (EVR) activities for the SpaceX (SpX)-30 flight. Shown EVR activities are preliminary and final operations will be developed by Flight Operations Directorate (FOD) Robotics (ROBO). The animation also displays the current ISS configuration at the time of the flight. Flight SpX-30 includes a SpaceX Cargo Dragon vehicle docked to Node 2 Zenith (N2Z) International Docking Adapter (IDA) and consists of the delivery of the Pump Module (PM) Integrated Assembly (IA). Robotic operations shown include the Special Purpose Dexterous Manipulator (SPDM) based on the Space Station Remote Manipulator System (SSRMS) for Trunk extraction of the PM IA, maneuvering to the External Stowage Platform 3 (ESP-3), temporary removal of the Control Moment Gyro (CMG) from ESP-3 Site 4, install of the PM IA at ESP-3 Site 3 and re-install of the CMG to ESP-3 Site4. There is no disposal payload for this flight.

Gas turbine engines are designed with sufficient margin to prevent stall under normal operating conditions throughout their life. This compromise ensures that during rapid accelerations, compressor operation remains stable, but at the cost of efficiency and thrust responsiveness. The design margin encompasses multiple sources of uncertainty and systematic deviances from the operating line, the largest of which is the transient allowance. This set-aside accounts for the temporary incoordination of the engine spools during an acceleration while still enabling it to meet the certification requirement to accelerate from low to high power within a specified time, and without experiencing overtemperature, surge, stall, or other detrimental factors. Electrification of the powertrain provides the opportunity to address this reserve and truly optimize the design. The addition of electric machines inherent in hybrid propulsion concepts offers a means to interact with the engine shafts such that the necessary margin can be reduced, which can positively impact the engine design. By adjusting the amount of power extracted from or injected to the engine spools by the electric machines during transient operation, excursions from the operating line can be minimized. Past work using a dynamic engine model has shown that optimization of the fuel flow schedule during acceleration can reduce the required margin while still meeting the time requirement, and results are further improved when combined with power injection and extraction. The current work uses machine learning through a genetic algorithm to address the problem holistically by concurrently optimizing the electric machine power command and fuel flow acceleration schedule using an updated, higher fidelity version of the original engine model.

Versatile programmable materials have long been envisioned that can reconfigure themselves to adapt to changing use cases in adaptive infrastructure, space exploration, disaster response, and more. We introduce a robotic structural system as an implementation of programmable matter, with mechanical performance and scale on par with conventional high-performance materials and truss systems. Fiber reinforced composite truss-like building-blocks form strong, stiff, and lightweight lattice structures as mechanical metamaterials. Two types of mobile robots operate over the exterior surface and through the interior of the system, performing transport, placement, and reversible fastening using the intrinsic lattice periodicity for indexing and metrology. Leveraging programmable matter algorithms to achieve scalability in size and complexity, this system design enables robust collective automated assembly and reconfiguration of large structures with simple robots. We describe the system design and experimental results from a 256-unit cell assembly demonstration and lattice mechanical testing, as well as demonstration of disassembly and reconfiguration. The assembled structural lattice material exhibits ultra-light mass density (0.0103 g/cc) with high strength and stiffness for its weight (0.01117 MPa and 1.1129 MPa, respectively), a material performance realm appropriate for applications like space structures. With simple robots and structure, high mass-specific structural performance, and competitive throughput, this system demonstrates potential for self-reconfiguring autonomous metamaterials for diverse applications.

ChatGPT, a generative AI large language model, has recently captured significant attention in both the computer science community and the broader public domain. It has demonstrated a wide range of capabilities, from answering simple questions to writing fully functional computer code. This study spotlights both the capabilities and limitations of ChatGPT when addressing engineering problems. The model's capacity to generate practical engineering tools is highlighted through an example of a prompt that leads to an interactive plotting tool, enabling the examination of the fluid boundary layer around a fan blade. Subsequently, the paper also uncovers potential pitfalls in ChatGPT’s application, shown through an unsuccessful attempt to use ChatGPT to automate a process in Ansys Workbench through scripting. The research further investigates ChatGPT's proficiency in addressing inquiries and providing explanations about the functionalities of OpenMDAO, an open-source, multidisciplinary design, analysis, and optimization tool developed at NASA Glenn Research Center. Finally, an optimization methodology, developed with ChatGPT’s help, is applied to the structural optimization of a fan blade. The developed optimization method utilizes T-Blade3 for geometry generation, Ansys Mechanical for meshing and finite element analysis, and sci-kit learn’s MLPRegressor method to generate a trained neural network model of the design space. OpenMDAO is then used to find the optimal point within the design space. The outcome is a significant reduction in stress in the optimized model—less than one-fifth of the stress value in the baseline model.

This video provides a demonstration of an innovative headset by the Dexterous Robots team.

The DebriSat project is a collaboration effort with the NASA Orbital Debris Program Office, the U.S. Space Force Space Systems Command Center, The Aerospace Corporation, and the University of Florida. To date, over 200,000 fragments from this ground-based, hypervelocity impact experiment have been collected, and processing is underway to determine their physical characteristics, such as material, shape, color, characteristic length, and average cross-sectional area. The x-ray process is primarily used to identify the location of the fragments and estimated size for extraction, so that these physical characteristics can be assessed. This paper proposes a machine learning-based approach to characterize materials from x-ray images of debris fragments embedded in soft-catch foam used in the DebriSat project. The novel methodology discussed in this paper will highlight the use of x-ray imagery data to characterize these fragments without extraction or a human-in-the-loop. Both supervised and unsupervised machine learning techniques are utilized with this approach to infer the physical parameters of the fragments embedded in the soft-catch foam panels used in the impact experiment based on x-ray images of the foam panels. Additionally, 3D reconstructions of the extracted fragments are created with images taken from two different angles using the structure from motion (SfM) method. The characteristic lengths and shape from the 3D reconstruction, alongside the physical characteristics of the debris, are used in the inference of the material type. To develop and test the approach, a dataset of x-ray images of debris fragments of varying sizes and materials is collected. Supervised learning methods such as convolutional neural networks (CNNs), support vector machines (SVM), decision trees, and random forest classifiers are used due to the high-dimensional feature spaces of the debris and nonlinear decision boundaries for material categorization. Given the limited pre-labeled data of embedded debris materials smaller than 10 mm, unsupervised machine learning techniques such as clustering algorithms and autoencoders are used, in addition to supervised learning methods. The clustering algorithms group similar fragments together based on their physical properties, and autoencoders reduce the dimensionality of the x ray images and extract relevant features. The performance of the proposed approach's is analyzed using a range of statistical methods, including confusion matrices, receiver operating characteristic curves, and precision-recall curves. The results are compared with those obtained using a baseline approach that relies on manual identification and classification of debris fragments. To evaluate the effectiveness of different machine learning methods, statistical tests such as t-tests, ANOVA, and cross-validation are performed, comparing the performance of CNNs, SVMs, clustering algorithms, and autoencoders. Additional analysis needs to be conducted to identify any sources of bias or variability that may affect the results, such as variations in imaging conditions or fragmentation patterns. Other topics explored are limitations, refinements, and the potential use of semi-supervised learning techniques, such as self-training to label unlabeled datasets and co-training using x-ray images taken from two different angles as two different models.

We investigate a framework for binary image denoising via restricted Boltzmann machines (RBMs) that introduces a denoising objective in quadratic unconstrained binary optimization (QUBO) form and is well-suited for quantum annealing. The denoising objective is attained by balancing the distribution learned by a trained RBM with a penalty term for derivations from the noisy image. We derive the statistically optimal choice of the penalty parameter assuming the target distribution has been well-approximated, and further suggest an empirically supported modification to make the method robust to that idealistic assumption. We also show under additional assumptions that the denoised images attained by our method are, in expectation, strictly closer to the noise-free images than the noisy images are. While we frame the model as an image denoising model, it can be applied to any binary data. As the QUBO formulation is well-suited for implementation on quantum annealers, we test the model on a D-Wave Advantage machine, and also test on data too large for current quantum annealers by approximating QUBO solutions through classical heuristics.

The MAGIK Robotic analysis team provides kinematic feasibility assessments for the ISS and has produced an animation to evaluate Extravehicular Robotics (EVR) activities for the SpaceX (SpX)-29 flight. The animation also displays the current ISS configuration at the time of the flight. Flight SpX-29 includes a SpaceX Cargo Dragon vehicle docked to Node 2 Forward (N2F) International Docking Adapter (IDA) and consists of the delivery of AWE (Atmospheric Waves Experiment) and Integrated LCRD LEO User Modem Amplifier optical communications Terminal (ILLUMA-T). Robotic operations shown include the Special Purpose Dexterous Manipulator (SPDM) Trunk extraction of ILLUMA-T and maneuvering to the JEM RMS Handoff position, the SPDM Trunk extraction of AWE, maneuvering to Express Logistics Carrier (ELC) 1 Site 3 to remove Space Test Program - Houston 5 (STP-H5), and the installation of AWE to ELC-1 Site 3. There is no disposal payload for this flight.

Develop a software tool for planning uncrewed lunar surface operations that simulates illumination conditions on the surface and displays environmental data, such as temperature and induced plume effects, into an integrated lunar operational environment simulation that does not require high-end computing hardware. This prototype tool is a capability that fills a gap, and it does not compete with existing KSC/agency simulation/visualization tools.

As more lunar In-Situ Resource Utilization (ISRU) missions are planned and developed, a need was identified for a simulation environment with accurate regolith interaction mechanics that is less computationally expensive than commercially available multiphysics tools. The purpose of the Simulated Excavation Environment for Lunar Operations (SEELO) project was to develop an interactive simulation environment that efficiently models lunar ISRU excavation operations, including soil deformation, while running in faster-than-real-time.

The BLiSS: Cargo Management and Retrieval project is a submission to the NASA X-Hab challenge for an autonomous system of cargo storage and retrieval for use on the Lunar Gateway system. The system is designed to stow 5 tonnes of cargo within a capsule that has an internal diameter of 3.2 meters and height of 6 meters for cargo that will be up to 0.8 meters in any one dimension. The system will inventory all cargo items placed in each cargo container and then track the containers using RFID chips for autonomous stowage and retrieval upon request by on-station crew.

As the space economy continues to expand through increasingly easy access to advanced and inexpensive technology, space missions themselves have become more ambitious with exploration targets growing ever distant while simultaneously requiring larger guidance and communication budgets. These conflicting desires of distance and control drive the need for advanced on-board intelligent decision making to reduce communication and control limitations by automating as many mission functions as possible in-situ. While the amount of research on such Artificial Intelligence and Machine Learning (AI/ML) software modules has grown exponentially, the capacity to experimentally validate such software modules in space in a rapid and inexpensive format has not. To this end, the Nano Orbital Workshop (NOW) group at NASA Ames Research Center has been at the forefront of performing initial flight evaluation tests of ‘commercially’ available bleeding-edge computational platforms via what is programmatically referred to as the BrainStack on the TechEdSat (TES-n) flight series. This on-orbit computational platform provides an evaluation laboratory where advanced software experiments are pre-loaded into memory prior to launch, then executed as payloads during mission operations with results reported back and program tweaks or new training sets uploaded as needed. Processors selected as part of the BrainStack are of ideal size, packaging, and power consumption for easy integration into a cube satellite structure. These experiments have included the evaluation of small, high-performance GPUs and, more recently, neuromorphic processors, in LEO operations. Neuromorphic processors are of particular interest due to their superior power efficiency over GPUs in intelligent automation applications. The first TES-n flight test of an Intel first-generation Loihi neuromorphic processor launched on TES-13, January 13, 2022, and continues to operate in orbit despite no significant modifications to harden the processor against the space environment. The Intel Loihi Gen-1 on TES-13 is characterized by a 14nm 128-core Spiking Neural Network (SNN) able to support on-chip training. The processor is packaged in the Kapoho Bay USB module, providing a relatively straight-forward interface to the bus avionics system. The Kapoho Bay was in turn managed by an Intel Pentium single-board computer to handle scheduling of the software application payloads and communications with the satellite’s primary computer. The recently released Intel Loihi Gen-2, able to support integer-valued spike payloads and produced using 7nm process, will form part of the continually evolving BrainStack in the upcoming three TES-n/NOW flights. The Kapoho Point unit will incorporate eight Loihi-2 processors, enabling neural networks of up to one million neurons and one billion synapsis. Additionally, it is planned to measure the radiation environment these processors experience to understand any degradation or computational artifacts caused by long term space radiation exposure on these novel architectures. This evolving flexible and collaborative environment involving various research teams across NASA and other organizations is intended to be a convenient orbital test platform from which many anticipated future space automation applications may be initially tested.

Autonomous decision-making significantly increases mission effectiveness by mitigating the effects of communication constraints, like latency and bandwidth, and mission complexity on multi-spacecraft operations. To advance the state of the art in autonomous Distributed Space Systems (DSS), the Distributed Spacecraft Autonomy (DSA) team at NASA's Ames Research Center is developing within five relevant technical areas: distributed resource and task management, reactive operations, system modeling and simulation, human-swarm interaction, and ad hoc network communications. DSA is maturing these technologies - critical for future large autonomous DSS - from concept to launch via simulation studies and orbital deployments. A 100-node heterogenous Processor-in-the-Loop (PiL) testbed aids distributed autonomy capability development and verification of multi-spacecraft missions. The DSA software payload deployed to the D-Orbit SCV-004 spacecraft demonstrates multi-agent reconfigurability and reliability as part of an ESA-sponsored in-orbit technology demonstration. Finally, DSA's primary flight mission showcases collaborative resource allocation for multipoint science data collection with four small spacecraft as a payload on NASA's Starling 1.0 satellites.

Future expeditions will enable exploration and study of the planetary surfaces of the Moon and Mars by performing extravehicular activity (EVA) operations. Present-day International Space Station (ISS) EVA operations require an intricate choreography of crew, space suits, tools, systems, and flight teams to plan, train, and execute with limited advanced informatics. In this paper, the Joint Augmented Reality Visual Informatics System (Joint AR) project team at NASA Johnson Space Center (JSC) characterizes the design space for developing a modular augmented reality (AR) device for a spacesuit form factor that can support crew decision-making for EVA. The Joint AR product was defined via trade studies and market analysis of previous EVA display efforts, various AR components such as optics, commercial AR systems, light engines, data interfaces, and graphics engine software. This paper outlines the defining architectural design decisions, including safety criticality considerations, interfaces, and computer architectures. The outcomes of these studies result in a prototype design which is defined here as the Joint AR product. This work aims to enable a community-wide discussion toward realizing necessary suit-compatible AR features and capabilities for future missions.

The demands of traditional industrial robotics differ significantly from those of space robotics. While industry requires robots that can perform repetitive tasks with precision and speed, the space environment needs robots to cope with uncertainties, dynamics, and communication delays or interruptions, similar to human astronauts. These demands make a well-suited application for compliant robotics and behavior-based programming. Pose Target Wrench Limiting (PTWL) is a compliant behavior paradigm developed specifically to meet these demands. PTWL controls a robot by moving a virtual attractor to a target pose. The attractor applies virtual forces, based on stiffness and damping presets, to an underlying admittance controller. Guided by virtual forces, the robot will follow the attractor until safety conditions are violated or success criteria are met. We tested PTWL on a variety of quasi-static tasks that may be useful for future space operations. Our results demonstrate that PTWL is an extremely powerful tool. It makes teleoperation easy and safe for a wide range of quasi-static tasks. It also facilitates the creation of semi-autonomous state machines that can reliably complete complex tasks with minimal human intervention.

The National Aeronautics and Space Administration (NASA) will soon land crew on the lunar surface to establish a sustainable presence and develop operational concepts for future long-duration missions. New technologies will be necessary to extend planning and execution capabilities for lunar surface activities. The Joint Augmented Reality Visual Informatics System (Joint AR) at NASA Johnson Space Center (JSC) is one such technology. Joint AR is a suit-mounted augmented reality (AR) display and compute system which facilitates unprecedented information exchange and data visualization capabilities between mission support operators and suited crew. This paper describes challenges associated with developing an AR technology for an envisioned work domain by applying a sociotechnical lens to the iterative testing and development of novel AR technology through virtual reality (VR). A foundational VR testbed was established, providing a high-fidelity approximation of the lunar surface and enabling testing of envisioned AR system features in parallel with real world product development. Using this environment, a series of human-in-the-loop experiments were conducted using VR to deploy a notional AR system supporting use cases envisioned for lunar exploration extravehicular activity (xEVA). Our findings indicate VR is a powerful and immersive tool for testing capabilities which extend beyond the limitations of current AR technology. Our VR testbed enables early testing of proposed system features, advancing identification of high-value features and driving present-day development of Joint AR. Future work directions are discussed, including lessons learned and a roadmap for an iterative research and development approach applying VR (among other testbeds) to accelerate Joint AR system maturation.

This project will leverage existing capabilities of an augmented reality (AR) sensorimotor assessment tool. Currently, the tool mimics the capabilities of validated 2-dimensional (2D) assessments. While this modality is well-aligned with seated interactions with flight-deck displays, extravehicular activity (EVA) tasks will require full body mobility wherein astronauts reach and bend in a 3-dimensional (3D) space. These types of motions, naturally including head movements, are known to elicit experiences of disorientation. Thus, sensorimotor assessments that include these stimulations and larger movements are important for understanding astronaut readiness prior to initial EVAs. The proposed effort will extend the current 2D eye-hand coordination task in AR to a 3D task designed to evaluate dynamic balance and eye-hand-body coordination. The new module will extend the range of motion and interaction space such that it better aligns with operational task needs for astronaut readiness evaluation.

The demands of traditional industrial robotics differ significantly from those of remote, supervised operations in hostile environments, such as operations in space. While industry requires robots that can perform repetitive tasks with precision and speed, the space environment needs robots to cope with uncertainties, dynamics, and communication delays or interruptions, similar to human astronauts. These demands make a well-suited application for compliant robotics and behavior-based programming. Pose Target Wrench Limiting (PTWL) is a compliant behavior paradigm developed specifically to meet these demands. PTWL controls a robot by moving a virtual attractor to a target pose. The attractor applies virtual forces, based on stiffness and damping presets, to an underlying admittance controller. Guided by virtual forces, the robot will follow the attractor until safety conditions are violated or success criteria are met. PTWL was tested on a variety of quasi-static and dynamic tasks that may be useful for future space operations. Results demonstrate that PTWL is a powerful tool. It makes teleoperation easy and safe for a wide range of quasi-static tasks. It also facilitates the creation of semi-autonomous state machines that can reliably complete complex tasks with minimal human intervention.

An automated localization and georectification pipeline for astronaut photography

This submission consists of summary use cases for NASA's Responsible Artificial Intelligence (RAI). These RAI Use Cases are to be made public, pursuant to the Presidential Executive Order 13960, Promoting the Use of Trustworthy Artificial Intelligence in the Federal Government. They were collected from NASA's practicing AI research community and cover the gamut of NASA's AI activities. These Use Cases will be updated annually as required by the Executive Order. The information included consists of the NASA Center, a summary of the goal, the AI techniques being applied, information on training data, and information on source code.

In-space assembly is crucial to creating large-scale space structures and enabling long term space missions. Natural limitations in the size of transportation vehicles and ISRU production facilities necessitate an additive strategy with the size of the typical structural unit being essentially fixed and inversely proportional to the final assembly size. In prior robotic and space assembly examples, reversible mechanical integration of structural modules is typically achieved with actuated alignment and fastening mechanisms onboard every structural module. Additive assembly or manufacturing planning approaches often feature a “build front” that receives new materials or parts and progresses gradually across the target geometry. The system we describe here places much of the alignment and fastener actuation systems onboard a mobile robot that can operate at a build front while companion robots (Scaling Omni-directional Lattice Locomoting Explorer, SOLLE) provide part or material transportation. The design and evaluation of this Mobile Meta-Material Interior Co-Integrator (MMIC-I), an inchworm-style locomoting robotic assembler, is described here with an emphasis on ease of assembly and a low number of unique parts for a simple design. It is designed to assist in alignment of cuboctahedron structural unit cells with captive fasteners, defining the build front in operation. Adjacent structural unit cells are locked together with specified axial and rotational actuation of the fasteners. Hardware prototypes show that the robot is able to successfully locomote to any indexed location within a lattice structure and bolt together each set of fasteners on any interface.

The Tall Lunar Tower (TLT) In-Space Assembly (ISA) team aims to design, model, fabricate, autonomously assemble, and characterize a TLT engineering development unit (EDU). The autonomous assembly of a tower also demonstrates a cross-cutting technology that can be applied to other lunar structures, such as blast shields, radiation shelters, and safe havens.

Current literature primarily addresses what is referred to as “Systems Thinking.” Dr. Marie Morganelli from Southern New Hampshire University states that “Systems thinking is a holistic way to investigate factors and interactions that could contribute to a possible outcome [1]. A mindset more than a prescribed practice, systems thinking provides an understanding of how individuals can work together in different types of teams and through that understanding, create the best possible processes to accomplish just about any-thing.” So, a “Thinking System” is a system that is capable of “systems thinking,” as it should be able to “ …create [utilize] the best possible processes, and possess the [intelligence] to accomplish just about anything.” To achieve this capability, hu-man-like thinking is required. A truly autonomous system must be one that is capable of human-like thinking. Sustained autonomy requires “Thinking Autonomy” (TA) that is enabled by a “Thinking System.”

The Problem: The use of conventional neural networks (CoNNs) to predict SEPs has become popular, but neural network models do not follow one-size-fits-all approaches and their chaotic natures can yield completely different results on identical data sets. Committees of neural networks identical in input features have been used to solve this problem by (Aminalragia et al., 2021), but they have the possibility of all agreeing together in lockstep and missing crucial information. The Solution: (O’Keefe et al., 2023) propose a solution consisting of neural network estimators in an ensemble, but with features randomly removed from them in a layout known as a random hivemind (RH). The decision weight, learning rate, and epoch count of each member in this ensemble are boosted in relation to how well its individual features perform in a chi-square test.

The InSight lander carried an Instrument Deployment System (IDS) that included an Instrument Deployment Arm (IDA), scoop, five finger “claw” grapple, forearm-mounted Instrument Deployment Camera (IDC) requiring arm motion to image a target, and landermounted Instrument Context Camera (ICC), designed to image the workspace, and to place the instruments onto the surface. As originally proposed, the IDS included a previously built arm and flight spare black and white cameras and had no science objectives or requirements, or expectation to be used after instrument deployment (90 sols). During project development the detectors were upgraded to color, and it was recognized that the arm could be used to carry out a wide variety of activities that would enable both geology and physical properties investigations. During surface operations for two martian years, the IDA was used during major campaigns to image the surface around the lander, to deploy the instruments, to assist the mole in penetrating beneath the surface, to bury a portion of the seismometer tether, to clean dust from the solar arrays to increase power, and to conduct a surface geology investigation including soil mechanics and physical properties experiments. No other surface mission has engaged in such a sustained and varied campaign of arm and scoop activities directed at such a diverse suite of objectives. Images close to the surface and continuous meteorology measurements provided important constraints on the threshold friction wind speed needed to initiate aeolian saltation and surface creep. The IDA was used extensively for almost 22 months to assist the mole in penetrating into the subsurface. Soil was scraped into piles and dumped onto the seismometer tether six times in an attempt to bury the tether and ∼ 30% was entrained in the wind and dispersed downwind 1-2 m, darkening the surface. Seven solar array cleaning experiments were conducted by dumping scoops of soil from 35 cm above the lander deck during periods of high wind that dispersed the sand onto the panels that kicked dust off of the panels into suspension in the atmosphere, thereby increasing the power by ∼15% during this period. Final IDA activities included an indentation experiment that used the IDA scoop to push on the ground to measure the plastic deformation of the soil that complemented soil mechanics measurements from scoop interactions with the surface, and two experiments in which SEIS measured the tilt from the arm pressing on the ground to derive near surface elastic properties.

In aerospace and engineering in general, the major metrics are capability, cost, and safety/risk. With the increasingly rapid emergence and utilization of new technologies and systems of increasing complexity, ensuring safety becomes more difficult. The technology and practice/applications of safety/risk technologies require updating in concert with capability and systems technology changes. Hence the new, updated edition of this risk engineering book. Major changes in technology and applications, now and going forward, increasingly involve artificial intelligence (AI)/autonomy and complex systems, which are rapidly developing and moving targets when it comes to risk/safety analysis. These introduce both new risks and safety issues, and they alter more usual ones. The current reality is that often the best AI is when it is “Black Boxed”, developed “independently”, without detailed human understanding of how and by what processes decisions and results are produced. There are ongoing efforts to make the AI processes more understandable by humans, with results to be determined. Also, trusted and true autonomy is free of human intervention, which would require machines to ideate to solve in real time issues that arise due to unknown unknowns and even known unknowns. Machines using generative adversarial network (GANs) and other approaches are beginning to ideate. Overall, the capabilities and practice of AI/autonomy utilization is a work in progress with the rate of progress substantial and the impacts upon system risk/safety major.

The proliferation of increasingly autonomous systems calls for new ways to address how safety is assured. As these systems become more advanced and complex, it becomes more important to model and prototype autonomous functions at the systems level and the functions that assure they are operating safely and as expected. To that effect, researchers at the National Aeronautics and Space Administration (NASA) 's Robust Software Engineering (RSE) group are working on prototyping a Research Autonomous Vehicle, commonly referred to as R-RAV. The R-RAV is an autonomous rover platform designed to act as a case study for assured autonomy research. Moreover, an overarching goal is for the R-RAV to serve as a training ground for other mission projects. In this paper, we will detail how we have used a Model-Based Systems Engineering (MBSE) approach to model a prototype of the R-RAV and test and verify its different functionalities.

The "AI Ethics Appendix" is a game-based design fiction for the deliberation of uncertain artificial intelligence (AI) ethical scenarios. The game is intended to be used as a tool for AI practitioners and industry professionals to grow responsible and ethical AI knowledge as they integrate this technology into their development. As AI/ML ethical considerations and governmental compliance develop, it is important to encourage teams to encourage teams to incorporate diverse thinking early in the development cycle and consider how different stakeholders may be affected by the technology. This game accomplishes these goals through storytelling and meaningful game interaction based on methods from game design as well as speculative and design fiction in the field of Human-Centered Design. The game mechanics were informed by the NASA Framework for the Ethical Use of Artificial Intelligence, Executive Order 13960, examples of AI use cases, and colleagues' work experiences with AI/ML.