Search

This paper extends recent work on decision rule learning from neural networks for tabular data classification. We propose alternative formulations to trainable Boolean logic operators as neurons with continuous weights, including trainable NAND neurons. These alternative formulations provide uniform treatments to different trainable logic neurons so that they can be uniformly trained, which enables, for example, the direct application of existing sparsity-promoting neural net training techniques like reweighted L1 regularization to derive sparse networks that translate to simpler rules. In addition, we present an alternative network architecture based on trainable NAND neurons by applying De Morgan’s law to realize a NAND-NAND network instead of an AND-OR network, both of which can be readily mapped to decision rule sets. Our experimental results show that these alternative formulations can also generate accurate decision rule sets that achieve state-of-the-art performance in terms of accuracy in tabular learning applications.

While neural networks have been achieving increasingly significant excitement in solving classification tasks such as natural language processing, their lack of interpretability becomes a great challenge for neural networks to be deployed in certain high-stakes human-centered applications. To address this issue, we propose a new approach for generating interpretable predictions by inferring a simple three-layer neural network with threshold activations, so that it can benefit from effective neural network training algorithms and at the same time, produce human-understandable explanations for the results. In particular, the hidden layer neurons in the proposed model are trained with floating point weights and binary output activations. The output neuron is also trainable as a threshold logic function that implements a disjunctive operation, forming the logical-OR of the first-level threshold logic functions. This neural network can be trained using state-of-the-art training methods to achieve high prediction accuracy. An important feature of the proposed architecture is that only a simple greedy algorithm is required to provide an explanation with the prediction that is human-understandable. In comparison with other explainable decision models, our proposed approach achieves more accurate predictions on a broad set of tabular data classification datasets.

Conventional federated learning (FL) approaches are ineffective in scenarios where clients have significant differences in the distributions of their local data. The Non-IID data distribution in the client data causes a drift in the local model updates from the global optima, which significantly impacts the performance of the trained models. In this article, we present a new algorithm called FLIS that aims to address this problem by grouping clients into clusters that have jointly trainable data distributions. This is achieved by comparing the inference similarity of client models. Our proposed framework captures settings where different groups of users may have their own objectives (learning tasks), but by aggregating their data with others in the same cluster (same learning task), superior models can be derived via more efficient and personalized federated learning. We present experimental results to demonstrate the benefits of FLIS over the state-of-the-art approaches on the CIFAR-100/10, SVHN, and FMNIST datasets. Our code is available at https://github.com/MMorafah/FLIS.

Continued scaling in accordance with Moore’s law is becoming increasingly difficult. Pitch shrinkage and standard cell height reduction via design technology co-optimization with design rules have sustained this scaling until recently. However, we observe that standard cell device scaling is becoming saturated due to yield and cost. One way to continue device footprint reduction is by expanding in the third dimension via monolithic 3D integration, using for example stacked gate-all-around (GAA) devices, complementary FETs, vertical FETs, and 3D logic. However, using these footprint scaling approaches to increase device density creates new problems. Using vertical gate-all-around FET (VFET) technologies as a specific instance of 3D device scaling, we demonstrate that the key bottleneck to footprint scaling is the pin density wall. The footprint of a block is predominantly limited by the pin density as we increase the number of active device layers. While a full-blown paradigm shift on layout methodology, design flow, and electronic design automation (EDA) platform is not available now, we describe in this article three specific baby steps that can alleviate the pin density problem and demonstrate their potential benefits for footprint scaling: (1) allocating standard cell pin sideways and using block-level routing with the local interconnect layers; (2) using the backside of the substrate for the power distribution network; and (3) using the generation of more complex standard cells. We show via several core designs that a 42.6% reduction in the core area is achievable when a combination of these operations is employed.

We propose a novel technique for dataset summarization by selecting representatives from a large, unsupervised dataset. The approach is based on the concept of self-rank, defined as the minimum number of samples needed to express all dataset samples with an accuracy proportional to the rank- $K$ approximation. As the exact computation of self-rank requires a computationally expensive combinatorial search, we propose an efficient algorithm that jointly estimates self-rank and selects the most informative samples in a linear order of complexity w.r.t the data size. We derive a new upper bound for the approximation ratio (AR), the ratio of obtained projection error using selected samples to the best rank- $K$ approximation error. The best previously known AR for self-representative low-rank approximation was presented in ICML 2017, which was further improved by the bound $\sqrt {1+K}$ reported in NeurIPS 2019. Both of these bounds are obtained by brute force search, which is not practical, and these bounds depend solely on $K$ , the number of selected samples. In contrast, we describe an adaptive AR that takes into consideration the spectral properties and spikiness measure of the original dataset, ${\boldsymbol {A}\in \mathbb {R}^{N\times M}}$ . In particular, our performance bound is proportional to the condition number $\kappa (\boldsymbol {A})$ . Our derived AR is expressed as $1+(\kappa (\boldsymbol {A})^{2}-1)/(N-K)$ , which approaches 1 and is optimal in two extreme spectral distribution instances. In the worst case, AR is shown not to exceed 1.25 for the proposed method. Our proposed algorithm enjoys linear complexity w.r.t. size of original dataset, which results in filling a historical gap between practical and theoretical methods in finding representatives. In addition to evaluating the proposed algorithm on a synthetic dataset, we show that it can be utilized in real-world applications such as graph node sampling for optimizing the shortest path criterion, learning a classifier with representative data, and open-set identification.

Low-rank matrix factorization problems such as non negative matrix factorization (NMF) can be categorized as a clustering or dimension reduction technique. The latter denotes techniques designed to find representations of some high dimensional dataset in a lower dimensional manifold without a significant loss of information. If such a representation exists, the features ought to contain the most relevant features of the dataset. Many linear dimensionality reduction techniques can be formulated as a matrix factorization. In this paper, we combine the conjugate gradient (CG) method with the Barzilai and Borwein (BB) gradient method, and propose a BB scaling CG method for NMF problems. The new method does not require to compute and store matrices associated with Hessian of the objective functions. Moreover, adopting a suitable BB step size along with a proper nonmonotone strategy which comes by the size of convex parameter ηk, results in a new algorithm that can significantly improve the CPU time, efficiency, the number of function evaluation. Convergence result is established and numerical comparisons of methods on both synthetic and real-world datasets show that the proposed method is efficient in comparison with existing methods and demonstrate the superiority of our algorithms.

We propose a novel three-layer neural network architecture with threshold activations for tabular data classification problems. The hidden layer units correspond to trainable neurons with arbitrary weights and biases and a step activation. These neurons are logically equivalent to threshold logic functions. The output layer neuron is also a threshold function that implements a conjunction of the hidden layer threshold functions. This neural network architecture can leverage state-of-the-art network training methods to achieve high prediction accuracy, and the network is designed so that minimal human understandable explanations can be readily derived from the model. Further, we employ a sparsity-promoting regularization approach to sparsify the threshold functions to simplify them, and to sparsify the output neuron so that it only depends on a small subset of hidden layer threshold functions. Experimental results show that our approach outperforms other state-of-the-art interpretable decision models in prediction accuracy.

With the relentless scaling of technology nodes, the track number reduction of conventional (Conv.) cell is starting to reach its limitations due to limited routing resources, lateral p-n separations, and performance requirements. As a result, to exploit the benefits of 3-D architectures, complementary-FET (CFET) technology, which stacks P-FET on N-FET or vice versa, is proposed to release the restriction of p-n separation and reduce in-cell routing congestion by enabling p-n direct connections. However, CFET standard cell (SDC) synthesis demands a holistic reconsideration of multirow (MR) structure to maximize the cell and block-level area benefits due to limited in-cell routing tracks and routability that comes from the stacked structure and reduced cell height. In this article, we propose a satisfiability modulo theory (SMT)-based MR CFET SDC synthesis framework that simultaneously solves place-and-route to minimize the cell area by considering single-row and MR placement together. We enable explorations on upper/lower M0A/PC routing to leverage the shared-and-split structure across cell rows with the proposed MR dynamic complementary pin allocation scheme. We demonstrate that MR 2.5T CFET without and with upper/lower M0A/PC routing achieves 16.44% and 20.61% on the average reduced cell areas, respectively, compared to 3.5T CFET. Moreover, MR 2.5T CFET SDCs achieve 13.43% and 14.40% less block-level area and total wirelength on average compared to 3.5T CFET SDCs.

Many-tier vertical gate-all-around nanowire FET (VFET) synthesis strongly demands a holistic approach of modeling/formulating/optimizing transistor placement and in-cell routing to obtain the maximum-achievable power, performance, area, and cost (PPAC) benefits. In this article, we propose a novel satisfiability modulo theories (SMT)-based many-tier VFET standard cell (SDC) synthesis framework that simultaneously solves place-and-route (P&R). We devise an extended relative positioning constraint and a dummy gate control scheme to capture the unique VFET cell architecture. Moreover, we present efficient objectives to improve pin-accessibility and reduce the use of vertical routing, which has high resistance. Compared to the conventional sequential P&R approach, our concurrent P&R achieves a 15.2% smaller cell area on average for 2-tier VFET. Throughout the extensive exploration for many-tier VFET configurations up to 4-tier, we show that the 4-tier VFET respectively achieves 50.1% and 27.9% of average area reduction on chip-level and block-level, over 4.5T GAAFET.

With solid tumor cancer survivorship increasing, the number of patients requiring post-treatment surveillance also continues to increase. This highlights the need for evidence-based cancer surveillance guidelines. Ideally, these guidelines would be based on combined high-quality data from randomized controlled trials (RCTs). We present a systematic review of published cancer surveillance RCTs in which we sought to determine the feasibility of data pooling for guideline development. We carried out a systematic search of medical databases for RCTs in which adult patients with solid tumors that had undergone surgical resection with curative intent and had no metastatic disease at presentation, were randomized to different surveillance regimens that assessed effectiveness on overall survival (OS). We extracted study characteristics and primary and secondary outcomes, and assessed risk of bias and validity of evidence with standardized checklist tools. Our search yielded 32,216 articles for review and 18 distinct RCTs were included in the systematic review. The 18 trials resulted in 23 comparisons of surveillance regimens. There was a highlevel of variation between RCTs, including the study populations evaluated, interventions assessed and follow-up periods for the primary outcome. Most studies evaluated colorectal cancer patients (11/18, [61%]). The risk of bias and validity of evidence were variable and inconsistent across studies. This review demonstrated that there is tremendous heterogeneity among RCTs that evaluate effectiveness of different postoperative surveillance regimens in cancer patients, rendering the consolidation of data to inform high-quality cancer surveillance guidelines unfeasible. Future RCTs in the field should focus on consistent methodology and primary outcome definition.

Background Patient activation and engagement can improve outcomes of medical and surgical care by increasing involvement of patients in their care plan. We designed a digital engagement tool to improve surgical cancellation and post-surgical outcomes for adult patients undergoing total joint replacements by providing patient education materials via email or text, in small increments throughout the perioperative period. Methods We assessed the tool's impact using a quasi-experimental design comparing patients scheduled for surgery January–June 2017 (pre-intervention) versus January–June 2018 (post-intervention). Post-intervention patients with digital contact information in the medical record were automatically enrolled. We extracted de-identified administrative data for all patients during both time periods and utilized an intent-to-treat approach including all post-intervention patients regardless of enrollment. Surgical cancellation and post-surgical outcomes (length of stay, discharge to home and revisits and readmissions) were compared between periods using adjusted regression models. We also examined associations between measures of engagement with the intervention and outcomes. Results A total of 2027 joint replacement patients were included (720 hip replacements; 1307 knee replacements). Adjusting for gender, age and insurance type, both hip and knee patients in the post-intervention group were more likely to have a cancelled surgery, but cancellations were less likely to be on the day of surgery compared to pre-intervention patients. Post-intervention patients were also less likely to have length of stay >2 days. Forty- three per cent of hip and 47% of knee patients in the post-period received the intervention and most were highly engaged. Higher engagement was associated with lower odds of surgical cancellation, shorter stays and higher odds of discharge home. Conclusion Findings suggest that utilization of a digital patient engagement tool translates into improved hospital efficiency and patient outcomes, particularly for those highly engaged.

Artificial Intelligence (AI) has the power to improve our lives through a wide variety of applications, many of which fall into the healthcare space; however, a lack of diversity is contributing to limitations in how broadly AI can help people. The UCSF AI4ALL program was established in 2019 to address this issue by targeting high school students from underrepresented backgrounds in AI, giving them a chance to learn about AI with a focus on biomedicine, and promoting diversity and inclusion. In 2020, the UCSF AI4ALL three-week program was held entirely online due to the COVID-19 pandemic. Thus, students participated virtually to gain experience with AI, interact with diverse role models in AI, and learn about advancing health through AI. Specifically, they attended lectures in coding and AI, received an in-depth research experience through hands-on projects exploring COVID-19, and engaged in mentoring and personal development sessions with faculty, researchers, industry professionals, and undergraduate and graduate students, many of whom were women and from underrepresented racial and ethnic backgrounds. At the conclusion of the program, the students presented the results of their research projects at the final symposium. Comparison of pre- and post-program survey responses from students demonstrated that after the program, significantly more students were familiar with how to work with data and to evaluate and apply machine learning algorithms. There were also nominally significant increases in the students' knowing people in AI from historically underrepresented groups, feeling confident in discussing AI, and being aware of careers in AI. We found that we were able to engage young students in AI via our online training program and nurture greater diversity in AI. This work can guide AI training programs aspiring to engage and educate students entirely online, and motivate people in AI to strive towards increasing diversity and inclusion in this field.

Florida has the most permitted artificial reefs in the nation. This publication presents the results of several studies to determine the economic benefits of artificial reefs. It is intended as a helpful reference for resource managers, coastal community and state government agencies, reef user groups including fishers and divers, and Extension agents.

Florida has the most permitted artificial reefs in the nation. This publication presents the results of several studies to determine the economic benefits of artificial reefs. It is intended as a helpful reference for resource managers, coastal community and state government agencies, reef user groups including fishers and divers, and Extension agents.

Hemodynamic functional ultrasound imaging (fUS) of neural activity provides a unique combination of spatial coverage, spatiotemporal resolution and compatibility with freely moving animals. However, deep and transcranial monitoring of brain activity and the imaging of dynamics in slow-flowing blood vessels remains challenging. To enhance fUS capabilities, we introduce biomolecular hemodynamic enhancers based on gas vesicles (GVs), genetically encodable ultrasound contrast agents derived from buoyant photosynthetic microorganisms. We show that intravenously infused GVs enhance ultrafast Doppler ultrasound contrast and visually-evoked hemodynamic contrast in transcranial fUS of the mouse brain. This hemodynamic contrast enhancement is smoother than that provided by conventional microbubbles, allowing GVs to more reliably amplify neuroimaging signals.

[This corrects the article DOI: 10.1371/journal.pbio.1002458.].

Background: Inpatient services for people with intellectual and other types of developmental disabilities (IDD) who also have forensic or risk issues are largely provided in secure hospitals. Although this is a health service sector with high levels of expenditure, there is limited empirical information on patient outcomes from such services. In order for a future substantive longitudinal outcomes study in forensic IDD services to be informed and feasible, more needs to be understood about the outcome domains that are of relevance and importance and how they should be measured. A preliminary series of studies was therefore undertaken. Objectives: To synthesise evidence in relation to the outcome domains that have been researched in the existing literature from hospital and community forensic services for people with IDD, within the broad domains of service effectiveness, patient safety and patient experience. To identify a definitive framework of outcome domains (and associated measures and indicators) based both on this research evidence and on the views of patients, carers and clinicians. To synthesise the information gathered in order to inform design of future multisite longitudinal research in the sector. Design: Three linked studies were conducted. Stage 1 was a systematic review and evidence synthesis of outcome domains and measures as found within the forensic IDD literature. Stage 2 was a consultation exercise with 15 patients with IDD and six carers. Stage 3 was a modified Delphi consensus exercise with 15 clinicians and experts using the information gathered at stages 1 and 2. Results: At stage 1, 60 studies that researched a range of outcomes in forensic IDD services were identified from the literature. This resulted in the construction of an initial framework of outcome domains. The consultation with patients and carers at stage 2 added to these framework domains that related particularly to carer experience and the level of support post discharge in the community. The Delphi process at stage 3 confirmed the validity of the resulting framework for clinician. This survey also identified the outcome measures preferred by clinicians and those that are currently utilised in services. Thus, indicators of appropriate measures in some important domains were identified, although there was a paucity of measures in other domains. Conclusions: Together, these three linked studies led to the development of an evidence-based framework of key outcome domains and subdomains. A provisional list of associated measures and indicators was developed, although with the paucity of measures in some domains development of specific indicators may be required. With further refinement this could eventually be utilised by services and commissioners for comparative purposes, and in future empirical research on outcomes in forensic IDD services. An outline research proposal closely linked to recent policy initiatives was proposed. Limitations of the study include the relatively small number of carers and patients and range of experts consulted. Future work: This would comprise a national longitudinal study tracking IDD in patients through hospitalisation and discharge. Study registration: This study is registered as PROSPERO CRD42015016941. Funding: The National Institute for Health Research Health Services and Delivery Research programme.

The oversupply of postdoctoral scholars relative to available faculty positions has led to calls for better assessment of career outcomes. Here, we report the results of a study of postdoctoral outcomes at the University of California, San Francisco, and suggest that institutions have an obligation to determine where their postdoc alumni are employed and to share this information with current and future trainees. Further, we contend that local efforts will be more meaningful than a national survey, because of the great variability in training environment and the classification of postdoctoral scholars among institutions. We provide a framework and methodology that can be adopted by others, with the goal of developing a finely grained portrait of postdoctoral career outcomes across the United States.

SGEB65, a 4-page illustrated article by Bill Lindberg and Mark Schrope, discusses the ecological impacts of artificial reefs and implications for conservation in interview format. Published by the UF Florida Sea Grant Program, January 2010. SGEB 65/SG100: Understanding the Ecology of Artificial Reefs: No Simple Answers (ufl.edu)

SGEB65, a 4-page illustrated article by Bill Lindberg and Mark Schrope, discusses the ecological impacts of artificial reefs and implications for conservation in interview format. Published by the UF Florida Sea Grant Program, January 2010. SGEB 65/SG100: Understanding the Ecology of Artificial Reefs: No Simple Answers (ufl.edu)

SGEB65, a 4-page illustrated article by Bill Lindberg and Mark Schrope, discusses the ecological impacts of artificial reefs and implications for conservation in interview format. Published by the UF Florida Sea Grant Program, January 2010. SGEB 65/SG100: Understanding the Ecology of Artificial Reefs: No Simple Answers (ufl.edu)

Florida has the most permitted artificial reefs in the nation. FE-649, a 6-page fact sheet by Charles Adams, presents the results of several studies to determine the economic benefits of artificial reefs. The author presents findings by region, with sections on Pinellas County, Dade County, Northwest Florida, Martin County, and the USS Speigel Grove (off Key Largo, FL). Published by the UF Department of Food and Resource Economics, August 2006. FE649/FE649: The Economic Benefits Associated with Florida's Artificial Reefs (ufl.edu)

Florida has the most permitted artificial reefs in the nation. FE-649, a 6-page fact sheet by Charles Adams, presents the results of several studies to determine the economic benefits of artificial reefs. The author presents findings by region, with sections on Pinellas County, Dade County, Northwest Florida, Martin County, and the USS Speigel Grove (off Key Largo, FL). Published by the UF Department of Food and Resource Economics, August 2006. FE649/FE649: The Economic Benefits Associated with Florida's Artificial Reefs (ufl.edu)

Florida has the most permitted artificial reefs in the nation. FE-649, a 6-page fact sheet by Charles Adams, presents the results of several studies to determine the economic benefits of artificial reefs. The author presents findings by region, with sections on Pinellas County, Dade County, Northwest Florida, Martin County, and the USS Speigel Grove (off Key Largo, FL). Published by the UF Department of Food and Resource Economics, August 2006. FE649/FE649: The Economic Benefits Associated with Florida's Artificial Reefs (ufl.edu)

Abstract Background Lung ultrasound (LUS) is a useful tool for assessing the severity of lung disease, without radiation exposure. However, there is little data on the practicality of LUS in assessing the severity of bronchopulmonary dysplasia (BPD) and evaluating short-term clinical outcomes. We adapted a LUS score to evaluate BPD severity and assess the reliability of mLUS score correlated with short-term clinical outcomes. Methods Prospective diagnostic accuracy study was designed to enroll preterm infants with gestational age

The deformation of congenital obstruction of the anterior urethra is rare in male infants. The anterior urethral valve (AUV) and diverticulum are not common causes of distal urethral obstruction, which may be significant but difficult to diagnose in time. We describe a premature infant who was diagnosed with AUV as part of a diverticulum in the anterior urethra and was presented as massive urinary ascites without hydroureters and hydronephrosis. After indwelling abdominal tube and urinary catheterization, the infant’s massive ascites were resolved, while urethral obstruction had successful treatment by Holmium laser. We suggest that the presence of urinary ascites in fetuses and neonates should be considered as a warning against urinary malformations.

In this study, we introduce a novel approach to examine the heart-brain interaction underlying the multifractality in the heart rate variability of healthy humans. Via the autonomic perturbation induced by the passive head-up-tilt (HUT), empirical supports for the central-autonomic fractal correlation (CAFC) are presented based on the fractal properties in simultaneously recorded electroencephalography (EEG) and heart beat interval data. In particular, we show the measure of CAFC varies according to the fractal complexity of HRV. The result implies the change towards more (less) complex HRV fractal complexity is associated with a stronger (weaker) CAFC and is tested significantly different from the surrogate data. Using the HRV and EEG physiological correlates in the frequency domain, we further show that CAFCis significantly linked to the EEG Beta band activities and the HRV spectral measures in the supine position. These findings suggest a potential arousal factor underlying the physiological processing of the central influence in the HRV scale-free dynamics.