Search

The research groups in computer vision, graphics, and machine learning have dedicated a substantial amount of attention to the areas of 3D object reconstruction, augmentation, and registration. Deep learning is the predominant method used in artificial intelligence for addressing computer vision challenges. However, deep learning on three-dimensional data presents distinct obstacles and is now in its nascent phase. There have been significant advancements in deep learning specifically for three-dimensional data, offering a range of ways to address these issues. This study offers a comprehensive examination of the latest advancements in deep learning methodologies. We examine many benchmark models for the tasks of 3D object registration, augmentation, and reconstruction. We thoroughly analyse their architectures, advantages, and constraints. In summary, this report provides a comprehensive overview of recent advancements in three-dimensional deep learning and highlights unresolved research areas that will need to be addressed in the future.

The Gaussian wiretap channel with noncausal state interference available at the transmitter, which is also called the dirty paper wiretap channel (DP-WTC), has been extensively studied in the literature. Recently, it has been shown that taking actions on the corrupted state interference of the DP-WTC (also called the action-dependent DP-WTC) helps to increase the secrecy capacity of the DP-WTC. Subsequently, it has been shown that channel feedback further increases the secrecy capacity of the action-dependent DP-WTC (AD-DP-WTC), and a sub-optimal feedback scheme is proposed for this feedback model. In this paper, a two-step hybrid scheme and a corresponding new lower bound on the secrecy capacity of the AD-DP-WTC with noiseless feedback are proposed. The proposed new lower bound is shown to be optimal (achieving the secrecy capacity) and tighter than the existing one in the literature for some cases, and the results of this paper are further explained via numerical examples.

On behalf of the Editor-in-Chief, Prof [...]

On behalf of the Editor-in-Chief, Prof [...]

On behalf of the Editor-in-Chief, Prof [...]

Translation of the seminal 1877 paper by Ludwig Boltzmann which for the first time established the probabilistic basis of entropy. Includes a scientific commentary.

This paper presents a novel method for finding features in the analysis of variable distributions stemming from time series. We apply the methodology to the case of submitted and accepted papers in peer-reviewed journals. We provide a comparative study of editorial decisions for papers submitted to two peer-reviewed journals: the Journal of the Serbian Chemical Society (JSCS) and this MDPI Entropy journal. We cover three recent years for which the fate of submitted papers—about 600 papers to JSCS and 2500 to Entropy—is completely determined. Instead of comparing the number distributions of these papers as a function of time with respect to a uniform distribution, we analyze the relevant probabilities, from which we derive the information entropy. It is argued that such probabilities are indeed more relevant for authors than the actual number of submissions. We tie this entropy analysis to the so called diversity of the variable distributions. Furthermore, we emphasize the correspondence between the entropy and the diversity with inequality measures, like the Herfindahl-Hirschman index and the Theil index, itself being in the class of entropy measures; the Gini coefficient which also measures the diversity in ranking is calculated for further discussion. In this sample, the seasonal aspects of the peer review process are outlined. It is found that the use of such indices, non linear transformations of the data distributions, allow us to distinguish features and evolutions of the peer review process as a function of time as well as comparing the non-uniformity of distributions. Furthermore, t- and z-statistical tests are applied in order to measure the significance (p-level) of the findings, that is, whether papers are more likely to be accepted if they are submitted during a few specific months or during a particular “season”; the predictability strength depends on the journal.

The analysis of research paper collections is an interesting topic that can give insights on whether a research area is stalled in the same problems, or there is a great amount of novelty every year. Previous research has addressed similar tasks by the analysis of keywords or reference lists, with different degrees of human intervention. In this paper, we demonstrate how, with the use of Normalized Relative Compression, together with a set of automated data-processing tasks, we can successfully visually compare research articles and document collections. We also achieve very similar results with Normalized Conditional Compression that can be applied with a regular compressor. With our approach, we can group papers of different disciplines, analyze how a conference evolves throughout the different editions, or how the profile of a researcher changes through the time. We provide a set of tests that validate our technique, and show that it behaves better for these tasks than other techniques previously proposed.

As such, entropy in an economic system is a sum of the entropy production in the system itself and the exchange of entropy with the environment. Entropy economics has also laid the groundwork for new avenues of economic research, such as econophysics, complexity economics, and quantum economics. The Role of Entropy in the Development of Economics [[2]] B Aleksander Jakimowicz b B I Entropy i 2020, 22(4), 452; b https://doi.org/10.3390/e22040452 Graph Economics and physics have been feeding into each other for at least 170 years. A new field of study has also appeared - thermoeconomics - which applies the analogues of thermodynamic entropy in economics, as best exemplified by money entropy. [Extracted from the article]

We are pleased to announce the “Entropy Best Paper Award” for 2015. Nominations were selected by the Editor-in-Chief and designated Editorial Board Members from all the papers published in 2011. Reviews and research papers were evaluated separately. We gladly announce that the following three papers have won the Entropy Best Paper Award in 2015:[...]

On behalf of the Editor-in-Chief, Prof. Dr. Kevin H. Knuth, we are pleased to announce the Entropy Best Paper Award for 2018 [...]

In 2013, Entropy instituted the “Best Paper” award to recognize outstanding papers in the area of entropy and information studies published in Entropy [1]. We are pleased to announce the “Entropy Best Paper Award” for 2014. Nominations were selected by the Editor-in-Chief and designated Editorial Board Members from all the papers published in 2010.

Almost two decades ago, Ernesto P. Borges and Bruce M. Boghosian embarked on the intricate task of composing a manuscript to honor the profound contributions of Constantino Tsallis to the realm of statistical physics, coupled with a concise exploration of q-Statistics. Fast-forward to Constantino Tsallis' illustrious 80th birthday celebration in 2023, where Deniz Eroglu and Ugur Tirnakli delved into Constantino's collaborative network, injecting renewed vitality into the project. With hearts brimming with appreciation for Tsallis' enduring inspiration, Eroglu, Boghosian, Borges, and Tirnakli proudly present this meticulously crafted manuscript as a token of their gratitude. [ABSTRACT FROM AUTHOR]

The accompanying papers in the first issue of Entropy, volume 5, 2003 were presented at the electronic conference on Foundations of Information Science FIS 2002 (http://www.mdpi.net/fis2002/). The running title of this FIS e-conference was THE NATURE OF INFORMATION: CONCEPTIONS, MISCONCEPTIONS, AND PARADOXES. It was held on the Internet from 6 to 10 May 2002, and was followed by a series of discussions –structured as focused sessions– which took place in the net from 10 May 2002 until 31 January 2003 (more than 400 messages were exchanged, see: http://fis.iguw.tuwien.ac.at/mailings/). This Introduction will briefly survey the problems around the concept of information, will present the central ideas of the FIS initiative, and will contrast some of the basic differences between information and mechanics (reductionism).

The papers range from the theoretical ones, the paper applying the models, to the papers providing software tools for causal inference. B Instrumental variable in causal inference. b Papers [[1], [3]] investigate models using instrumental variable in causal inference. The present Special Issue of Entropy, entitled "Causal Inference for Heterogeneous Data and Information Theory", covers various aspects of causal inference. In the first step, the treatment and outcome are modeled to incorporate the potential confounders, and in the second step, the predictions are inserted into the ATE estimators such as the Augmented Inverse Probability Weighting (AIPW) estimator, based on neural networks (NN). [Extracted from the article]

The journal Entropy is initiating a “Best Paper” award to recognize outstanding papers in the area of entropy and information studies published in Entropy. We are pleased to announce the first “Entropy Best Paper Award” for 2013. Nominations were selected by the Editor-in-Chief and selected Editorial Board Members from all the papers published in 2009 and evaluated by the Entropy Best Paper Award Committee. Reviews and articles were evaluated separately. A first prize is awarded to the selected review paper, and a first and second prize is awarded to the top two selected research articles.

n/a

In his groundbreaking 1905 paper on special relativity, Einstein distinguished between local and global time in inertial systems, introducing his famous definition of distant simultaneity to give physical content to the notion of global time. Over the following decade, Einstein attempted to generalize this analysis of relativistic time to include accelerated frames of reference, which, according to the principle of equivalence, should also account for time in the presence of gravity. Characteristically, Einstein's methodology during this period focused on simple, intuitively accessible physical situations, exhibiting a high degree of symmetry. However, in the final general theory of relativity, the a priori existence of such global symmetries cannot be assumed. Despite this, Einstein repeated some of his early reasoning patterns even in his 1916 review paper on general relativity and in later writings. Modern commentators have criticized these arguments as confused, invalid, and inconsistent. Here, we defend Einstein in the specific context of his use of global time and his derivations of the gravitational redshift formula. We argue that a detailed examination of Einstein's early work clarifies his later reasoning and demonstrates its consistency and validity. [ABSTRACT FROM AUTHOR]

In insecure communication environments where the communication bandwidth is limited, important image data must be compressed and encrypted for transmission. However, existing image compression and encryption algorithms suffer from poor image reconstruction quality and insufficient image encryption security. To address these problems, this paper proposes an image-compression and encryption scheme based on a newly designed hyperchaotic system and two-dimensional compressed sensing (2DCS) technique. In this paper, the chaotic performance of this hyperchaotic system is verified by bifurcation diagrams, Lyapunov diagrams, approximate entropy, and permutation entropy, which have certain advantages over the traditional 2D chaotic system. The new 2D chaotic system as a pseudo-random number generator can completely pass all the test items of NIST. Meanwhile, this paper improves on the existing 2D projected gradient (2DPG) algorithm, which improves the quality of image compression and reconstruction, and can effectively reduce the transmission pressure of image data confidential communication. In addition, a new image encryption algorithm is designed for the new 2D chaotic system, and the security of the algorithm is verified by experiments such as key space size analysis and encrypted image information entropy. [ABSTRACT FROM AUTHOR]

Translation of the seminal 1877 paper by Ludwig Boltzmann which for the first time established the probabilistic basis of entropy. Includes a scientific commentary. [ABSTRACT FROM AUTHOR]

Domestic and international risk shocks have greatly increased the demand for systemic risk management in China. This paper estimates China's multi-layer financial network based on multiple financial relationships among banks, assets, and firms, using China's banking system data in 2021. An improved PageRank algorithm is proposed to identify systemically important banks and other economic sectors, and a stress test is conducted. This study finds that China's multi-layer financial network is sparse, and the distribution of transactions across financial markets is uneven. Regulatory authorities should support economic recovery and adjust the money supply, while banks should differentiate competition and manage risks better. Based on the PageRank index, this paper assesses the systemic importance of large commercial banks from the perspective of network structure, emphasizing the role of banks' transaction behavior and market participation. Different industries and asset classes are also assessed, suggesting that increased attention should be paid to industry risks and regulatory oversight of bank investments. Finally, stress tests confirm that the improved PageRank algorithm is applicable within the multi-layer financial network, reinforcing the need for prudential supervision of the banking system and revealing that the degree of transaction concentration will affect the systemic importance of financial institutions. [ABSTRACT FROM AUTHOR]

Coreference resolution is a key task in Natural Language Processing. It is difficult to evaluate the similarity of long-span texts, which makes text-level encoding somewhat challenging. This paper first compares the impact of commonly used methods to improve the global information collection ability of the model on the BERT encoding performance. Based on this, a multi-scale context information module is designed to improve the applicability of the BERT encoding model under different text spans. In addition, improving linear separability through dimension expansion. Finally, cross-entropy loss is used as the loss function. After adding BERT and span BERT to the module designed in this article, F1 increased by 0.5% and 0.2%, respectively. [ABSTRACT FROM AUTHOR]

Joint communications and sensing functionalities integrated into the same communication network have become increasingly relevant due to the large bandwidth requirements of next-generation wireless communication systems and the impending spectral shortage. While there exist system-level guidelines and waveform design specifications for such systems, an information-theoretic analysis of the absolute performance capabilities of joint sensing and communication systems that take into account practical limitations such as fading has not been addressed in the literature. Motivated by this, we undertake a network information-theoretic analysis of a typical joint communications and sensing system in this paper. Towards this end, we consider a state-dependent fading Gaussian multiple access channel (GMAC) setup with an additive state. The state process is assumed to be independent and identically distributed (i.i.d.) Gaussian, and non-causally available to all the transmitting nodes. The fading gains on the respective links are assumed to be stationary and ergodic and available only at the receiver. In this setting, with no knowledge of fading gains at the transmitters, we are interested in joint message communication and estimation of the state at the receiver to meet a target distortion in the mean-squared error sense. Our main contribution here is a complete characterization of the distortion-rate trade-off region between the communication rates and the state estimation distortion for a two-sender GMAC. Our results show that the optimal strategy is based on static power allocation and involves uncoded transmissions to amplify the state, along with the superposition of the digital message streams using appropriate Gaussian codebooks and dirty paper coding (DPC). This acts as a design directive for realistic systems using joint sensing and transmission in next-generation wireless standards and points to the relative benefits of uncoded communications and joint source-channel coding in such systems. [ABSTRACT FROM AUTHOR]

Granger causality provides a framework that uses predictability to identify causation between time series variables. This is important to policymakers for effective policy management and recommendations. Granger causality is recognized as the primary advance on the causation problem. The objective of this paper is to conduct a bibliometric analysis of Granger causality publications indexed in the Web of Science database. Harzing's Publish or Perish and VOSviewer were used for performance analysis and science mapping. The first paper indexed was published in 1981 and there has been an upward trend in the annual publication of Granger causality studies which are shifting towards the areas of environmental science, energy, and economics. Most of the publications are articles and proceeding papers under the areas of business economics, environmental science ecology, and neurosciences/neurology. China has the highest number of publications while the United States has the highest number of citations. England has the highest citation impact. This paper also constructed country co-authorship, co-analysis of cited references, cited sources, and cited authors, keyword co-occurrence, and keyword overlay visualization maps. [ABSTRACT FROM AUTHOR]

We explore the different notions of completeness applied in the EPR discussion following and amending the thorough analysis of Arthur Fine. To this aim, we propose a classification scheme for scientific theories that provides a methodology for analyzing the different levels at which interpretive approaches come into play. This allows us to contrast several concepts of completeness that operate on specific levels of the theory. We introduce the notion of theory completeness and compare it with the established notions of Born completeness, Schrödinger completeness and bijective completeness. We relate these notions to the recent concept of ψ -completeness and predictable completeness. The paper shows that the EPR argument contains conflicting versions of completeness. The confusion of these notions led to misunderstandings in the EPR debate and hindered its progress. Their clarification will thus contribute to recent debates on interpretational issues of quantum mechanics. Finally, we discuss the connection between the EPR paper and the Einstein–Rosen paper with regard to the question of completeness. [ABSTRACT FROM AUTHOR]

Based on authorized patents of China's artificial intelligence industry from 2013 to 2022, this paper constructs an Industry–University–Research institution (IUR) collaboration network and an Inter-Firm (IF) collaboration network and used the entropy weight method to take both the quantity and quality of patents into account to calculate the innovation performance of firms. Through the hierarchical clustering algorithm and classification and regression trees (CART) algorithm, in-depth analysis has been conducted on the intricate non-linear influence mechanisms between multiple variables and a firm's innovation performance. The findings indicate the following: (1) Based on the network centrality (NC), structural hole (SH), collaboration breadth (CB), and collaboration depth (CD) of both IUR and IF collaboration networks, two types of focal firms are identified. (2) For different types of focal firms, the combinations of network characteristics affecting their innovation performance are various. (3) In the IUR collaboration network, focal firms with a wide range of heterogeneous collaborative partners can obtain high innovation performance. However, focal firms in the IF collaboration network can achieve the same aim by maintaining deep collaboration with other focal firms. This paper not only helps firms make scientific decisions for development but also provides valuable suggestions for government policymakers. [ABSTRACT FROM AUTHOR]

Recently, many password guessing algorithms have been proposed, seriously threatening cyber security. In this paper, we systematically review over thirty methods for password guessing published between 2016 and 2023. First, we introduce a taxonomy for classifying the existing methods into trawling guessing and targeted guessing. Second, we present an extensive benchmark dataset that can assist researchers and practitioners in successive works. Third, we conduct a bibliometric analysis to present trends in this field and cross-citation between reviewed papers. Further, we discuss the open challenges of password guessing in terms of diverse application scenarios, guessing efficiency, and the combination of traditional and deep learning methods. Finally, this review presents future research directions to guide successive research and development of password guessing. [ABSTRACT FROM AUTHOR]

We feature papers on recent developments in the areas of adaptive signal processing, machine learning, and deep learning using information theory and entropy to improve performance in widespread and popular problems, and also to provide effective solutions to emerging problems. Our goal is to publish recent developments in the areas of adaptive signal processing, machine learning, and deep learning using information theory and entropy to improve performance in widespread and popular problems, and also to provide effective solutions to emerging problems. This Special Issue on "Adaptive Signal Processing and Machine Learning Using Entropy and Information Theory" was birthed from observations of the recent trend in the literature. Entropy-based cost functions have replaced mean-square-error (MSE)-based ones and have been widely used in adaptive signal processing and machine learning to improve performance by designing and optimizing effective and specific models that fit the data, even in noisy and adverse conditions. [Extracted from the article]

In a recent paper, Nicolas Gisin suggests that by conducting physics with intuitionistic rather than classical mathematics, rich temporality—that is, passage and tense, and specifically the future's openness—can be incorporated into physics. Physics based on classical mathematics is tenseless and deterministic, and that, so he holds, renders it incongruent with experience. According to Gisin, physics ought to represent the indeterminate nature of reality, and he proposes that intuitionistic mathematics is the key to succeeding in doing so. While I share his insistence on the reality of passage and tense and on the future being real and open, I argue that the amendment he offers does not work. I show that, its attunement to time notwithstanding, intuitionistic mathematics is as tenseless as classical mathematics and that physics is bound to remain tenseless regardless of the math it employs. There is much to learn about tensed time, but the task belongs to phenomenology and not to physics. [ABSTRACT FROM AUTHOR]

The multi-particle Arnol'd cat is a generalization of the Hamiltonian system, both classical and quantum, whose period evolution operator is the renowned map that bears its name. It is obtained following the Joos–Zeh prescription for decoherence by adding a number of scattering particles in the configuration space of the cat. Quantization follows swiftly if the Hamiltonian approach, rather than the semiclassical approach, is adopted. The author has studied this system in a series of previous works, focusing on the problem of quantum–classical correspondence. In this paper, the dynamics of this system are tested by two related yet different indicators: the time autocorrelation function of the canonical position and the out-of-time correlator of position and momentum. [ABSTRACT FROM AUTHOR]

Investigating the significant "roles" within financial complex networks and their stability is of great importance for preventing financial risks. On one hand, this paper initially constructs a complex network model of the stock market based on mutual information theory and threshold methods, combined with the closing price returns of stocks. It then analyzes the basic topological characteristics of this network and examines its stability under random and targeted attacks by varying the threshold values. On the other hand, using systemic risk entropy as a metric to quantify the stability of the stock market, this paper validates the impact of the COVID-19 pandemic as a widespread, unexpected event on network stability. The research results indicate that this complex network exhibits small-world characteristics but cannot be strictly classified as a scale-free network. In this network, key roles are played by the industrial sector, media and information services, pharmaceuticals and healthcare, transportation, and utilities. Upon reducing the threshold, the network's resilience to random attacks is correspondingly strengthened. Dynamically, from 2000 to 2022, systemic risk in significant industrial share markets significantly increased. From a static perspective, the period around 2019, affected by the COVID-19 pandemic, experienced the most drastic fluctuations. Compared to the year 2000, systemic risk entropy in 2022 increased nearly sixtyfold, further indicating an increasing instability within this complex network. [ABSTRACT FROM AUTHOR]

This paper establishes a general framework for measuring statistical divergence. Namely, with regard to a pair of random variables that share a common range of values: quantifying the distance of the statistical distribution of one random variable from that of the other. The general framework is then applied to the topics of socioeconomic inequality and renewal processes. The general framework and its applications are shown to yield and to relate to the following: f-divergence, Hellinger divergence, Renyi divergence, and Kullback–Leibler divergence (also known as relative entropy); the Lorenz curve and socioeconomic inequality indices; the Gini index and its generalizations; the divergence of renewal processes from the Poisson process; and the divergence of anomalous relaxation from regular relaxation. Presenting a 'fresh' perspective on statistical divergence, this paper offers its readers a simple and transparent construction of statistical-divergence gauges, as well as novel paths that lead from statistical divergence to the aforementioned topics. [ABSTRACT FROM AUTHOR]

Partial discharge (PD) fault diagnosis is of great importance for ensuring the safe and stable operation of power transformers. To address the issues of low accuracy in traditional PD fault diagnostic methods, this paper proposes a novel method for the power transformer PD fault diagnosis. It incorporates the approximate entropy (ApEn) of symplectic geometry mode decomposition (SGMD) into the optimized bidirectional long short-term memory (BILSTM) neural network. This method extracts dominant PD features employing SGMD and ApEn. Meanwhile, it improves the diagnostic accuracy with the optimized BILSTM by introducing the golden jackal optimization (GJO). Simulation studies evaluate the performance of FFT, EMD, VMD, and SGMD. The results show that SGMD–ApEn outperforms other methods in extracting dominant PD features. Experimental results verify the effectiveness and superiority of the proposed method by comparing different traditional methods. The proposed method improves PD fault recognition accuracy and provides a diagnostic rate of 98.6%, with lower noise sensitivity. [ABSTRACT FROM AUTHOR]

Accurate prediction of air quality is crucial for assessing the state of the atmospheric environment, especially considering the nonlinearity, volatility, and abrupt changes in air quality data. This paper introduces an air quality index (AQI) prediction model based on the Dung Beetle Algorithm (DBO) aimed at overcoming limitations in traditional prediction models, such as inadequate access to data features, challenges in parameter setting, and accuracy constraints. The proposed model optimizes the parameters of Variational Mode Decomposition (VMD) and integrates the Informer adaptive sequential prediction model with the Convolutional Neural Network-Long Short Term Memory (CNN-LSTM). Initially, the correlation coefficient method is utilized to identify key impact features from multivariate weather and meteorological data. Subsequently, penalty factors and the number of variational modes in the VMD are optimized using DBO. The optimized parameters are utilized to develop a variationally constrained model to decompose the air quality sequence. The data are categorized based on approximate entropy, and high-frequency data are fed into the Informer model, while low-frequency data are fed into the CNN-LSTM model. The predicted values of the subsystems are then combined and reconstructed to obtain the AQI prediction results. Evaluation using actual monitoring data from Beijing demonstrates that the proposed coupling prediction model of the air quality index in this paper is superior to other parameter optimization models. The Mean Absolute Error (MAE) decreases by 13.59%, the Root-Mean-Square Error (RMSE) decreases by 7.04%, and the R-square (R2) increases by 1.39%. This model surpasses 11 other models in terms of lower error rates and enhances prediction accuracy. Compared with the mainstream swarm intelligence optimization algorithm, DBO, as an optimization algorithm, demonstrates higher computational efficiency and is closer to the actual value. The proposed coupling model provides a new method for air quality index prediction. [ABSTRACT FROM AUTHOR]

In order to solve the problem of great difficulty in detecting the internal damage of wire rope, this paper proposes a method to improve the VGG model to identify the internal damage of wire rope. The short-time Fourier transform method is used to transform the wire rope damage signal into a time-frequency spectrogram as the model input, and then the traditional VGG model is improved from three aspects: firstly, the attention mechanism module is introduced to increase the effective feature weights, which effectively improves the recognition accuracy; and then, the batch normalization layer is added to carry out a uniform normalization of the data, so as to make the model easier to converge. At the same time, the pooling layer and the fully connected layer are improved to solve the redundancy problem of the traditional VGG network model, which makes the model structure more lightweight, greatly saves the computational cost, shortens the training time, and finally adopts the joint-sample uniformly distributed cross-entropy as the loss function to solve the overfitting problem and further improve the recognition rate. The experimental results show that the improved VGG model has an identification accuracy of up to 98.84% for the internal damage spectrogram of the wire rope, which shows a good identification ability. Not only that, but the model is also superior, with less time-consuming training and stronger generalization ability. [ABSTRACT FROM AUTHOR]