1. Causal deconvolution by algorithmic generative models
- Author
-
Jesper Tegnér, Allan A. Zea, Narsis A. Kiani, and Hector Zenil
- Subjects
0301 basic medicine ,Algorithmic information theory ,Theoretical computer science ,Dynamical systems theory ,Computer Networks and Communications ,Computer science ,Computability ,Complex network ,Cellular automaton ,Human-Computer Interaction ,03 medical and health sciences ,030104 developmental biology ,0302 clinical medicine ,Artificial Intelligence ,Computer Vision and Pattern Recognition ,Algorithmic probability ,Causation ,030217 neurology & neurosurgery ,Software ,Generative grammar - Abstract
Complex behaviour emerges from interactions between objects produced by different generating mechanisms. Yet to decode their causal origin(s) from observations remains one of the most fundamental challenges in science. Here we introduce a universal, unsupervised and parameter-free model-oriented approach, based on the seminal concept and the first principles of algorithmic probability, to decompose an observation into its most likely algorithmic generative models. Our approach uses a perturbation-based causal calculus to infer model representations. We demonstrate its ability to deconvolve interacting mechanisms regardless of whether the resultant objects are bit strings, space–time evolution diagrams, images or networks. Although this is mostly a conceptual contribution and an algorithmic framework, we also provide numerical evidence evaluating the ability of our methods to extract models from data produced by discrete dynamical systems such as cellular automata and complex networks. We think that these separating techniques can contribute to tackling the challenge of causation, thus complementing statistically oriented approaches. Most machine learning approaches extract statistical features from data, rather than the underlying causal mechanisms. A different approach analyses information in a general way by extracting recursive patterns from data using generative models under the paradigm of computability and algorithmic information theory.
- Published
- 2019