Search

Quantization has become increasingly pivotal in addressing the steadily increasing computational and memory requirements of Deep Neural Networks (DNNs). By reducing the number of bits used to represent weights and activations (typically from 32-bit floating-point to 16-bit or 8-bit integers), quantization reduces the memory footprint, energy consumption, and execution time of DNN models. However, traditional quantization methods typically focus on the inference of DNNs, while the training process still relies on floating-point operations. To date, only one work in the literature has addressed integer-only training for Multi-Layer Perceptron (MLP) architectures. This work introduces NITRO-D, a new framework for training arbitrarily deep integer-only Convolutional Neural Networks (CNNs) that operate entirely in the integer-only domain for both training and inference. NITRO-D is the first framework in the literature enabling the training of integer-only CNNs without the need to introduce a quantization scheme. Specifically, NITRO-D introduces a novel architecture integrating multiple integer local-loss blocks, which include the proposed NITRO Scaling Layer and the NITRO-ReLU activation function. Additionally, it introduces a novel integer-only learning algorithm derived from Local Error Signals (LES), utilizing IntegerSGD, an optimizer specifically designed to operate in an integer-only context. NITRO-D is implemented in an open-source Python library. Extensive experimental evaluations demonstrate its effectiveness across several state-of-the-art image recognition datasets. Results show significant performance improvements from 2.47% to 5.96% for integer-only MLP architectures over the state-of-the-art solution, and the capability of training integer-only CNN architectures with minimal accuracy degradation from -0.15% to -4.22% compared to floating-point LES., Comment: 15 pages, 3 figures

This paper investigates citizens' counter-strategies to the use of Artificial Intelligence (AI) by law enforcement agencies (LEAs). Based on information from three countries (Greece, Italy and Spain) we demonstrate disparities in the likelihood of ten specific counter-strategies. We further identified factors that increase the propensity for counter-strategies. Our study provides an important new perspective to societal impacts of security-focused AI applications by illustrating the conscious, strategic choices by citizens when confronted with AI capabilities for LEAs., Comment: 20th International Conference on Information and Knowledge Engineering (IKE'21), 3 papges, 1 figure

We prove that two reflection factorizations of a given element in an exceptional rank-2 complex reflection group of tetrahedral type are Hurwitz-equivalent if and only if they generate the same subgroup and have the same multiset of conjugacy classes., Comment: 18 pages

We provide a variety of cases in which two factorizations have Hurwitz orbits of the same size. We begin with prototypical results about factorizations of length two, and show that cycling elements or flipping and inverting elements in any factorization preserves Hurwitz orbit size. We prove that "double reverse" factorizations in groups with special presentations have Hurwitz orbits of equal size, and end with applications to complex reflection groups., Comment: 14 pages

The link between the equation $b(b+a)-a^2=0$ concerning the side $b$ and the diagonal $a$ of a regular pentagon and the {\it Cassini identity} $F_{i}F_{i+2}-F_{i+1}^2=(-1)^{i}$, concerning three consecutive Fibonacci numbers, is very strong. In this paper we present our thesis that the two mentioned equations were "almost simultaneously" discovered by the {\it Pythagorean School}., Comment: 10 pages and 1 figure

In this paper, we characterize by lexicographic order all finite Sturmian and episturmian words, i.e., all (finite) factors of such infinite words. Consequently, we obtain a characterization of infinite episturmian words in a "wide sense" (episturmian and episkew infinite words). That is, we characterize the set of all infinite words whose factors are (finite) episturmian. Similarly, we characterize by lexicographic order all balanced infinite words over a 2-letter alphabet; in other words, all Sturmian and skew infinite words, the factors of which are (finite) Sturmian., Comment: 18 pages; to appear in the European Journal of Combinatorics