Search

This is the Scientific Report and Prototype Description (Y2), reflecting the work done in the scope of the Data-Driven Infrastructure Management (DDIM) capability of the overall BigDataStack environment. The document describes the DDIM solution as assembled at M23 of the project (i.e. November 2019) in terms of updated design specifications, implementation, integration details, experimentation outcomes and next steps for the highlevel components comprising the DDIM solution: Cluster Management, Dynamic Orchestration, ADS Ranking & Deploy, Triple Monitoring & QoS Evaluation, and InformationDriven Networking. Regarding research results, it focuses on the research conducted to optimize the two components bringing artificial intelligence (AI) to the solution: the ADS Ranking—responsible for ranking and selecting the best application deployment configurations—and the Dynamic Orchestration—in charge of making re-deployment decisions. Both components make use of machine learning (ML) techniques to bring the data-driven aspect to the DDIM capability. The rest of the components complement the above towards the overall data-driven functionality targeted at the level of infrastructure management: Cluster Management and Information-Driven Networking, responsible for the management and monitoring of the infrastructure resources (compute, storage and networking), and the Triple Monitoring & QoS Evaluation, responsible for the monitoring and evaluation of the QoS at different levels of the solution, that is, infrastructure resources, data services and application services. This document concludes with the description of global experimentation outcomes related to the ranking of the performance of grocery product recommendation techniques for the Connected Consumer use case.

This deliverable describes the key functionalities of the overall architecture, the interactions between the main building blocks and their components, {"references":["Docker compose, https://docs.docker.com/compose/compose-file/","OpenShift Origin Kubernetes Distribution, https://www.openshift.com/","J. Duncan, J. Osborne \"Chapter 1. Getting to know OpenShift\" in \"OpenShift in Action\". Manning Publications Co. ISBN 978-1-6172-9483-9, 2018","2 RedHat, \"How Deployments Work\", https://docs.okd.io/latest/dev_guide/deployments/how_deployments_work.html","3 Larry Carvalho Matthew Marden, \"The Business Value of Red Hat OpenShift\", https://cdn2.hubspot.net/hubfs/4305976/s3-files/idc-business-value-of-openshift.pdf","5 RedHat, \"What's New in Red Hat OpenShift Origin 3.10 OpenShift Commons Briefing\", https://blog.openshift.com/wp-content/uploads/Whats-New-in-Origin-3.10.pdf","[3x] Geard, https://openshift.github.io/geard/","[3y] Project Atomic, https://www.projectatomic.io/","4 RedHat, \"Architecture OpenShift Container Platform 3.6 Architecture Information\", https://access.redhat.com/documentation/enus/openshift_container_platform/3.6/pdf/architecture/OpenShift_Container_Platform-3.6- Architecture-en-US.pdf","ITU, \"User Requirements Notation\", https://www.itu.int/rec/T-REC-Z.151-201210-I/en","BigDataStack (July 2018). \"D2.1 – State of the art and Requirements analysis - I\"","V. Gulisano, R. Jiménez-Peris, M. Patiño-Martínez, C. Soriente, P. Valduriez, \"StreamCloud: An Elastic and Scalable Data Streaming System\", IEEE Trans. Parallel Distrib. Syst. 23(12): 2351-2365, 2012","Apache Storm, http://storm.apache.org/","Apache Flink, http://flink.apache.org","Apache Spark, https://spark.apache.org/streaming","Paula Ta-Shma, \"How to Layout Big Data in IBM Cloud Object Storage for Spark SQL\", https://www.ibm.com/blogs/bluemix/2018/06/big-data-layout/","R. Raschke, \"Process-based view of agility: The value contribution of IT and the effects on process outcomes.\" International Journal of Accounting Information Systems 11.4: 297-313, 2010","Workflow Patterns Initiative http://www.workflowpatterns.com/R","IOStack H2020 project, http://iostack.eu","Node-RED, https://nodered.org/","Data-Driven Documents, https://d3js.org/","Flow-Based Programming for JavaScript - NoFlo, https://noflojs.org/"]}

The current datacenter-centralized architecture limits the cloud to the location of the datacenters, generally far from the user. This architecture collides with the latest trend of ubiquity of Cloud computing. Also, current estimated energy usage of data centers and core networks adds up to 3% of the global energy production, while according to latest estimations only 42,3% of the population is connected. In the current work, we focused on two drawbacks of datacenter-centralized Clouds: Energy consumption and poor quality of service. On the one hand, due to its centralized nature, energy consumption in networks is affected by the centralized vision of the Cloud. That is, backbone networks increase their energy consumption in order to connect the clients to the datacenters. On the other hand, distance leads to increased utilization of the broadband Wide Area Network and poor user experience, especially for interactive applications. A distributed approach can provide a better Quality of Experience (QoE) in large urban populations in mobile cloud networks. To do so, the cloud should confine local traffic close to the user, running on the users and network devices. In this work, we propose a novel distributed cloud architecture based on microclouds. Microclouds are dynamically created and allow users to contribute resources from their computers, mobile and network devices to the cloud. This way, they provide a dynamic and scalable system without the need of an extra investment in infrastructure. We also provide a description of a realistic mobile cloud use case, and the adaptation of microclouds on it. Through simulations, we show an overall saving up to 75% of energy consumed in standard centralized clouds with our approach. Also, our results indicate that this architecture is scalable with the number of mobile devices and provide a significantly lower latency than regular datacenter-centralized approaches. Finally, we analyze the use of incentives for Mobile Clouds, and propose a new auction system adapted to the high dynamism and heterogeneity of these systems. We compare our solution to other existing auctions systems in a Mobile Cloud use case, and show the suitability of our solution.; L'architecture actuelle du cloud, reposant sur des datacenters centralisés, limite la qualité des services offerts par le cloud du fait de l'éloignement de ces datacenters par rapport aux utilisateurs. En effet, cette architecture est peu adaptée à la tendance actuelle promouvant l'ubiquité du cloud computing. De plus, la consommation énergétique actuelle des data centers, ainsi que du cœur de réseau, représente 3% de la production totale d'énergie, tandis que selon les dernières estimations, seulement 42,3% de la population serait connectée. Dans cette thèse, nous nous intéressons à deux inconvénients majeurs des clouds centralisés: la consommation d'énergie ainsi que la faible qualité de service offerte. D'une part, du fait de son architecture centralisée, le cœur de réseau consomme plus d'énergie afin de connecter les utilisateurs aux datacenters. D'autre part, la distance entre les utilisateurs et les datacenters entraîne une utilisation accrue du réseau mondial à large bande, menant à des expériences utilisateurs de faible qualité, particulièrement pour les applications interactives. Une approche semi-centralisée peut offrir une meilleur qualité d'expérience aux utilisateurs urbains dans des réseaux clouds mobiles. Pour ce faire, cette approche confine le traffic local au plus proche de l'utilisateur, tout en maintenant les caractéristiques centralisées s’exécutant sur les équipements réseaux et utilisateurs. Dans cette thèse, nous proposons une nouvelle architecture de cloud distribué, basée sur des "microclouds". Des "microclouds" sont créés de manière dynamique, afin que les ressources utilisateurs provenant de leurs ordinateurs, téléphones ou équipements réseaux puissent être mises à disposition dans le cloud. De ce fait, les microclouds offrent un système dynamique, passant à l'échelle, tout en évitant d’investir dans de nouvelles infrastructures. Nous proposons également un exemple d'utilisation des microclouds sur un cas typique réel. Par simulation, nous montrons que notre approche permet une économie d'énergie pouvant atteindre 75%, comparée à une approche centralisée standard. En outre, nos résultats indiquent que cette architecture passe à l'échelle en terme du nombre d'utilisateurs mobiles, tout en offrant une bien plus faible latence qu'une architecture centralisée. Pour finir, nous analysons comment inciter les utilisateurs à partager leur ressources dans les clouds mobiles et proposons un nouveau mécanisme d'enchère adapté à l'hétérogénéité et la forte dynamicité de ces systèmes. Nous comparons notre solution aux autres mécanismes d’enchère existants dans des cas d'utilisations typiques au sein des clouds mobiles, et montrons la pertinence de notre solution.

During the last decade, technology has created a new field in software development, known as pervasive computing, thank lo the improvement and extension of integrated sensors. These sensors have been successfully integrated in the daily-life of the common user, using devices like mobile phones. Those new hardware improvements gave the common developer the chance to generate new and more complete applications, which interact with the user's life with a minimum effort. However, it also meant an extra consumption of device's resources, which is translated into a extra energy consumption. The contribution of this work is to propose a new policy for energy saving applications in the framework of context­aware systems. The expected energy saving achieved through this police means to be significant both in the perception of the duration of the battery by the user and reducing the impact of these devices in the environment.

Children younger than 3 years old are very special humans, their psychomotor and social development is very fast and parents and relatives would like to know every new detail (when, who, where, what, how and why) in real time. These news are difficult to remember and some kind of diary is needed. Here we propose a “prosthetic memory” based on Digital Object Memories applied to Web of Things using hidden NFC tags in children’s clothes, mobile applications for smartphones and a cen tral server to store the ontologized information.

Security has become one of the most important fea tures in modern computation, especially due to the point of view of the user. Security issues (like pri vacy or secure use of the application) will be taken into account during the evaluation of the system by the final user. Also, it is an important issue for the developer, due to the reason that the developer should be sure about the correct performance of the system. The purpose of this paper is to offer a deep survey on existent attacks to GSM location adapt ing them from common GSM attacks to location attacks.

Children younger than 3 years old are very special humans, their psychomotor and social development is very fast and parents and relatives would like to know every new detail (when, who, where, what, how and why) in real time. These news are difficult to remember and some kind of diary is needed. Here we propose a “prosthetic memory” based on Digital Object Memories applied to Web of Things using hidden NFC tags in children’s clothes, mobile applications for smartphones and a central server to store the ontologized information.