Search

Due to the dynamic development and growing complexity of systems, it is necessary to constantly search for new methods for managing services in cloud computing. Consequently, containerization technologies help to easily deploy applications, manage and distribute cloud provider resources, thereby scaling them, ensure data portability and isolate applications and their dependencies. However, with the growing complexity of infrastructure and data, new challenges, such as ensuring continuous operation of services, resource optimization, load balancing, and system performance, arise. The use of machine learning becomes necessary to solve the many problems that arise in the context of deploying and managing containerized applications. The integration of containerization technology and machine learning allows you to adapt to changing conditions, optimize the use of resources and ensure continuous operation of the system. The article provides an overview of popular machine learning methods and their application in the context of container technologies, presented a reference architecture for container orchestration based on machine learning and their evolution, and also explored containers and orchestrators such as Kubernetes, Docker, Prefect, Nomad, Red Hat OpenShift Service on AWS, Amazon Elastic Container Service (ECS), Google Kubernetes Engine, Azure Kubernetes Service. Machine learning techniques can be used to predict resource consumption, adapt to demand, predict timing for managing container clusters, and analyze workload behavior based on historical data. [ABSTRACT FROM AUTHOR] more...

Copyright of Journal of Economic Research & Business Administration is the property of Al-Farabi Kazakh National University and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) more...

Copyright of Journal of Educational Sciences (2520-2634) is the property of Al-Farabi Kazakh National University and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) more...

В XXI веке произошло взрывное развитие информационно-коммуникационных технологий, которые затронули все сферы жизни людей и особенно организаций. Цель нашего исследования — оценка показателей, характеризующих использование четырех типов информационно-коммуникационных технологий, а именно анализа больших данных, интеллектуального анализа данных, облачных вычислений и Интернета вещей организациями, расположенными в российских регионах. В качестве эмпирических данных использовалась официальная информация Федеральной службы государственной статистики России за 2020 год. Моделирование эмпирических данных было основано на функциях плотности нормального распределения. Основное внимание в исследовании уделено региональным особенностям использования рассматриваемых технологий организациями. Результаты работы показали, что эти виды технологий получили существенное развитие в России. Наибольшее распространение среди четырех рассматриваемых технологий получили анализ больших данных и облачные вычисления. В процессе компаративного анализа были составлены перечни регионов, в которых были расположены организации, отличающиеся максимальными и минимальными значениями показателей. more...

This article presents the application of soft computing methods for solving the problem of designing and optimizing cloud-based Content Distribution Networks (CDN). A multi-objective approach is applied to solve the resource provisioning problem for building the infrastructure for the network, considering the objectives of minimizing the cost of the virtual machines, network, and storage, and the maximization of the quality-of-service provided to end-users. A specific brokering model is proposed to allow a single cloud-based CDN to be able to host multiple content providers applying a resource sharing strategy. Following the proposed brokering model, three multiobjective evolutionary approaches are studied for the offline optimization of resource provisioning and a greedy heuristic method is proposed for addressing the online routing of contents. The experimental evaluation of the proposed approach is performed over a set of realistic problem instances. The obtained experimental results indicate that the proposed approach is effective for designing and optimizing cloud-based Content Distribution Networks: total costs are reduced by up to 10.34% while maintaining high quality-of-service values. more...

This special issue contains selected papers that had been submitted to Proceedings of the Institute for System Programming of the Russian Academy of Sciences. Thirteen submissions from nine countries (England, Mexico, China, Uruguay, Spain, Pakistan, Cuba, Dominican Republic, and Russia) cover several important topics in rapidly expanding area of research and development related with Advanced Computing. Authors show a spectrum of approaches to solve complex problems such as: data-oriented scheduling, scientific workflows, cloud computing, evolutionary algorithms, content distribution networks, soft computing, parallel programming model for multicore machines, high performance computing, data mining, software birth-marking, anomaly detection, swarm robotics, neural networks, machine learning, security, secret-sharing schemes, heterogeneous distributed computing, and Internet of Things. more...

Рассматриваются свойства и особенности «облачных» компьютерных систем с точки зрения моделей информационного и телекоммуникационного взаимодействия. На основе анализа существующих реализаций предложена обобщенная модель архитектуры «облака» как компьютерной системы, даны описания ее состава и основных функций. Проанализированы особенности реализации «клиент-серверной» модели и модели сетевого взаимодействия при построении «облачных» систем. Для описания моделей функционирования «облака» вводятся и классифицируются понятия «облачная компьютерная система», «прокси-клиент». more...

The management intellectualization using intelligence agents, semantic Web-services, cloud computing is proposed. The integration solution in management process based on semantic Web technologies is given. The example of CRM system implementation based on cloud computing technology is shown. more...

Analysis elements of users work in information corporative systems (ICS) are done. The mathematical model of social authentification in ICS allows on given quality of unsatisfactory marks to calculate the probability of successful authentification with the use of time primoderatin calculating. It allows to restore the user password during losing and by villain exchanging. The modifying algorithm on this model base is reproduced which allows to execute user authentification on charger with attraction. The approach for save user activity in clouding computer area is done. more...

At present, big companies such as Amazon, Google, Facebook, Microsoft, Yahoo! own huge datacenters with thousands of nodes. These clusters are used simultaneously by many users. The users submit jobs containing one or more tasks. Task flow is usually a mix of short, long, interactive, batch, and tasks with different priorities. Cluster scheduler decides on which server to run the task, where the task is then run as a process, container or a virtual machine. Scheduler optimizations are important as they provide higher server utilization, lower latency, improved load balancing, and fault tolerance. Achieving good task placement is hard. The problem has multiple dimensions and requires algorithmically complex optimizations. This increases placement latency and limits cluster scalability. In this paper we consider different cluster scheduler architectures and optimization problems. more...

Data Center is the most progressive form of providing computing resources when it is necessary to provide services to a wide range of users. The paper discusses one of the approaches to the creation of a data center - the concept of software-defined infrastructure. Software-defined is such a data center infrastructure, in which all its key elements - computing resources, network, data storage systems, etc. - are virtualized and provided to users as services with a given quality. It is shown that the implementation of the proposed infrastructure allows each user to productively solve their tasks in a reasonable time with an acceptable level of costs. The paper formulates the general requirements for inter-departmental data processing centers, proposes methods for creating software-defined data center (deployment of computing platforms that maximize hardware reuse, provide support for the execution of programs of different classes of tasks, etc.) and describes the implementation of infrastructures of this class in specific projects. more...

Одной из наиболее актуальных задач, связанных с защитой облачных вычислений, является анализ криптостойкости гомоморфных шифров. Данная статья посвящена изучению вопроса о защищенности двух недавно предложенных гомоморфных криптосистем, которые, в связи с их высокой вычислительной эффективностью, могут быть использованы для шифрования данных на облачных серверах. Обе криптосистемы основаны на системах остаточных классов, что позволяет рассмотреть их с единых позиций. Именно использование систем остаточных классов делает применение этих криптосистем в реальных приложениях заманчивым с точки зрения эффективности по сравнению с другими гомоморфными шифрами, так как появляется возможность легко распараллелить вычисления. Однако их криптостойкость не была в достаточной мере изучена в литературе и нуждается в анализе. Отметим, что ранее предшественниками была рассмотрена криптосистема похожая на один из шифров, криптостойкость которого исследуется. Была предложена идея адаптивной атаки по выбранным открытым текстам на эту конструкцию и дана оценка необходимого для раскрытия ключа количества пар <>. Здесь проводится анализ этой атаки и показываем, что иногда она может работать некорректно. Также описывается более общий алгоритм атаки с известными открытыми текстами. Приводятся теоретические оценки вероятности успешного раскрытия секретного ключа с его помощью и практические оценки этой вероятности, полученные в ходе вычислительного эксперимента. Защищенность второй криптосистемы не была исследована ранее в литературе. Изучена её стойкость к атаке с известными открытыми текстами. Проанализирована зависимость необходимого для взлома количества пар <> от параметров криптосистемы и даны рекомендации, которые могут помочь улучшить криптостойкость. Итог проведенного анализа заключается в том, что обе криптосистемы являются уязвимыми к атаке с известными открытыми текстами. Поэтому использовать их для шифрования конфиденциальных данных может быть небезопасно. Основным алгоритмом, используемым в предложенных атаках на криптосистемы, является алгоритм поиска наибольшего общего делителя. Как следствие, время, необходимое для реализации атак, является полиномиальным от размера входных данных. more...

The article focuses on the fact that the need for education is continuous and ongoing process therefore anytime anywhere access to it is becoming a necessity. The need for information is constantly increasing phenomenon. Education should meet the needs of different groups of learners, and therefore, modern information technologies are important to meet this need. Discusses the requirements of society, which consist in the fact that all the members of this society have the necessary level of technological literacy. Thus, increasing access and reducing the cost of education with the aim of achieving the planned quality of education possible to implement cloud-based IT technologies. Sets out the specifics of cloud computing, which imposes special requirements for training in their use, including the management of educational process. Draws conclusions about what information and communication technologies, understanding the capabilities of cloud technologies and their impact on the management efficiency of the education system, are the main prerequisites for the development of professional competence of the head of the educational organization in the field of information technology. more...

This paper is devoted to known plaintexts cryptanalysis of homomorphic cryptosystem proposed by Domingo-Ferrer. In previous works it was shown that at least pairs (plaintext, ciphertext) are necessary to recover secret key, where is a degree of polynomials representing ciphertexts. Here we analyze existing known plaintext attack. And also slightly modified attack on this cryptosystem is presented. It allows to reduce the necessary number of pairs meaningfully. In particular interception only of two pairs may be enough for successful key recovering with overwhelming probability. The running time of our attack depends polynomially on and logarithmically on plaintexts space size as well as for previous attack. We provide the results of computer experiments. more...

A web-laboratory is a web based software platform to support scientific collaboration, research, and education. It has unique combination of capabilities that allows to conduct numerical experiments, discussion of results in workshops and meetings, planning activities, to prepare reports and articles, to support the educational processes (training courses, workshops, labs, etc.). It lets researchers and engineers: run simulation tools; upload and share datasets, documents and other materials; work together in a private space, send messages to one another; ask questions and post responses; work collaboratively on the source code of their simulation programs and share those programs with the community. Web laboratory implementation is related with need to enable dispatching of different remote computational resources (supercomputers , high performance clusters , including accelerators computing, development of 2D and 3D visualization , servers, storage and processing of large data sets , etc.) and software in a way that is completely transparent to users. It is also necessary to provide scalability, reliability and security. Modern method to solve this problem is to use a cloud computing model. In this model computational resources are provided to user as remotely set of elastic services with on demand access. The paper describes an architecture of web laboratory developed in scope of the cloud model. The UniHUB platform implementation based on this architecture is represented. The UniHUB is as an extension of the OpenStack platform. more...

In article questions of an evaluation of complexity of large-block cloud computing with enhanced accuracy are considered. This development is directed on the decision in a cloud of tasks of mathematical simulation with special requirements of accuracy. In particular it is about obtaining the precision and confidential solution of tasks with complex couplings between subtasks in the form of large blocks and the score time considerably exceeding transmission time of information in between. The methodology of an evaluation of complexity of tasks of this sort used for creation of the computing systems, optimum on productivity functioning in the cloudy environment is offered. more...

For efficient use of high-performance computing resources while implementing Computational Science methods for the study of physical, biological and social problems one can use problem-oriented distributed computing environments approach. They provide users with transparent access to the solution of specific classes of applications based on the available computing resources. To increase the effectiveness of such environments, one must use problem-oriented planning methods, which use the information about the subject area for predicting computing problems performance for optimal tasks planning and allocation. In the article the models of the subject area and problem-oriented cloud computing environment, focused on supporting the development of new problem-oriented scheduling algorithms are presented. Subject area P is defined as an ordered triple, consisting of a set of basic information objects B , the set of information object classes C and a set of functions defined over C . The task-oriented cloud computing environment can be defined as an ordered quadruple consisting of the set of nodes of a computer system N ; a set of network connections E ; a set of virtual machines images M , the basic subject area P . It should be required that within a problem-oriented computing environment the following functions for the prediction of the task execution, depending on the values of the input parameters for each class of problems were identified: the estimation of the amount of output data when a certain set of input parameters is given; the evaluation function of task execution time, given certain input parameters on the machine with the specified performance characteristics vector. Since it is impossible to estimate the time of the task execution with a perfect accuracy, task runtime evaluation should be modeled as a random variable. The provided model allows tasks execution time and output parameters volume evaluation through the collection, storage and analysis of statistics for all problems, executed in the environment. more...

This article is an overview of scalable infrastructure for storage and processing of genome data in genetics problems. The overview covers used technologies descriptions, the organization of unified access to genome processing API of different underlying services. The article also covers methods for scalable and cloud computing technologies support. The first service in virtual genome processing laboratory is provided and presented. The service solves transcription factors bindning sites prediction problem. The main principles of service construction are provided. Basic requirements for underlying comptutaion software in virtual laboratory environments are provided. Overview describes the implemented web-service (https://api.ispras.ru/demo/gen) for transcription factors binding site prediction. Provided solution is based on ISPRAS API project as an API gateway and load-balancer; the middle-ware task-manager software for pool of workers support and for communications with Openstack infrastructure; OpenZFS as an intermediate storage with transparent compression support. The described solution is easy to extend with new services fitting the basic requirements. more...

In this paper, we present a Big Data analysis paradigm related to smart cities using cloud computing infrastructures. The proposed architecture follows the MapReduce parallel model implemented using the Hadoop framework. We analyse two case studies: a quality-of-service assessment of public transportation system using historical bus location data, and a passenger-mobility estimation using ticket sales data from smartcards. Both case studies use real data from the transportation system of Montevideo, Uruguay. The experimental evaluation demonstrates that the proposed model allows processing large volumes of data efficiently. more...

Apache Spark is a framework providing fast computations on Big Data using MapReduce model. With cloud environments Big Data processing becomes more flexible since they allow to create virtual clusters on-demand. One of the most powerful open-source cloud environments is Openstack. The main goal of this project is to provide an ability to create virtual clusters with Apache Spark and other Big Data tools in Openstack. There exist three approaches to do it. The first one is to use Openstack REST APIs to create instances and then deploy the environment. This approach is used by Apache Spark core team to create clusters in propriatary Amazon EC2 cloud. Almost the same method has been implemented for Openstack environments. Although since Openstack API changes frequently this solution is deprecated since Kilo release. The second approach is to integrate virtual clusters creation as a built-in service for Openstack. ISP RAS has provided several patches implementing universal Spark Job engine for Openstack Sahara and Openstack Swift integration with Apache Spark as a drop-in replacement for Apache Hadoop. This approach allows to use Spark clusters as a service in PaaS service model. Since Openstack releases are less frequent than Apache Spark this approach may be not convenient for developers using the latest releases. The third solution implemented uses Ansible for orchestration purposes. We implement the solution in loosely coupled way and provide an ability to add any auxiliary tool or even to use another cloud environment. Also, it provides an ability to choose any Apache Spark and Apache Hadoop versions to deploy in virtual clusters. All the listed approaches are available under Apache 2.0 license. more...

This system is designed for automatic workload distribution in a cluster by analysing workload of compute nodes and migrating VMs from overloaded nodes to underloaded ones. Besides workload stabilization, the system also provides an opportunity to reduce power consumption by unloading and suspending underloaded nodes. Workload stabilization in a cluster increases stability and reduces system response time. more...

Exponential grow of volume, increased quality of data in current and incoming sky surveys open new horizons for astrophysics but require new approaches to data processing especially big data technologies and cloud computing. This work presents a MapReduce-based approach to solve a major and important computational task in astrophysics - raw astronomical image data processing. more...

This article is dedicated to automation of cluster creation and management for Apache Spark MapReduce implementation in Openstack environments. As a result of this project open-source (Apache 2.0 license) implementation of toolchain for virtual cluster on-demand creation in Openstack environments was presented. The article contains an overview of existing solutions for clustering automation in cloud environments by the start of 2014 year. The article provides a shallow overview of issues and problems in Openstack Heat project that provides a compatibility layer for Amazon EC2 API. The final implementation provided in the article is almost strainforward port of existing toolchain for cluster creation automation for Apache Spark in Amazon EC2 environment with some improvements. Also prepared base system virtual machine image for Openstack is provided. Plans for further work are connected with Ansible project. Using Ansible for observed problem will make possible to implement versatile environment-agnostic solution that is able to work using any cloud computing services provider, set of Docker containers or bare-metal clusters without any dependencies for prepared operating system image. Current article doesn't use Ansible due to the lack of key features at the moment of the project start. The solution provided in this article has been already tested in production environment for graph theory research arcticle. more...

Information security in cloud computing technology is actively investigated by the world scientific community. They uses the internet and the central remote servers to provide and maintain data as well as applications. This users' data files can be accessed and manipulated by any other users. So the problem of secure data storage and computation is actual. The modern studies in this field shows that the indicated problem is much more complex than any of the other information security problems, which are solved by well-known cryptographic methods. So, for example M. van Dijk and A. Juels in the paper "On the impossibility of cryptography alone for privacy-preserving cloud computing" described a mathematical model of the organization of cloud computing and proved that in the case of two users information protection is impossible. This result refutes the well-established point of view that the recently proposed by C. Gentry construction for fully homomorphic encryption solves at least theoretically, all the problems of information security in cloud computing. We offer an alternative model of cloud computing, in which the specified negative result does not holds. It differs from the above in the point that each subject interested in privacy, creates his own crypto server. From the point of view of users these cryptoservers are the part of the cloud. The methods of information protection, using threshold cryptosystem in this new model are investigated. more...

Fully homomorphic encryption (FHE) is a recognized tool to obtain the cryptographic protec-tion of cloud computing. However, the characteristics of existing FHE schemes are not suffi-cient for use in practice � the security of some FHE is unsatisfying, others require too much computational resources. For improvement the efficiency of the last one IBM researchers pro-posed a method for "ciphertexts batching", which was applied by them to public key FHE scheme whose security is based on the complexity of the lattice theory hardness assumptions. In this paper, we discuss several methods for embedding "ciphertexts batching" into recently proposed symmetric encryption scheme based on matrix polynomials. For one of this method we completely specify how cryptosystem algorithms should work. The results of computer experiments are given. more...

The paper describes some basic topics and use cases of cloud computing environments in various scientific laboratories. It describes the Joint Institute for Nuclear Research (JINR) activities aimed at the development of the cloud infrastructure deployed in the Laboratory of Infomation Technologies in JINR, as well as applied strategies of the improvement of efficiency, fault tolerance and reliability of the JINR cloud service, and also its integration with other cloud services. more...

Monitoring results of SkyHigh product are presented. This product has been used to analyse the incidents of information security in SaaS cloud computing model in one of the companies. Analysis showed economical use of cloud computing for the given company while also ensuring the needed level of data security in the cloud. more...

Copyright of International Journal of Research in E-Learning is the property of Wydawnictwo Uniwersytetu Slaskiego and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) more...

This article analyzes the main methods of scaling databases (replication, sharding) and their support at the popular relational databases and NoSQL solutions with different data models: a document-oriented, key-value, column-oriented, graph. The article provides an assessment of the capabilities of modern cloud-based solution and gives a model for the organization of dynamic scaling in the cloud infrastructure. In the article are analyzed different types of metrics and are included the basic metrics that characterize the functioning parameters and database technology, as well as sets the goals of the integral metrics, necessary for the implementation of adaptive algorithms for dynamic scaling databases in the cloud infrastructure. This article was prepared with the support of RFBR grant № 13-07-00749. more...

This article analyzes the main methods of scalingdatabases (replication, sharding) and their supportat the popular relational databases and NoSQLsolutions with different data models: document-oriented, key-value, column-oriented and graph.The article presents an algorithm for the dynamicscaling of a relational database (DB), that takesinto account the specifics of the different types of logic database model. This article was prepared with the support of RFBR (grant № 13-07-00749). more...

The article discusses the features of building theInformation Space of St. Petersburg. It was statedthat there is strong inefficiency of investments inthe existing information systems in St. Petersburg.The reinvention of information systems into cloudservices with private partnership is recommended.Basing on the developed method was provided anapproach to the task of building an effective infrastructure of information systems and the choice ofoptions for its cooperation. The results can be used as a tool for transforming the variety of informationsystems into a single information environment, andtransforming the infrastructure to cloud technologyby reinvention of existing information and telecommunication infrastructure. more...

There is pronounced interest to cloud computing in the scientific community. However, current cloud computing offerings are rarely suitable for highperformance computing, in large part due to an overhead level of underlying virtualization components. The purpose of this paper is to propose a design and implementation of a cloud system that possesses a small enough overhead level to allow it to be practically used for a wide range of scientific workloads. First, we describe requirements for the desired system and classify workloads to identify those that are practical to transfer to the cloud. Then, we review related work. Finally, we describe our cloud system, "Virtual Supercomputer", which is based on the OpenStack cloud infrastructure and KVM/QEMU hypervisor. Most components of the original infrastructure were modified to satisfy the requirements. In particular, we tuned KVM/QEMU and the host operating system, introduced the concept of virtual machine groups and implemented a topology-aware scheduler to reduce communication overhead between network nodes belonging to the same virtual machine group. Also, we implemented a proof-of-concept web service on top of our system that allows to use OpenFOAM toolbox in software-as-a-service manner. The main result of our work is that "Virtual Supercomputer" achieved the overhead level of less than 10% on industry standard benchmarks when using up to 1024 processor cores. We deem this overhead level as acceptable for practical use. more...

For some compute intensive applications cloud computing can be a costeffective alternative or an addition to supercomputers. However, in the case of highperformance computing, overall application performance depends heavily on how processes are mapped to the network nodes. Therefore a cloud scheduler must be topology-aware to reduce network congestion. In this paper the Hop-Byte metric for the case of "fat tree" network topology was evaluated under the assumption that all pairs of processes communicate evenly. We propose a scheduling algorithm that tries to minimize this metric, which was implemented atop the OpenStack scheduler. All instances are divided into groups according to compute intensive application they belong to. Every time the scheduler receives a request for launching N new instances of the same group, it maps them to the nodes in such a way that entire group (including already running instances) uses as few lower-level switches in “fat tree” as possible. We measured the impact of topology-aware scheduling on the performance of NASA Advanced Supercomputing Parallel Benchmarks. Results of 10 of 11 benchmarks changed insignificantly. The average time of Block Tridiagonal test decreased by 14%, the maximum time decreased by 40% and the difference between the maximum time and the minimum time decreased from 42% to 3%, that is, fluctuation almost disappeared. more...

Copyright of Black Sea / Karadeniz is the property of Black Sea / Karadeniz and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) more...

The article presents the main approaches to cloud computing infrastructure based on the SDN network in present data processing centers (DPC). The main indexes of management effectiveness of network infrastructure of DPC are determined. The examples of solutions for the creation of virtual network devices are provided. more...

Copyright of Economic Annals-XXI / Ekonomìčnij Časopis-XXI is the property of Institute of Society Transformation and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) more...