31 results
Search Results
2. Data-Driven Analysis for RFID-Enabled Smart Factory: A Case Study.
- Author
-
Feng, Jiqiang, Li, Feipeng, Xu, Chen, and Zhong, Ray Y.
- Subjects
MACHINE shops ,RADIO frequency ,BIG data ,FACTORIES ,ACQUISITION of data ,CASE studies - Abstract
The emergence of Internet of Things (IoT) and new manufacturing paradigms have brought greater complexity of massive datasets. Radio frequency identification (RFID), as one of the key IoT technologies, has been used to collect real-time production data to support the manufacturing decision-making in smart factories. The adoption of these technologies results in a large amount of data collection. To extract useful information from this data, this paper utilizes a big data approach to figure out useful insights from RFID-enabled data regarding possible bottlenecks or inefficiencies on the shop floor so as to improve the quality management. Time and quality are the main metrics measured in this paper, where the longest process times, part accuracy percentage, and failure rate are determined for each of the workers (UserIDs) and process types (ProcCodes). Key findings and observations are significant to make advanced decisions in the smart factory by making full use of the RFID captured data. Note to Practitioners— This paper was motivated by a real-life company which has used RFID technology for over ten years. Great myriad of data has been captured from frontline production shop floors where machines, workers, materials, and manufacturing jobs were logically associated. Processing time and quality data are studied in this paper so as to investigate the production performance in the RFID-enabled smart factory. [ABSTRACT FROM AUTHOR]
- Published
- 2020
- Full Text
- View/download PDF
3. A Framework for Mining RFID Data From Schedule-Based Systems.
- Author
-
Ertek, Gurdal, Chi, Xu, and Zhang, Allan N.
- Subjects
ALGORITHMS ,BIG data - Abstract
A schedule-based system is a system that operates on or contains within a schedule of events and breaks at particular time intervals. Entities within the system show presence or absence in these events by entering or exiting the locations of the events. Given radio frequency identification (RFID) data from a schedule-based system, what can we learn about the system (the events and entities) through data mining? Which data mining methods can be applied so that one can obtain rich actionable insights regarding the system and the domain? The research goal of this paper is to answer these posed research questions, through the development of a framework that systematically produces actionable insights for a given schedule-based system. We show that through integrating appropriate data mining methodologies as a unified framework, one can obtain many insights from even a very simple RFID dataset, which contains only very few fields. The developed framework is general, and is applicable to any schedule-based system, as long as it operates under certain basic assumptions. The types of insights are also general, and are formulated in this paper in the most abstract way. The applicability of the developed framework is illustrated through a case study, where real world data from a schedule-based system is analyzed using the introduced framework. Insights obtained include the profiling of entities and events, the interactions between entity and events, and the relations between events. [ABSTRACT FROM AUTHOR]
- Published
- 2017
- Full Text
- View/download PDF
4. Dynamic Delay Predictions for Large-Scale Railway Networks: Deep and Shallow Extreme Learning Machines Tuned via Thresholdout.
- Author
-
Oneto, Luca, Fumeo, Emanuele, Clerico, Giorgio, Canepa, Renzo, Papa, Federico, Dambra, Carlo, Mazzino, Nadia, and Anguita, Davide
- Subjects
DYNAMICS ,RAILROAD trains ,INTELLIGENT transportation systems - Abstract
Current train delay (TD) prediction systems do not take advantage of state-of-the-art tools and techniques for handling and extracting useful and actionable information from the large amount of endogenous (i.e., generated by the railway system itself) and exogenous (i.e., related to railway operation but generated by external phenomena) data available. Additionally, they are not designed in order to deal with the intrinsic time varying nature of the problem (e.g., regular changes in the nominal timetable, etc.). The purpose of this paper is to build a dynamic data-driven TD prediction system that exploits the most recent tools and techniques in the field of time varying big data analysis. In particular, we map the TD prediction problem into a time varying multivariate regression problem that allows exploiting both historical data about the train movements and exogenous data about the weather provided by the national weather services. The performance of these methods have been tuned through the state-of-the-art thresholdout technique, a very powerful procedure which relies on the differential privacy theory. Finally, the performance of two efficient implementations of shallow and deep extreme learning machines that fully exploit the recent in-memory large-scale data processing technologies have been compared with the current state-of-the-art TD prediction systems. Results on real-world data coming from the Italian railway network show that the proposal of this paper is able to remarkably improve the state-of-the-art systems. [ABSTRACT FROM AUTHOR]
- Published
- 2017
- Full Text
- View/download PDF
5. Sliding Window-Based Fault Detection From High-Dimensional Data Streams.
- Author
-
Zhang, Liangwei, Lin, Jing, and Karim, Ramin
- Subjects
ELECTRIC power system faults ,BIG data ,ALGORITHMS - Abstract
High-dimensional data streams are becoming increasingly ubiquitous in industrial systems. Efficient detection of system faults from these data can ensure the reliability and safety of the system. The difficulties brought about by high dimensionality and data streams are mainly the “curse of dimensionality” and concept drifting, and one current challenge is to simultaneously address them. To this purpose, this paper presents an approach to fault detection from nonstationary high-dimensional data streams. An angle-based subspace anomaly detection approach is proposed to detect low-dimensional subspace faults from high-dimensional datasets. Specifically, it selects fault-relevant subspaces by evaluating vectorial angles and computes the local outlier-ness of an object in its subspace projection. Based on the sliding window strategy, the approach is further extended to an online mode that can continuously monitor system states. To validate the proposed algorithm, we compared it with the local outlier factor-based approaches on artificial datasets and found the algorithm displayed superior accuracy. The results of the experiment demonstrated the efficacy of the proposed algorithm. They also indicated that the algorithm has the ability to discriminate low-dimensional subspace faults from normal samples in high-dimensional spaces and can be adaptive to the time-varying behavior of the monitored system. The online subspace learning algorithm for fault detection would be the main contribution of this paper. [ABSTRACT FROM PUBLISHER]
- Published
- 2017
- Full Text
- View/download PDF
6. A Deep Latent Factor Model for High-Dimensional and Sparse Matrices in Recommender Systems.
- Author
-
Wu, Di, Luo, Xin, Shang, Mingsheng, He, Yi, Wang, Guoyin, and Zhou, MengChu
- Subjects
SPARSE matrices ,RECOMMENDER systems ,DEEP learning ,COMPUTATIONAL complexity ,NONLINEAR functions ,MATRICES (Mathematics) - Abstract
Recommender systems (RSs) commonly adopt a user-item rating matrix to describe users’ preferences on items. With users and items exploding, such a matrix is usually high-dimensional and sparse (HiDS). Recently, the idea of deep learning has been applied to RSs. However, current deep-structured RSs suffer from high computational complexity. Enlightened by the idea of deep forest, this paper proposes a deep latent factor model (DLFM) for building a deep-structured RS on an HiDS matrix efficiently. Its main idea is to construct a deep-structured model by sequentially connecting multiple latent factor (LF) models instead of multilayered neural networks through a nonlinear activation function. Thus, the computational complexity grows linearly with its layer count, which is easy to resolve in practice. The experimental results on four HiDS matrices from industrial RSs demonstrate that when compared with state-of-the-art LF models and deep-structured RSs, DLFM can well balance the prediction accuracy and computational efficiency, which well fits the desire of industrial RSs for fast and right recommendations. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
7. New IT Driven Service-Oriented Smart Manufacturing: Framework and Characteristics.
- Author
-
Tao, Fei and Qi, Qinglin
- Subjects
INFORMATION technology ,MANUFACTURING processes ,INTERNET of things - Abstract
Recently, along with the wide application of new generation information technologies (New IT) in manufacturing, many countries issued their national advanced manufacturing development strategies, such as Industrial Internet, Industry 4.0, and Made in China 2025. One common aim of these strategies is to achieve smart manufacturing, which demands the interoperation, integration, and fusion of the physical world and the cyber world of manufacturing. As well, New IT [such as Internet of Things (IoT), cloud computing, big data, mobile Internet, and cyber-physical systems (CPS)] have played pivotal roles in promoting smart manufacturing. Data generated in the physical world can be sensed and transfered to the cyber world through IoT and the Internet, and be processed and analyzed by cloud computing, big data technologies to adjust the physical world. The physical world and the cyber world of manufacturing are integrated based on CPS. On the other hand, servitization has become a prominent trend in the manufacturing. Embracing the concept of “Manufacturing-as-a-Service,” manufacturing is provided as service for users. Because of the characteristics of interoperability and platform independence, services pave the way for large-scale smart applications and manufacturing collaboration. Combining New IT and services, this paper proposes a framework—New IT driven service-oriented smart manufacturing (SoSM). SoSM aims at facilitating the visions of smart manufacturing by making full use of New IT and services. Complementary to the framework of SoSM, the New IT driven typical characteristics of SoSM are also investigated and discussed, respectively. [ABSTRACT FROM AUTHOR]
- Published
- 2019
- Full Text
- View/download PDF
8. Game Theoretic Suppression of Forged Messages in Online Social Networks.
- Author
-
Wang, Xu, Zha, Xuan, Ni, Wei, Liu, Ren Ping, Guo, Y. Jay, Niu, Xinxin, and Zheng, Kangfeng
- Subjects
ONLINE social networks ,FORGING ,BEHAVIORAL assessment ,ELECTRONIC books - Abstract
Online social networks (OSNs) suffer from forged messages. Current studies have typically been focused on the detection of forged messages and do not provide the analysis of the behaviors of message publishers and network strategies to suppress forged messages. This paper carries out the analysis by taking a game theoretic approach, where infinitely repeated games are constructed to capture the interactions between a publisher and a network administrator and suppress forged messages in OSNs. Critical conditions, under which the publisher is disincentivized to publish any forged messages, are identified in the absence and presence of misclassification on genuine messages. Closed-form expressions are established for the maximum number of forged messages that a malicious publisher could publish. Confirmed by the numerical results, the proposed infinitely repeated games reveal that forged messages can be suppressed by improving the payoffs for genuine messages, increasing the cost of bots, and/or reducing the payoffs for forged messages. The increasing detection probability of forged messages or decreasing misclassification probability of genuine messages also has a strong impact on the suppression of forged messages. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
9. Latent Factor-Based Recommenders Relying on Extended Stochastic Gradient Descent Algorithms.
- Author
-
Luo, Xin, Wang, Dexian, Zhou, MengChu, and Yuan, Huaqiang
- Subjects
RECOMMENDER systems ,MISSING data (Statistics) ,ALGORITHMS ,SPARSE matrices ,GENEALOGY ,SUPPORT vector machines - Abstract
High-dimensional and sparse (HiDS) matrices generated by recommender systems contain rich knowledge regarding various desired patterns like users’ potential preferences and community tendency. Latent factor (LF) analysis proves to be highly efficient in extracting such knowledge from an HiDS matrix efficiently. Stochastic gradient descent (SGD) is a highly efficient algorithm for building an LF model. However, current LF models mostly adopt a standard SGD algorithm. Can SGD be extended from various aspects in order to improve the resultant models’ convergence rate and prediction accuracy for missing data? Are such SGD extensions compatible with an LF model? To answer them, this paper carefully investigates eight extended SGD algorithms to propose eight novel LF models. Experimental results on two HiDS matrices generated by real recommender systems show that compared with an LF model with a standard SGD algorithm, an LF model with extended ones can achieve: 1) higher prediction accuracy for missing data; 2) faster convergence rate; and 3) model diversity. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
10. Distributed Nonlinear Semiparametric Support Vector Machine for Big Data Applications on Spark Frameworks.
- Author
-
Diaz-Morales, Roberto and Navia-Vazquez, Angel
- Subjects
SUPPORT vector machines ,BIG data ,PATTERNS (Mathematics) ,CENTROID ,ALGORITHMS - Abstract
In recent years there has been a noticeable increase in the number of available Big Data infrastructures. This fact has promoted the adaptation of traditional machine learning techniques to be capable of addressing large scale problems in distributed environments. Kernel methods like support vector machines (SVMs) suffer from scalability problems due to their nonparametric nature and the complexity of their training procedures. In this paper, we propose a new and efficient distributed implementation of a training procedure for nonlinear semiparametric (budgeted) SVMs called distributed iterative reweighted least squares (IRWLS). This algorithm uses $ {k}$ -means to select the centroids of the semiparametric model and a new distributed algorithmic implementation of the IRWLS optimization procedure to find the weights of the model. We have implemented the proposed algorithm in Apache Spark and we have benchmarked it against other state-of-the-art methods, either full SVM ($ {p}$ -pack SVM) or budgeted (budgeted stochastic gradient descent). Experimental results show that the proposed algorithm achieves higher accuracy while controlling the size of the final model, and also offers high performance in terms of run time and efficiency, when processing very large datasets (the computation time grows linear with the number of training patterns). [ABSTRACT FROM AUTHOR]
- Published
- 2020
- Full Text
- View/download PDF
11. One-Class Convex Hull-Based Algorithm for Classification in Distributed Environments.
- Author
-
Fernandez-Francos, Diego, Fontenla-Romero, Oscar, and Alonso-Betanzos, Amparo
- Subjects
PLURALITY voting ,CLASSIFICATION algorithms ,DISTRIBUTED algorithms ,BIG data ,DISTRIBUTED databases ,PARALLEL algorithms - Abstract
In this paper, a new one-class classification algorithm capable of working in distributed environments is presented. In it, convex hull is used to build the boundary of the target class defining the one-class problem in each of the distributed nodes. Therefore, we will consider several classifiers, each one determined using a given local data partition, and the goal is to obtain a global classification decision. In order to obtain this final decision, two different algebraic combination rules were proposed: 1) sum and 2) majority voting. Experimental results show that this method opens the possibility of tackling practical one-class classification problems in distributed big data scenarios in an efficient and accurate way. [ABSTRACT FROM AUTHOR]
- Published
- 2020
- Full Text
- View/download PDF
12. An Improved Deep Computation Model Based on Canonical Polyadic Decomposition.
- Author
-
Zhang, Qingchen, Yang, Laurence T., Chen, Zhikui, and Li, Peng
- Subjects
DEEP learning ,POLYADIC algebras - Abstract
Deep computation models achieve super performance for big data feature learning. However, training a deep computation model poses a significant challenge since a deep computation model typically involves a large number of parameters. Specially, it needs a high-performance computing server with a large-scale memory and a powerful computing unit to train a deep computation model, making it difficult to increase the size of a deep computation model further for big data feature learning on low-end devices such as conventional desktops and portable CPUs. In this paper, we propose an improved deep computation model based on the canonical polyadic decomposition scheme to compress the parameters and to improve the training efficiency. Furthermore, we devise a learning algorithm based on the back-propagation strategy to train the parameters of the proposed model. The learning algorithm can be directly performed on the compressed parameters to improve the training efficiency. Finally, we carry on the experiments on three representative datasets, i.e., CUAVE, SNAE2, and STL-10, to evaluate the performance of the proposed model by comparing with the conventional deep computation model and other two improved deep computation models based on the Tucker decomposition and the tensor-train network. Results demonstrate that the proposed model can compress parameters greatly and improve the training efficiency significantly with a low classification accuracy drop. [ABSTRACT FROM AUTHOR]
- Published
- 2018
- Full Text
- View/download PDF
13. Stochastic Decision Making for Adaptive Crowdsourcing in Medical Big-Data Platforms.
- Author
-
Kim, Joongheon and Lee, Wonjun
- Subjects
BIG data ,STOCHASTIC processes ,ACCESS points (Indexing) - Abstract
This paper proposes two novel algorithms for adaptive crowdsourcing in 60-GHz medical imaging big-data platforms, namely, a max-weight scheduling algorithm for medical cloud platforms and a stochastic decision-making algorithm for distributed power-and-latency-aware dynamic buffer management in medical devices. In the first algorithm, medical cloud platforms perform a joint queue-backlog and rate-aware scheduling decisions for matching deployed access points (APs) and medical users where APs are eventually connected to medical clouds. In the second algorithm, each scheduled medical device computes the amounts of power allocation to upload its own medical data to medical big-data clouds with stochastic decision making considering joint energy-efficiency and buffer stability optimization. Through extensive simulations, the proposed algorithms are shown to achieve the desired results. [ABSTRACT FROM PUBLISHER]
- Published
- 2015
- Full Text
- View/download PDF
14. Using Deep Learning-Based Approach to Predict Remaining Useful Life of Rotating Components.
- Author
-
Deutsch, Jason and He, David
- Subjects
ROTATING discs (Engineering) ,PRODUCT life cycle ,DEEP learning - Abstract
In the age of Internet of Things and Industrial 4.0, prognostic and health management (PHM) systems are used to collect massive real-time data from mechanical equipment. PHM big data has the characteristics of large-volume, diversity, and high-velocity. Effectively mining features from such data and accurately predicting the remaining useful life (RUL) of the rotating components with new advanced methods become issues in PHM. Traditional data driven prognostics is based on shallow learning architectures, requires establishing explicit model equations and much prior knowledge about signal processing techniques and prognostic expertise, and therefore is limited in the age of big data. This paper presents a deep learning-based approach for RUL prediction of rotating components with big data. The presented approach is tested and validated using data collected from a gear test rig and bearing run-to-failure tests and compared with existing PHM methods. The test results show the promising RUL prediction performance of the deep learning-based approach. [ABSTRACT FROM PUBLISHER]
- Published
- 2018
- Full Text
- View/download PDF
15. Nearest Neighbor Classification for High-Speed Big Data Streams Using Spark.
- Author
-
Ramirez-Gallego, Sergio, Krawczyk, Bartosz, Garcia, Salvador, Wozniak, Michal, Benitez, Jose Manuel, and Herrera, Francisco
- Subjects
BIG data ,DATA mining ,MACHINE learning - Abstract
Mining massive and high-speed data streams among the main contemporary challenges in machine learning. This calls for methods displaying a high computational efficacy, with ability to continuously update their structure and handle ever-arriving big number of instances. In this paper, we present a new incremental and distributed classifier based on the popular nearest neighbor algorithm, adapted to such a demanding scenario. This method, implemented in Apache Spark, includes a distributed metric-space ordering to perform faster searches. Additionally, we propose an efficient incremental instance selection method for massive data streams that continuously update and remove outdated examples from the case-base. This alleviates the high computational requirements of the original classifier, thus making it suitable for the considered problem. Experimental study conducted on a set of real-life massive data streams proves the usefulness of the proposed solution and shows that we are able to provide the first efficient nearest neighbor solution for high-speed big and streaming data. [ABSTRACT FROM AUTHOR]
- Published
- 2017
- Full Text
- View/download PDF
16. GPU-Accelerated Parallel Hierarchical Extreme Learning Machine on Flink for Big Data.
- Author
-
Chen, Cen, Li, Kenli, Ouyang, Aijia, Tang, Zhuo, and Li, Keqin
- Subjects
BIG data ,MACHINE learning ,GRAPHICS processing units - Abstract
The extreme learning machine (ELM) has become one of the most important and popular algorithms of machine learning, because of its extremely fast training speed, good generalization, and universal approximation/classification capability. The proposal of hierarchical ELM (H-ELM) extends ELM from single hidden layer feedforward networks to multilayer perceptron, greatly strengthening the applicability of ELM. Generally speaking, during training H-ELM, large-scale datasets (DSTs) are needed. Therefore, how to make use of H-ELM framework in processing big data is worth further exploration. This paper proposes a parallel H-ELM algorithm based on Flink, which is one of the in-memory cluster computing platforms, and graphics processing units (GPUs). Several optimizations are adopted to improve the performance, such as cache-based scheme, reasonable partitioning strategy, memory mapping scheme for mapping specific Java virtual machine objects to buffers. Most importantly, our proposed framework for utilizing GPUs to accelerate Flink for big data is general. This framework can be utilized to accelerate many other variants of ELM and other machine learning algorithms. To the best of our knowledge, it is the first kind of library, which combines in-memory cluster computing with GPUs to parallelize H-ELM. The experimental results have demonstrated that our proposed GPU-accelerated parallel H-ELM named as GPH-ELM can efficiently process large-scale DSTs with good performance of speedup and scalability, leveraging the computing power of both CPUs and GPUs in the cluster. [ABSTRACT FROM AUTHOR]
- Published
- 2017
- Full Text
- View/download PDF
17. A Micro-Extended Belief Rule-Based System for Big Data Multiclass Classification Problems.
- Author
-
Yang, Long-Hao, Liu, Jun, Wang, Ying-Ming, and Martinez, Luis
- Subjects
BIG data ,COMPUTER workstation clusters ,CLASSIFICATION ,MACHINE learning - Abstract
Big data classification problems have drawn great attention from diverse fields, and many classifiers have been developed. Among those classifiers, the extended belief rule-based system (EBRBS) has shown its potential in both big data and multiclass situations, while the time complexity and computing efficiency are two challenging issues to be handled in EBRBS. As such, three improvements of EBRBS are proposed first in this paper to decrease the time complexity and computing efficiency of EBRBS for multiclass classification under the assumption of large amount of data, including the strategy to skip rule weight calculation, a simplified evidential reasoning algorithm, and the domain division-based rule reduction method. This turns out to be a micro version of the EBRBS, called Micro-EBRBS. Moreover, one of commonly used cluster computing, named Apache Spark, is then applied to implement the parallel rule generation and inference schemes of the Micro-EBRBS for big data multiclass classification problems. The comparative analyses of experimental studies demonstrate that the Micro-EBRBS not only can obtain a desired accuracy but also has the comparatively better time complexity and computing efficiency than some popular classifiers, especially for multiclass classification problems. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
18. An Efficient Intrusion Detection Approach for Visual Sensor Networks Based on Traffic Pattern Learning.
- Author
-
Huang, Kaixing, Zhang, Qi, Zhou, Chunjie, Xiong, Naixue, and Qin, Yuanqing
- Subjects
TRAFFIC patterns ,SENSOR networks ,INTRUSION detection systems (Computer security) - Abstract
Visual sensor networks (VSNs) are highly vulnerable to attacks due to their open deployment in possibly unattended environments. To improve the network security of VSNs, an intrusion detection system (IDS) is an effective countermeasure. However, as visual sensors can produce big and dynamic video data, it is a tough task to rapidly and effectively detect attacks in VSNs. Moreover, attack samples in VSNs are generally too rare for IDSs to fully understand the behaviors of attacks. Facing these difficulties, in this paper, we propose an efficient intrusion detection approach for VSNs, which is based on traffic pattern learning. In the proposed approach, a traffic model is developed to describe the dynamic characteristics of network traffic in VSNs. Based on this model, the optimal feature set for traffic pattern learning can be extracted. Then a hierarchical self-organizing map (HSOM) is employed to learn traffic patterns and detect intrusions. Furthermore, an active learning strategy is devised to accelerate the training process of the HSOM and better learn the patterns of attacks. Experimental results show that the proposed approach has high detection accuracy and good real-time performance. [ABSTRACT FROM AUTHOR]
- Published
- 2017
- Full Text
- View/download PDF
19. Multitask TSK Fuzzy System Modeling by Jointly Reducing Rules and Consequent Parameters.
- Author
-
Wang, Jun, Lin, Defu, Deng, Zhaohong, Jiang, Yizhang, Zhu, Jihua, Chen, Lei, Li, Zuoyong, Gong, Lejun, and Wang, Shitong
- Subjects
FUZZY sets ,FUZZY systems ,REGULARIZATION parameter ,TASK analysis - Abstract
Existing multitask Takagi–Sugeno–Kang (TSK) fuzzy modeling methods always produce high complex fuzzy models with numerous redundant rules and consequent parameters. To this end, we propose a novel multitask TSK fuzzy modeling method called mtSparseTSK, which learns a compact set of fuzzy rules and shared consequent parameters across tasks in a unified procedure. Specifically, we consider the fuzzy rule reduction and consequent parameter selection across tasks by devising novel group sparsity regularizations in the learning criterion of the model. We also integrate the intertask relations in the proposed TSK model for multitask learning. We fully utilize the block structure in the TSK fuzzy models in formulating a joint block sparse optimization problem and develop a procedure for alternating direction method of multipliers (ADMMs) to find the optimal solution of the problem. Experiments on the synthetic and real-world datasets demonstrate the distinctive performance of the proposed methods over the existing ones on multitask fuzzy system modeling. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
20. An Information Theory-Based Feature Selection Framework for Big Data Under Apache Spark.
- Author
-
Ramirez-Gallego, Sergio, Mourino-Talin, Hector, Martinez-Rego, David, Bolon-Canedo, Veronica, Benitez, Jose Manuel, Alonso-Betanzos, Amparo, and Herrera, Francisco
- Subjects
BIG data ,INFORMATION theory ,FEATURE selection - Abstract
With the advent of extremely high dimensional datasets, dimensionality reduction techniques are becoming mandatory. Of the many techniques available, feature selection (FS) is of growing interest for its ability to identify both relevant features and frequently repeated instances in huge datasets. We aim to demonstrate that standard FS methods can be parallelized in big data platforms like Apache Spark so as to boost both performance and accuracy. We propose a distributed implementation of a generic FS framework that includes a broad group of well-known information theory-based methods. Experimental results for a broad set of real-world datasets show that our distributed framework is capable of rapidly dealing with ultrahigh-dimensional datasets as well as those with a huge number of samples, outperforming the sequential version in all the cases studied. [ABSTRACT FROM AUTHOR]
- Published
- 2018
- Full Text
- View/download PDF
21. Table of contents.
- Subjects
GENETIC algorithms ,BIG data - Abstract
Presents the table of contents for this issue of the publication. [ABSTRACT FROM PUBLISHER]
- Published
- 2015
- Full Text
- View/download PDF
22. A Latent Factor Analysis-Based Approach to Online Sparse Streaming Feature Selection.
- Author
-
Wu, Di, He, Yi, Luo, Xin, and Zhou, MengChu
- Subjects
FEATURE selection ,FACTOR analysis ,COMPUTATIONAL intelligence ,ONLINE algorithms ,SPARSE matrices - Abstract
Online streaming feature selection (OSFS) has attracted extensive attention during the past decades. Current approaches commonly assume that the feature space of fixed data instances dynamically increases without any missing data. However, this assumption does not always hold in many real applications. Motivated by this observation, this study aims to implement online feature selection from sparse streaming features, i.e., features flow in one by one with missing data as instance count remains fixed. To do so, this study proposes a latent-factor-analysis-based online sparse-streaming-feature selection algorithm (LOSSA). Its main idea is to apply latent factor analysis to pre-estimate missing data in sparse streaming features before conducting feature selection, thereby addressing the missing data issue effectively and efficiently. Theoretical and empirical studies indicate that LOSSA can significantly improve the quality of OSFS when missing data are encountered in target instances. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
23. Attribute Equilibrium Dominance Reduction Accelerator (DCCAEDR) Based on Distributed Coevolutionary Cloud and Its Application in Medical Records.
- Author
-
Ding, Wei-Ping, Lin, Chin-Teng, Prasad, Mukesh, Chen, Sen-Bo, and Guan, Zhi-Jin
- Subjects
CLOUD computing ,MEDICAL records ,DATA mining - Abstract
Aimed at the tremendous challenge of attribute reduction for big data mining and knowledge discovery, we propose a new attribute equilibrium dominance reduction accelerator (DCCAEDR) based on the distributed coevolutionary cloud model. First, the framework of N -populations distributed coevolutionary MapReduce model is designed to divide the entire population into N subpopulations, sharing the reward of different subpopulations’ solutions under a MapReduce cloud mechanism. Because the adaptive balancing between exploration and exploitation can be achieved in a better way, the reduction performance is guaranteed to be the same as those using the whole independent data set. Second, a novel Nash equilibrium dominance strategy of elitists under the N bounded rationality regions is adopted to assist the subpopulations necessary to attain the stable status of Nash equilibrium dominance. This further enhances the accelerator’s robustness against complex noise on big data. Third, the approximation parallelism mechanism based on MapReduce is constructed to implement rule reduction by accelerating the computation of attribute equivalence classes. Consequently, the entire attribute reduction set with the equilibrium dominance solution can be achieved. Extensive simulation results have been used to illustrate the effectiveness and robustness of the proposed DCCAEDR accelerator for attribute reduction on big data. Furthermore, the DCCAEDR is applied to solve attribute reduction for traditional Chinese medical records and to segment cortical surfaces of the neonatal brain 3-D-MRI records, and the DCCAEDR shows the superior competitive results, when compared with the representative algorithms. [ABSTRACT FROM AUTHOR]
- Published
- 2016
- Full Text
- View/download PDF
24. Estimating Population Density Without Contravening Citizen’s Privacy: Warsaw Use Case.
- Author
-
Luckner, Marcin, Krzeminska, Izabella, Wawrzyniak, Piotr, and Legierski, Jaroslaw
- Subjects
POPULATION density ,RIGHT of privacy ,PRIVACY ,CLOSED-circuit television ,CITIES & towns ,ANIMAL population density - Abstract
Spatial data on a cellular network load can be used to develop commercial and public services. However, such data is calculated based on individual users’ behavior and can contravene their privacy rights. Moreover, direct tracking of individual devices violates the European Union’s regulations. To solve this issue, we propose to use data aggregated in individual cells of the public land mobile network without tracking an individual mobile device in the entire process. To prove that the proposed data collection method is useful, we compared the obtained results with a closed-circuit television system in an estimation of the number of people. The proposed system is sensitive enough to detect untypical global events in an urban area and distinguish transport demand zones of various types as we showed on real data from the City of Warsaw. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
25. Trustworthiness Assessment of Users in Social Reviewing Systems.
- Author
-
Esposito, Christian, Moscato, Vincenzo, and Sperli, Giancarlo
- Subjects
SOCIAL systems ,MULTIPLE criteria decision making ,SOCIAL networks - Abstract
Social Networks represent a cornerstone of our daily life, where the so-called social reviewing systems (SRSs) play a key role in our daily lives and are used to access data typically in the form of reviews. Due to their importance, social networks must be trustworthy and secure, so that their shared information can be used by the people without any concerns, and must be protected against possible attacks and misuses. One of the most critical attacks against the reputation system is represented by mendacious reviews. As this kind of attacks can be conducted by legitimate users of the network, a particularly powerful solution is to exploit trust management, by assigning a trust degree to users, so that people can weigh the gathered data based on such trust degrees. Trust management within the context of SRSs is particularly challenging, as determining incorrect behaviors is subjective and hard to be fully automatized. Several attempts in the current literature have been proposed; however, such an issue is still far from been completely resolved. In this study, we propose a solution against mendacious reviews that combines fuzzy logic and the theory of evidence by modeling trust management as a multicriteria multiexpert decision making and exploiting the novel concept of time-dependent and content-dependent crown consensus. We empirically proved that our approach outperforms the main related works approaches, also in dealing with sockpuppet attacks. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
26. Assimilating Second-Order Information for Building Non-Negative Latent Factor Analysis-Based Recommenders.
- Author
-
Li, Weiling, He, Qiang, Luo, Xin, and Wang, Zidong
- Subjects
HESSIAN matrices ,RECOMMENDER systems ,FACTOR analysis ,SPARSE matrices ,INDUSTRIAL applications ,PREDICTION models - Abstract
A non-negative latent factor analysis (NLFA)-based recommender can make precise recommendations by correctly representing the non-negative characteristic of industrial data. It commonly relies on a nonconvex and bilinear optimization process, where the effects of first-order solvers maybe significantly reduced. Higher order solvers like a Newton-type method are expected to make a breakthrough; however, its computation efficiency and scalability are greatly limited due to the numerous parameters involved in a Hessian matrix. To address this issue, this article proposes an approach for assimilating second-order information for building NLFA-based recommenders. The key idea is an inner second-order solver that employs a Hessian-free method for avoiding the highly expensive manipulations of a Hessian matrix. Empirical studies on eight data cases emerging from real industrial applications indicate that the proposed approach outperforms state-of-the-art models in prediction accuracy with affordable computational burden. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
27. Evidential Reasoning Rule-Based Decision Support System for Predicting ICU Admission and In-Hospital Death of Trauma.
- Author
-
Kong, Guilan, Xu, Dong-Ling, Yang, Jian-Bo, Wang, Tianbing, and Jiang, Baoguo
- Subjects
DECISION support systems ,INTENSIVE care units ,ARTIFICIAL neural networks ,PRAGMATICS ,WEIGHT training ,PHYSICIANS ,EMERGENCY physicians ,BIG data - Abstract
We propose to employ evidential reasoning (ER) rule to construct a clinical decision support system (CDSS) to aid physicians to predict the probability of intensive care unit (ICU) admission and in-hospital death for trauma patients once they arrive at a hospital. A generalized Bayesian rule is used to mine evidence from historical data. Evidence is profiled using a format of belief distribution, where the belief degrees of different trauma outcomes are assigned with derived probabilities linked to the corresponding outcomes. Inputs to the CDSS are clinical data of a patient, and output from the system is predicted belief degree of severe trauma, including ICU admission and in-hospital death. The inner logic of the CDSS is that pieces of evidence that match the clinical data of a patient are identified from the evidence base first, and then the ER rule-based evidence aggregation mechanism is utilized to combine the matched evidences to arrive at a prediction. The reliability, weight, and interdependence of clinical evidence are taken into account. Moreover, an evidence weight training module is constructed. The ER rule-based prediction model has superior performance compared with logistic regression and artificial neural network models. An innovative and pragmatic ER rule-based CDSS for trauma outcome prediction is contributed by this article. In the era of big data, this CDSS helps predict patient outcomes based on historical data and helps physicians in emergency departments make proper trauma management decisions. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
28. Non-Negative Latent Factor Model Based on β-Divergence for Recommender Systems.
- Author
-
Xin, Luo, Yuan, Ye, Zhou, MengChu, Liu, Zhigang, and Shang, Mingsheng
- Subjects
NONNEGATIVE matrices ,RECOMMENDER systems ,EUCLIDEAN distance ,ALGORITHMS ,SPARSE matrices ,LINEAR programming - Abstract
Non-negative latent factor (NLF) models well represent high-dimensional and sparse (HiDS) matrices filled with non-negative data, which are frequently encountered in industrial applications like recommender systems. However, current NLF models mostly adopt Euclidean distance in their objective function, which represents a special case of a β-divergence function. Hence, it is highly desired to design a β-divergence-based NLF (β-NLF) model that uses a β-divergence function, and investigate its performance in recommender systems as β varies. To do so, we first model β-NLF’s learning objective with a β-divergence function. Subsequently, we deduce a general single latent factor-dependent, non-negative and multiplicative update scheme for β-NLF, and then design an efficient β-NLF algorithm. The experimental results on HiDS matrices from industrial applications indicate that by carefully choosing the value of β, β-NLF outperforms an NLF model with Euclidean distance in terms of accuracy for missing data prediction without increasing computational time. The research outcomes show the necessity of using an optimal β-divergence function in order to achieve the best performance of an NLF model on HiDS matrices. Hence, the proposed model has both theoretical and application significance. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
29. KNN-BLOCK DBSCAN: Fast Clustering for Large-Scale Data.
- Author
-
Chen, Yewang, Zhou, Lida, Pei, Songwen, Yu, Zhiwen, Chen, Yi, Liu, Xin, Du, Jixiang, and Xiong, Naixue
- Subjects
K-nearest neighbor classification ,APPROXIMATION algorithms ,PARALLEL algorithms ,BIG data - Abstract
Large-scale data clustering is an essential key for big data problem. However, no current existing approach is “optimal” for big data due to high complexity, which remains it a great challenge. In this article, a simple but fast approximate DBSCAN, namely, KNN-BLOCK DBSCAN, is proposed based on two findings: 1) the problem of identifying whether a point is a core point or not is, in fact, a kNN problem and 2) a point has a similar density distribution to its neighbors, and neighbor points are highly possible to be the same type (core point, border point, or noise). KNN-BLOCK DBSCAN uses a fast approximate kNN algorithm, namely, FLANN, to detect core-blocks (CBs), noncore-blocks, and noise-blocks within which all points have the same type, then a fast algorithm for merging CBs and assigning noncore points to proper clusters is also invented to speedup the clustering process. The experimental results show that KNN-BLOCK DBSCAN is an effective approximate DBSCAN algorithm with high accuracy, and outperforms other current variants of DBSCAN, including ρ-approximate DBSCAN and AnyDBC. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
30. A Fast Non-Negative Latent Factor Model Based on Generalized Momentum Method.
- Author
-
Luo, Xin, Liu, Zhigang, Li, Shuai, Shang, Mingsheng, and Wang, Zidong
- Subjects
NONNEGATIVE matrices ,MISSING data (Statistics) ,MACHINE learning ,SPARSE matrices ,RECOMMENDER systems ,MULTIPLE imputation (Statistics) - Abstract
Non-negative latent factor (NLF) models can efficiently acquire useful knowledge from high-dimensional and sparse (HiDS) matrices filled with non-negative data. Single latent factor-dependent, non-negative and multiplicative update (SLF-NMU) is an efficient algorithm for building an NLF model on an HiDS matrix, yet it suffers slow convergence. A momentum method is frequently adopted to accelerate a learning algorithm, but it is incompatible with those implicitly adopting gradients like SLF-NMU. To build a fast NLF (FNLF) model, we propose a generalized momentum method compatible with SLF-NMU. With it, we further propose a single latent factor-dependent non-negative, multiplicative and momentum-incorporated update algorithm, thereby achieving an FNLF model. Empirical studies on six HiDS matrices from industrial application indicate that an FNLF model outperforms an NLF model in terms of both convergence rate and prediction accuracy for missing data. Hence, compared with an NLF model, an FNLF model is more practical in industrial applications. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
31. Efficient and Rapid Machine Learning Algorithms for Big Data and Dynamic Varying Systems.
- Author
-
Sun, Fuchun, Huang, Guang-Bin, Jonathan Wu, Q. M., Song, Shiji, and Wunsch II, Donald C.
- Subjects
DYNAMICS ,MACHINE learning ,BIG data - Abstract
With the exponential growth of data and complexity of systems, fast machine learning/artificial intelligence and computational intelligence techniques are highly required. Many conventional computational intelligence techniques face bottlenecks in learning (e.g., intensive human intervention and convergence time) [item 1) in the Appendix]. However, efficient learning algorithms alternatively offer significant benefits including fast learning speed, ease of implementation, and minimal human intervention. The need for efficient and fast implementation of machine learning techniques in big data and dynamic varying systems poses many research challenges. This special issue highlights some latest development in the related areas. [ABSTRACT FROM AUTHOR]
- Published
- 2017
- Full Text
- View/download PDF
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.