Search

With the development of 5G technology and Internet of Things, all kinds of real life data are collected and recorded by a large number of sensors. It is of great significance to mine and analyze the hidden information in the data for applications like future prediction. However, due to interferences or instability of collection equipment, collected sensory data are often incomplete, and this incompleteness hinders the in-depth analysis of data in the cloud. Therefore, processing around missing values is significant. Relying on cloud machine learning methods is not enough to deal with the problem of missing data in the Artificial Intelligence of Things (AIoT) environment, however, edge computing provides a promising solution. In this article, gated recurrent units filling is employed at the edge nodes. A mobile edge node can not only find the historical information of the current missing data node but also acquire the data of the nodes adjacent to the missing data node. These ensure that the missing data are restored to the maximum extent at the source. The experimental results show that the missing value filling based on edge computing not only outperforms other filling methods in quality but also greatly reduces the energy consumption in AIoT. [ABSTRACT FROM AUTHOR]

Human-oriented and machine-generated data in cyber-physical-social systems are often complicated graph-structured. Graph-powered learning methods are conducive to discovering valuable knowledge from large-scale graph data and improving decision-making processes. However, due to the neglect of diverse relations among things, most existing knowledge reasoning studies are inherently flawed and inefficient in processing the heterogeneous graphs with high-order connectivity. Tensor, as a powerful and effective tool to model high-level semantic interactions between various things, can provide high-order Internet of things graph with new perspectives and possibilities. Therefore, this article innovatively proposes a collaborative artificial intelligence of things data analysis and application framework based on Boolean tensors, which supports the expression and fusion of heterogeneous graph and ultimately promotes the AI processing. In this context, we focus on developing an incremental Boolean tensor factorization (IBTF) approach for efficient knowledge reasoning to meet the requirements of real-time and high-level quality demands for intelligent services. To the best of our knowledge, we are the first to do this work. More concretely, we present factors update and binary features merge algorithms for the integrated graph tensors to avoid numerous repeated calculations of historical data. Experimental results on general synthetic datasets demonstrate that the IBTF approach proposed in this article guarantees nearly equal approximate accuracy while reducing execution time by dozens and even more of times. Furthermore, experimental evaluations and interpretability analysis on real-world datasets verify the practicality of the proposed framework and approach. [ABSTRACT FROM AUTHOR]

Large-scale knowledge in the artificial intelligence of things (AIoT) field urgently needs effective models to understand human language and automatically answer questions. Pretrained language models achieve state-of-the-art performance on some question answering (QA) datasets, but few models can answer questions on AIoT domain knowledge. Currently, the AIoT domain lacks sufficient QA datasets and large-scale pretraining corpora. In this article, we propose RoBERTa $_{\mathrm AIoT}$ to address the problem of the lack of high-quality large-scale labeled AIoT QA datasets. We construct an AIoT corpus to further pretrain RoBERTa and BERT. RoBERTa $_{\mathrm AIoT}$ and BERT $_{\mathrm AIoT}$ leverage unsupervised pretraining on a large corpus composed of AIoT-oriented Wikipedia webpages to learn more domain-specific context and improve performance on the AIoT QA tasks. To fine-tune and evaluate the model, we construct three AIoT QA datasets based on the community QA websites. We evaluate our approach on these datasets, and the experimental results demonstrate the significant improvements of our approach. [ABSTRACT FROM AUTHOR]

Artificial intelligence shows promising efforts in collaborating the language models with the artificial intelligence of things (AIoT), promoting the edging intelligence on natural language understanding. To adapt to the limited computational resources in AIoT, the large language models (e.g., transformer) are compressed into light-weight models, which always results in poor feature representation and unsatisfactory performance on downstream tasks, especially on those low-resource language understanding tasks. To address the above issues, we propose a method named memory-assistant multi-task learning (MAMT), where an auxiliary memory module is introduced to promote multitask learning (MT), which serves as a surrogate of target domain representation and performs instance-level weighted MT. More importantly, our MAMT module is in a plug-and-play fashion. Thus, researchers can plug in it to conduct collaborative training and plug it out for AIoT model inference without extra computation burdens. Experiments demonstrate that MAMT significantly improves the performance of light-weight transformer models and show its superiority over the state-of-the-arts on eight GLUE subtasks. [ABSTRACT FROM AUTHOR]

With the prevalence of smart appliances, smart meters, and Internet of Things (IoT) devices in smart grids, artificial intelligence (AI) built on the rich IoT big data enables various energy data analysis applications and brings intelligent and personalized energy services for users. In conventional AI of Things (AIoT) paradigms, a wealth of individual energy data distributed across users’ IoT devices needs to be migrated to a central storage (e.g., cloud or edge device) for knowledge extraction, which may impose severe privacy violation and data misuse risks. Federated learning, as an appealing privacy-preserving AI paradigm, enables energy data owners (EDOs) to cooperatively train a shared AI model without revealing the local energy data. Nevertheless, potential security and efficiency concerns still impede the deployment of federated-learning-based AIoT services in smart grids due to the low-quality shared local models, non-independently and identically distributed (non-IID) data distributions, and unpredictable communication delays. In this article, we propose a secure and efficient federated-learning-enabled AIoT scheme for private energy data sharing in smart grids with edge-cloud collaboration. Specifically, we first introduce an edge-cloud-assisted federated learning framework for communication-efficient and privacy-preserving energy data sharing of users in smart grids. Then, by considering non-IID effects, we design a local data evaluation mechanism in federated learning and formulate two optimization problems for EDOs and energy service providers. Furthermore, due to the lack of knowledge of multidimensional user private information in practical scenarios, a two-layer deep reinforcement-learning-based incentive algorithm is developed to promote EDOs’ participation and high-quality model contribution. Extensive simulation results show that the proposed scheme can effectively stimulate EDOs to share high-quality local model updates and improve the communication efficiency. [ABSTRACT FROM AUTHOR]

Under the needs of processing huge amounts of data, providing high-quality service, and protecting user privacy in artificial intelligence of things (AIoT), federated learning (FL) has been treated as a promising technique to facilitate distributed learning with privacy protection. Although the importance of developing privacy-preserving FL has attracted a lot of attentions, the existing research only focuses on FL with independent identically distributed (i.i.d.) data and lacks study of non-i.i.d. scenario. What is worse, the assumption of i.i.d. data is impractical, reducing the performance of privacy protection in real applications. In this article, we carry out an innovative exploration of privacy protection in FL with non-i.i.d. data. First, a thorough analysis on privacy leakage in FL is conducted with proving the performance upper bound of privacy inference attack. Based on our analysis, a novel algorithm, 2DP-FL, is designed to achieve differential privacy by adding noise during training local models and when distributing global model. Especially, our 2DP-FL algorithm has a flexibility of noise addition to meet various needs and has a convergence upper bound. Finally, the real-data experiments can validate the results of our the oretical analysis and the advantages of 2DP-FL in privacy protection, learning convergence, and model accuracy. [ABSTRACT FROM AUTHOR]