π DeepMetaIoT: A Multimodal Deep Learning Framework Harnessing Metadata for IoT Sensor Data Classification
Internet of Things (IoT) sensor data, which capture time series physical measurements such as temperature and humidity, often lack proper classification. This limits their effective understanding, integration, and reuse. While sensor metadataβtextual descriptions of the measurementsβis sometimes available, it is frequently incomplete or ambiguous. As a result, classification often depends solely on the time series data. Leveraging both time series sensor readings and textual metadata for automated and accurate classification remains a challenge due to the heterogeneity and inconsistency of these data sources. In this paper, we propose DeepMetaIoT, a multimodal deep learning framework that integrates time series and textual data for classification. DeepMetaIoT employs a cross-residual architecture comprising a time series encoder and a text encoder based on a pre-trained large language model, enabling effective fusion of both modalities. Experimental results on real-world IoT sensor datasets show that DeepMetaIoT consistently outperforms state-of-the-art machine learning and deep learning baselines.
.
βββ datasets/ # Contains datasets
βββ scripts/ # Source code
βββ paper/ # paper related other resources
βββ requirements.txt # Python dependencies
βββ README.md
Clone this repository and install dependencies:
git clone https://github.com/skinan/DeepMetaIoT.git
cd DeepMetaIoT
Conda environment setup
conda create -n deepmetaiot python=3.9.0
conda activate deepmetaiot
pip install -r requirements.txt
If you use this code or any resources of the paper (including datasets), please kindly cite our paper:
@article{inan2025deepmetaiot,
title={DeepMetaIoT: A Multimodal Deep Learning Framework Harnessing Metadata for IoT Sensor Data Classification},
author={Inan, Muhammad Sakib Khan and Liao, Kewen and Shen, Haifeng and Jayaraman, Prem Prakash and Montori, Federico and Georgakopoulos, Dimitrios},
journal={IEEE Internet of Things Journal},
year={2025},
publisher={IEEE}
}