Skip to content

This repository contains code for the paper "A Multimodal Deep Learning Framework for Metadata-Assisted Classification of IoT Sensor Data" , published in IEEE Internet of Things Journal

Notifications You must be signed in to change notification settings

skinan/DeepMetaIoT

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

3 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

πŸ“„ DeepMetaIoT: A Multimodal Deep Learning Framework Harnessing Metadata for IoT Sensor Data Classification

Paper

πŸ“Œ Abstract

Internet of Things (IoT) sensor data, which capture time series physical measurements such as temperature and humidity, often lack proper classification. This limits their effective understanding, integration, and reuse. While sensor metadataβ€”textual descriptions of the measurementsβ€”is sometimes available, it is frequently incomplete or ambiguous. As a result, classification often depends solely on the time series data. Leveraging both time series sensor readings and textual metadata for automated and accurate classification remains a challenge due to the heterogeneity and inconsistency of these data sources. In this paper, we propose DeepMetaIoT, a multimodal deep learning framework that integrates time series and textual data for classification. DeepMetaIoT employs a cross-residual architecture comprising a time series encoder and a text encoder based on a pre-trained large language model, enabling effective fusion of both modalities. Experimental results on real-world IoT sensor datasets show that DeepMetaIoT consistently outperforms state-of-the-art machine learning and deep learning baselines.


πŸ“‚ Repository Overview

.
β”œβ”€β”€ datasets/             # Contains datasets
β”œβ”€β”€ scripts/              # Source code
β”œβ”€β”€ paper/                # paper related other resources
β”œβ”€β”€ requirements.txt      # Python dependencies
└── README.md


βš™οΈ Installation (Ubuntu Linux / MAC)

Clone this repository and install dependencies:

git clone https://github.com/skinan/DeepMetaIoT.git
cd DeepMetaIoT

Conda environment setup

conda create -n deepmetaiot python=3.9.0
conda activate deepmetaiot
pip install -r requirements.txt

πŸ“ Citation

If you use this code or any resources of the paper (including datasets), please kindly cite our paper:

@article{inan2025deepmetaiot,
  title={DeepMetaIoT: A Multimodal Deep Learning Framework Harnessing Metadata for IoT Sensor Data Classification},
  author={Inan, Muhammad Sakib Khan and Liao, Kewen and Shen, Haifeng and Jayaraman, Prem Prakash and Montori, Federico and Georgakopoulos, Dimitrios},
  journal={IEEE Internet of Things Journal},
  year={2025},
  publisher={IEEE}
}

About

This repository contains code for the paper "A Multimodal Deep Learning Framework for Metadata-Assisted Classification of IoT Sensor Data" , published in IEEE Internet of Things Journal

Topics

Resources

Stars

Watchers

Forks

Languages