—Underwater networks are characterized by undesirable time variability of the channel conditions due to Doppler effect, serious multipath and variable impulse response. Energy efficiency is a primary concern in these scenarios, because nodes batteries cannot be recharged or replaced. Accordingly, in order to increase network lifetime and effectiveness of underwater channel transmissions, in this paper, we present a reinforcement learning approach for communication in multihop underwater networks. The proposed methodology employs a Markov underwater channel model to characterize the link status that allows the relay device to choose the most efficient next hop node to forward data towards a remote gateway device for connection to the terrestrial internet. Simulation results are presented to show the effectiveness of the proposed methodology in terms of energy consumption and latency performance so allowing to increase network lifetime.

A Q-learning approach for the support of reliable transmission in the internet of underwater things

galluccio
Ultimo
Supervision
2020-01-01

Abstract

—Underwater networks are characterized by undesirable time variability of the channel conditions due to Doppler effect, serious multipath and variable impulse response. Energy efficiency is a primary concern in these scenarios, because nodes batteries cannot be recharged or replaced. Accordingly, in order to increase network lifetime and effectiveness of underwater channel transmissions, in this paper, we present a reinforcement learning approach for communication in multihop underwater networks. The proposed methodology employs a Markov underwater channel model to characterize the link status that allows the relay device to choose the most efficient next hop node to forward data towards a remote gateway device for connection to the terrestrial internet. Simulation results are presented to show the effectiveness of the proposed methodology in terms of energy consumption and latency performance so allowing to increase network lifetime.
File in questo prodotto:
File Dimensione Formato  
QL.pdf

solo gestori archivio

Tipologia: Versione Editoriale (PDF)
Dimensione 555 kB
Formato Adobe PDF
555 kB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.11769/526963
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 4
  • ???jsp.display-item.citation.isi??? 4
social impact