Maximizing quality of information from multiple sensor devices

The exploration vs exploitation tradeoff

Ertugrul Necdet Ciftcioglu, Aylin Yener, Michael J. Neely

    Research output: Contribution to journalArticle

    12 Citations (Scopus)

    Abstract

    This paper investigates Quality of Information (QoI) aware adaptive sampling in a system where two sensor devices report information to an end user. The system carries out a sequence of tasks, where each task relates to a random event that must be observed. The accumulated information obtained from the sensor devices is reported once per task to a higher layer application at the end user. The utility of each report depends on the timeliness of the report and also on the quality of the observations. Quality can be improved by accumulating more observations for the same task, at the expense of delay. We assume new tasks arrive randomly, and the qualities of each new observation are also random. The goal is to maximize time average quality of information subject to cost constraints. We solve the problem by leveraging dynamic programming and Lyapunov optimization. Our algorithms involve solving a 2-dimensional optimal stopping problem, and result in a 2-dimensional threshold rule. When task arrivals are i.i.d., the optimal solution to the stopping problem can be closely approximated with a small number of simplified value iterations. When task arrivals are periodic, we derive a structured form approximately optimal stopping policy. We also introduce hybrid policies applied over the proposed adaptive sampling algorithms to further improve the performance. Numerical results demonstrate that our policies perform near optimal. Overall, this work provides new insights into network operation based on QoI attributes.

    Original languageEnglish (US)
    Article number6507557
    Pages (from-to)883-894
    Number of pages12
    JournalIEEE Journal on Selected Topics in Signal Processing
    Volume7
    Issue number5
    DOIs
    StatePublished - Sep 27 2013

    Fingerprint

    Sampling
    Sensors
    Dynamic programming
    Costs

    All Science Journal Classification (ASJC) codes

    • Signal Processing
    • Electrical and Electronic Engineering

    Cite this

    @article{67052baa40f141818344fd01f571e079,
    title = "Maximizing quality of information from multiple sensor devices: The exploration vs exploitation tradeoff",
    abstract = "This paper investigates Quality of Information (QoI) aware adaptive sampling in a system where two sensor devices report information to an end user. The system carries out a sequence of tasks, where each task relates to a random event that must be observed. The accumulated information obtained from the sensor devices is reported once per task to a higher layer application at the end user. The utility of each report depends on the timeliness of the report and also on the quality of the observations. Quality can be improved by accumulating more observations for the same task, at the expense of delay. We assume new tasks arrive randomly, and the qualities of each new observation are also random. The goal is to maximize time average quality of information subject to cost constraints. We solve the problem by leveraging dynamic programming and Lyapunov optimization. Our algorithms involve solving a 2-dimensional optimal stopping problem, and result in a 2-dimensional threshold rule. When task arrivals are i.i.d., the optimal solution to the stopping problem can be closely approximated with a small number of simplified value iterations. When task arrivals are periodic, we derive a structured form approximately optimal stopping policy. We also introduce hybrid policies applied over the proposed adaptive sampling algorithms to further improve the performance. Numerical results demonstrate that our policies perform near optimal. Overall, this work provides new insights into network operation based on QoI attributes.",
    author = "Ciftcioglu, {Ertugrul Necdet} and Aylin Yener and Neely, {Michael J.}",
    year = "2013",
    month = "9",
    day = "27",
    doi = "10.1109/JSTSP.2013.2259798",
    language = "English (US)",
    volume = "7",
    pages = "883--894",
    journal = "IEEE Journal on Selected Topics in Signal Processing",
    issn = "1932-4553",
    publisher = "Institute of Electrical and Electronics Engineers Inc.",
    number = "5",

    }

    Maximizing quality of information from multiple sensor devices : The exploration vs exploitation tradeoff. / Ciftcioglu, Ertugrul Necdet; Yener, Aylin; Neely, Michael J.

    In: IEEE Journal on Selected Topics in Signal Processing, Vol. 7, No. 5, 6507557, 27.09.2013, p. 883-894.

    Research output: Contribution to journalArticle

    TY - JOUR

    T1 - Maximizing quality of information from multiple sensor devices

    T2 - The exploration vs exploitation tradeoff

    AU - Ciftcioglu, Ertugrul Necdet

    AU - Yener, Aylin

    AU - Neely, Michael J.

    PY - 2013/9/27

    Y1 - 2013/9/27

    N2 - This paper investigates Quality of Information (QoI) aware adaptive sampling in a system where two sensor devices report information to an end user. The system carries out a sequence of tasks, where each task relates to a random event that must be observed. The accumulated information obtained from the sensor devices is reported once per task to a higher layer application at the end user. The utility of each report depends on the timeliness of the report and also on the quality of the observations. Quality can be improved by accumulating more observations for the same task, at the expense of delay. We assume new tasks arrive randomly, and the qualities of each new observation are also random. The goal is to maximize time average quality of information subject to cost constraints. We solve the problem by leveraging dynamic programming and Lyapunov optimization. Our algorithms involve solving a 2-dimensional optimal stopping problem, and result in a 2-dimensional threshold rule. When task arrivals are i.i.d., the optimal solution to the stopping problem can be closely approximated with a small number of simplified value iterations. When task arrivals are periodic, we derive a structured form approximately optimal stopping policy. We also introduce hybrid policies applied over the proposed adaptive sampling algorithms to further improve the performance. Numerical results demonstrate that our policies perform near optimal. Overall, this work provides new insights into network operation based on QoI attributes.

    AB - This paper investigates Quality of Information (QoI) aware adaptive sampling in a system where two sensor devices report information to an end user. The system carries out a sequence of tasks, where each task relates to a random event that must be observed. The accumulated information obtained from the sensor devices is reported once per task to a higher layer application at the end user. The utility of each report depends on the timeliness of the report and also on the quality of the observations. Quality can be improved by accumulating more observations for the same task, at the expense of delay. We assume new tasks arrive randomly, and the qualities of each new observation are also random. The goal is to maximize time average quality of information subject to cost constraints. We solve the problem by leveraging dynamic programming and Lyapunov optimization. Our algorithms involve solving a 2-dimensional optimal stopping problem, and result in a 2-dimensional threshold rule. When task arrivals are i.i.d., the optimal solution to the stopping problem can be closely approximated with a small number of simplified value iterations. When task arrivals are periodic, we derive a structured form approximately optimal stopping policy. We also introduce hybrid policies applied over the proposed adaptive sampling algorithms to further improve the performance. Numerical results demonstrate that our policies perform near optimal. Overall, this work provides new insights into network operation based on QoI attributes.

    UR - http://www.scopus.com/inward/record.url?scp=84884528014&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84884528014&partnerID=8YFLogxK

    U2 - 10.1109/JSTSP.2013.2259798

    DO - 10.1109/JSTSP.2013.2259798

    M3 - Article

    VL - 7

    SP - 883

    EP - 894

    JO - IEEE Journal on Selected Topics in Signal Processing

    JF - IEEE Journal on Selected Topics in Signal Processing

    SN - 1932-4553

    IS - 5

    M1 - 6507557

    ER -