Stochastic optimal control and performance analysis of wireless ad hoc networks

217 477 0
Stochastic optimal control and performance analysis of wireless ad hoc networks

Đang tải... (xem toàn văn)

Tài liệu hạn chế xem trước, để xem đầy đủ mời bạn chọn Tải xuống

Từ khóa liên quan

Mục lục

  • Acknowledgments

  • Abstract

  • List of Figures

  • List of Tables

  • List of Symbols

  • List of Abbreviations

  • List of Algorithms

  • 1 Introduction

    • 1.1 Optimal Stochastic Control using -irreducible Markov chains

    • 1.2 Near-Optimal and Model-Free QoS Provisioning

    • 1.3 Hierarchical Optimal Control for Resource Allocation

    • 1.4 Decentralized Optimal Control for Resource Allocation

    • 1.5 Thesis Contributions

    • 1.6 Summary of MDP models & algorithms

    • 1.7 Organization of Thesis

    • 2 Optimization and Stability of Markov Decision Process

      • 2.1 Controlled Markov Chain or Markov Decision Process

      • 2.2 Concept of -irreducibility for general state space chains

      • 2.3 f-Regularity and Stability

      • 2.4 Existence of optimal policies of -irreducible controlled chains

      • 2.5 Value Iteration Algorithm for -irreducible controlled chains

      • 3 -irreducible MDP for Wireless Queueing Model

        • 3.1 System Model: Time-Varying Channel State Process

Tài liệu cùng người dùng

  • Đang cập nhật ...

Tài liệu liên quan