logo
    Exact finite dimensional filters for certain exponential functionals of Gaussian state space processes
    2
    Citation
    14
    Reference
    10
    Related Paper
    Abstract:
    In this paper, we derive finite dimensional filters for certain exponential functionals of the state of a continuous-time linear Gaussian process. Apart from being of mathematical interest, these new filters have applications in the state reconstruction of doubly-stochastic autoregressive processes. We also derive similar filters for exponential functionals of the state of nonlinear Benes systems.
    Keywords:
    Finite state
    Abstract We consider a Markov decision chain X = {X n, n = 0, 1, ...} with finite state space $$ \mathcal{I} $$ = {1, 2, ...,N} and a finite set $$ \mathcal{A}_i $$ = {1, 2, ...,K i} of possible decisions (actions) in state i ∈ $$ \mathcal{I} $$ . Supposing that in state i ∈ $$ \mathcal{I} $$ action k ∈ $$ \mathcal{A}_i $$ is selected, then state j is reached in the next transition with a given probability p ij k and one-stage transition reward r ij will be accrued to such transition.
    Finite state
    Finite set
    Chain (unit)
    Citations (0)
    We propose a simple stochastic process for modeling improper or noncircular complex-valued signals. The process is a natural extension of a complex-valued autoregressive process, extended to include a widely linear autoregressive term. This process can then capture elliptical, as opposed to circular, stochastic oscillations in a bivariate signal. The process is order one and is more parsimonious than alternative stochastic modeling approaches in the literature. We provide conditions for stationarity, and derive the form of the covariance and relation sequence of this model. We describe how parameter estimation can be efficiently performed both in the time and frequency domain. We demonstrate the practical utility of the process in capturing elliptical oscillations that are naturally present in seismic signals.
    Stochastic modelling
    Citations (27)
    In this paper we consider stochastic systems with finite state space and counting process output. In particular we address the question whether a given system has a minimal representation, where ro...
    Finite state
    Representation
    State-space representation
    Finite set
    Citations (0)
    In this paper we investigate a link between state- space models and Gaussian Processes (GP) for time series modeling and forecasting. In particular, several widely used state- space models are transformed into continuous time form and corresponding Gaussian Process kernels are derived. Experimen- tal results demonstrate that the derived GP kernels are correct and appropriate for Gaussian Process Regression. An experiment with a real world dataset shows that the modeling is identical with state-space models and with the proposed GP kernels. The considered connection allows the researchers to look at their models from a different angle and facilitate sharing ideas between these two different modeling approaches.
    State-space representation
    Citations (0)
    A stochastic systems framework is established for the formulation of call admission control (CAC) and routing control (RC) problems in loss networks. The state process of the underlying system is a piecewise deterministic Markov process (PDMP) evolving deterministically between random event instants at which times the state jumps to another state value. The random events in the system correspond to the arrival of call requests or the departure of connections. The system state process is hybrid since it possesses positive integer and positive real valued components. The resulting NETCAD stochastic state space systems framework permits the formulation and analysis of centralized optimal stochastic control with respect to specified utility functions, see (Z. Ma et al., 2006)
    Stochastic control
    Citations (9)
    This paper constructs a finite state abstraction of a possibly continuous-time and infinite state model in two steps. First, a finite external signal space is added, generating a so called $\Phi$-dynamical system. Secondly, the strongest asynchronous $l$-complete approximation of the external dynamics is constructed. As our main results, we show that (i) the abstraction simulates the original system, and (ii) bisimilarity between the original system and its abstraction holds, if and only if the original system is $l$-complete and its state space satisfies an additional property.
    Abstraction
    Finite state
    Citations (0)
    In this paper we investigate a link between state- space models and Gaussian Processes (GP) for time series modeling and forecasting. In particular, several widely used state- space models are transformed into continuous time form and corresponding Gaussian Process kernels are derived. Experimen- tal results demonstrate that the derived GP kernels are correct and appropriate for Gaussian Process Regression. An experiment with a real world dataset shows that the modeling is identical with state-space models and with the proposed GP kernels. The considered connection allows the researchers to look at their models from a different angle and facilitate sharing ideas between these two different modeling approaches.
    State-space representation
    Kernel (algebra)
    Citations (3)
    In this paper we consider stochastic systems with finite state space and counting process output. In particular we address the question whether a given system has a minimal representation, where ro...
    Representation
    Finite state
    State-space representation
    Finite set
    Citations (0)