Asymptotic Efficiency of Deterministic Estimators for Discrete Energy-Based Models: Ratio Matching and Pseudolikelihood
17
Citation
17
Reference
10
Related Paper
Citation Trend
Abstract:
Standard maximum likelihood estimation cannot be applied to discrete energy-based models in the general case because the computation of exact model probabilities is intractable. Recent research has seen the proposal of several new estimators designed specifically to overcome this intractability, but virtually nothing is known about their theoretical properties. In this paper, we present a generalized estimator that unifies many of the classical and recently proposed estimators. We use results from the standard asymptotic theory for M-estimators to derive a generic expression for the asymptotic covariance matrix of our generalized estimator. We apply these results to study the relative statistical efficiency of classical pseudolikelihood and the recently-proposed ratio matching estimator.Keywords:
Asymptotic Analysis
Abstract In this paper we provide asymptotically efficient estimators for SUR equations with general stationary errors. The relative efficiency of time and frequency domain estimators is compared by means of a Monte Carlo experiment. The major conclusion is that there is little to recommend the use of frequency domain estimators in the sample sizes available in applied economic research. Keywords: Seemingly unrelated systemstime domain estimatorsfrequency domain estimatorsfinite sample relative efficiency
Sample (material)
Cite
Citations (0)
An alternative general class of estimators of the variance of the ratio estimator is considered. The class includes the classical variance estimator v0 . Asymptotic expansions for the biases and variances of the proposed estimators are obtained and a comparison of the relative merits of the estimators v0 vs1 and vs2 is made. Conditions under which each of these estimators is more efficient than the other two are derived. Among the estimators v0 v1 v2 vs1 vs2 the results of the empirical study seem to favour the use of vs1
Extremum estimator
Invariant estimator
Delta method
Cite
Citations (0)
Extended Kalman filter (EKF) is prevailing for cooperative localization, where the cross-covariance (representing the correlation of estimated position) determines the benefit quantity from the local measurement. In this paper, the covariance factor set is adopted for cross-covariance maintaining in distributed architecture. During two exteroceptive measurements, the covariance factor set is propagated independently in each agent. When the updating information from the measuring agent is received by the other agents, a temporary relative master-slave relationship is determined between them. The updated correlation is retained in the receiver (slave) agent as a covariance factor. Meanwhile, the counterpart in the measuring (master) agent is set as identify matrix. The operation of matrix decomposition and the feedback for covariance update from slave to master is saved. Thus, the computational consumption and communication burden are reduced. It is significant for real-time cooperative localization.
Master/slave
Position (finance)
Cite
Citations (1)
Extremum estimator
Asymptotic Analysis
Delta method
Cite
Citations (1,512)
ABSTRACT The relative efficiency of maximum likelihood estimates is studied when taking advantage of underlying linear patterns in the covariances or correlations when estimating covariance matrices. We compare the variances of estimates of the covariance matrix obtained under two nested patterns with the assumption that the more restricted pattern is the true state. Formulas for the asymptotic variances are given which are exact for linear covariance patterns when explicit maximum likelihood estimates exist. Several specific examples are given using complete symmetry, circular symmetry and general covariance patterns as well as an example involving a covariance matrix with a linear pattern in the correlations.
General Covariance
Covariance mapping
Analysis of covariance
Cite
Citations (0)
Abstract The efficiencies of two consistent estimators of a parameter may be compared by the ratio of their asymptotic variances. Alternative measures are the Pitman and Bahadur measures, which relate to the ratio of sample sizes needed to achieve equivalent asymptotic power. Topics examined are the relevance for finite samples, sensitivity to the underlying distribution, higher‐order efficiency (to compare different fully efficient estimators), and efficiency estimation in complex models.
Asymptotic Analysis
Sample (material)
Cite
Citations (0)
Spectrum estimation is a fundamental methodology in the analysis of time-series data, with applications including medicine, speech analysis, and control design. The asymptotic theory of spectrum estimation is well-understood, but the theory is limited when the number of samples is fixed and finite. This paper gives non-asymptotic error bounds for a broad class of spectral estimators, both pointwise (at specific frequencies) and in the worst case over all frequencies. The general method is used to derive error bounds for the classical Blackman-Tukey, Bartlett, and Welch estimators. In particular, these are first non-asymptotic error bounds for Bartlett and Welch estimators.
Pointwise
Asymptotic Analysis
Cite
Citations (0)
Population mean
Cite
Citations (13)
In literature, several ratio type estimators of population mean were proposed by statisticians but none of them made pair wise comparison of these estimators. In this paper an attempt has been made for pair wise efficiency comparison of the same and find out the different conditions on which one estimator performed better than the other. Depending on the structure of data used, the efficiency comparison of these estimators is varied in certain circumstances. In this study we have revealed the efficiency conditions of the existing ratio estimators, through pair wise comparisons and examine the relative performance of ratio estimators in terms of efficiency and unbiasedness empirically.
Ratio estimator
Extremum estimator
Population mean
Bootstrapping (finance)
Cite
Citations (1)
Covariance matrix estimation is a persistent challenge for cosmology. We focus on a class of model covariance matrices that can be generated with high accuracy and precision, using a tiny fraction of the computational resources that would be required to achieve comparably precise covariance matrices using mock catalogues. In previous work, the free parameters in these models were determined using sample covariance matrices computed using a large number of mocks, but we demonstrate that those parameters can be estimated consistently and with good precision by applying jackknife methods to a single survey volume. This enables model covariance matrices that are calibrated from data alone, with no reference to mocks.
Jackknife resampling
General Covariance
Covariance mapping
Matérn covariance function
Analysis of covariance
Cite
Citations (23)