Robustness and Tractability for Non-convex M-estimators
1
Citation
2
Reference
10
Related Paper
Citation Trend
Abstract:
We investigate two important properties of M-estimator, namely, robustness and tractability, in linear regression setting, when the observations are contaminated by some arbitrary outliers. Specifically, robustness means the statistical property that the estimator should always be close to the underlying true parameters {\em regardless of the distribution of the outliers}, and tractability indicates the computational property that the estimator can be computed efficiently, even if the objective function of the M-estimator is {\em non-convex}. In this article, by learning the landscape of the empirical risk, we show that under mild conditions, many M-estimators enjoy nice robustness and tractability properties simultaneously, when the percentage of outliers is small. We further extend our analysis to the high-dimensional setting, where the number of parameters is greater than the number of samples, $p \gg n$, and prove that when the proportion of outliers is small, the penalized M-estimators with {\em $L_1$} penalty will enjoy robustness and tractability simultaneously. Our research provides an analytic approach to see the effects of outliers and tuning parameters on the robustness and tractability for some families of M-estimators. Simulation and case study are presented to illustrate the usefulness of our theoretical results for M-estimators under Welsch's exponential squared loss.Keywords:
Robustness
Cite
Citations (0)
Cite
Citations (1)
Our main purpose is to introduce the notion of almost α(Λ, sp)-continuous multifunctions. Moreover, some characterizations of almost α(Λ, sp)-continuous multifunctions are established.
Cite
Citations (5)
Cite
Citations (33)
Cite
Citations (0)
Cite
Citations (76)
In this paper we consider a generalization to analytic multifunctions of the classical Hardy space theory of analytic functions on the unit disc. With \K(lambda) = sup (\z\; z is an element of K(lambda)) we define the Nevanlinna class N and the classes H
Cite
Citations (0)
In this paper, some properties of an order induced by uninorms are investigated. In this aim, the set of incomparable elements with respect to the $U$-partial order for any uninorm is introduced and studied. Also, by defining such an order, an equivalence relation on the class of uninorms is defined and this equivalence is deeply investigated. Finally, another set of incomparable elements with respect to the $U$-partial order for any uninorm is introduced and studied.
Equivalence relation
Cite
Citations (10)
Cite
Citations (4)