Search

Scholarly Works (2 results)

Article
Peer Reviewed

High-dimensional semi-supervised learning: in search for optimal inference of the mean

UC San Diego Previously Published Works (2019)

We provide a high-dimensional semi-supervised inference framework focused on the mean and variance of the response. Our data are comprised of an extensive set of observations regarding the covariate vectors and a much smaller set of labeled observations where we observe both the response as well as the covariates. We allow the size of the covariates to be much larger than the sample size and impose weak conditions on a statistical form of the data. We provide new estimators of the mean and variance of the response that extend some of the recent results presented in low-dimensional models. In particular, at times we will not necessitate consistent estimation of the functional form of the data. Together with estimation of the population mean and variance, we provide their asymptotic distribution and confidence intervals where we showcase gains in efficiency compared to the sample mean and variance. Our procedure, with minor modifications, is then presented to make important contributions regarding inference about average treatment effects. We also investigate the robustness of estimation and coverage and showcase widespread applicability and generality of the proposed method.

Cover page: High-dimensional semi-supervised learning: in search for optimal inference of the mean

Thesis
Peer Reviewed

Robust and Efficient Methods in Semi-supervised Inference and Causal Inference

Zhang, Yuqian
Advisor(s): Bradic, Jelena

UC San Diego Electronic Theses and Dissertations (2022)

We consider the mean response estimation and inference in semi-supervised settings in the first two chapters. Such settings consist of a relatively small labeled dataset and an extensive unlabeled dataset. Chapter 1 considers the classical semi-supervised setup that the outcome is missing completely at random (MCAR). Our goal is to improve the efficiency of the supervised sample mean estimator using the additional unlabeled data. We proposed a semi-supervised mean estimator based on flexible working models, including high-dimensional and non-parametric models. In Chapter 2, we further consider the situation that a selection bias may appear. Our goal is to remove the bias originating from the dependence between the missing and outcome. We propose a semi-supervised doubly robust mean estimator with valid inference results when some product rate condition holds. Our work fills in the gap between the semi-supervised literature and the missing data literature. We allow selection bias -- this extends the semi-supervised literature. We also allow extremely unbalanced labeled/unlabeled groups and violate the usual positivity condition, which is always assumed throughout the missing data literature.

The last two chapters consider the estimation and inference of the dynamic treatment effect (DTE) when the treatment variable is longitudinal and the covariates are possibly high dimensional. Chapter 3 proposes a doubly robust DTE estimator based on (imputed) Lasso-type nuisance estimators. We established root-n inference when all the nuisance models are correctly specified and some sparsity conditions hold. Chapter 4 further provides root-n inference for the DTE even when model misspecification occurs. This is achieved based on special ``moment targeting'' nuisance estimators. We provide valid inference as long as one of the nuisance models is correctly specified at each time spot -- such a result is better than all the existing literature, even containing the low-dimensional works.

Cover page: Robust and Efficient Methods in Semi-supervised Inference and Causal Inference