ADMINISTRATIVE RECORDS FOR SURVEY METHODOLOGY

Addresses the international use of administrative records for large-scale surveys, censuses, and other statistical purposes

Administrative Records for Survey Methodology is a comprehensive guide to improving the quality, cost-efficiency, and interpretability of surveys and censuses using administrative data research. Contributions from a team of internationally-recognized experts provide practical approaches for integrating administrative data in statistical surveys, and discuss the methodological issues—including concerns of privacy, confidentiality, and legality—involved in collecting and analyzing administrative records. Numerous real-world examples highlight technological and statistical innovations, helping readers gain a better understanding of both fundamental methods and advanced techniques for controlling data quality reducing total survey error.

Divided into four sections, the first describes the basics of administrative records research and addresses disclosure limitation and confidentiality protection in linked data. Section two focuses on data quality and linking methodology, covering topics such as quality evaluation, measuring and controlling for non-consent bias, and cleaning and using administrative lists. The third section examines the use of administrative records in surveys and includes case studies of the Swedish register-based census and the administrative records applications used for the US 2020 Census. The book’s final section discusses combining administrative and survey data to improve income measurement, enhancing health surveys with data linkage, and other uses of administrative data in evidence-based policymaking. This state-of-the-art resource:

Administrative Records for Survey Methodology is an indispensable reference and guide for statistical researchers and methodologists in academia, industry, and government, particularly census bureaus and national statistical offices, and an ideal supplemental text for undergraduate and graduate courses in data science, survey methodology, data collection, and data analysis methods.

Preface xv

Acknowledgments xxi

List of Contributors xxiii

Part I Fundamentals of Administrative Records Research and Applications 1

1 On the Use of Proxy Variables in Combining Register and Survey Data 3
Li-Chun Zhang

1.1 Introduction 3

1.1.1 A Multisource Data Perspective 3

1.1.2 Concept of Proxy Variable 5

1.2 Instances of Proxy Variable 7

1.2.1 Representation 7

1.2.2 Measurement 10

1.3 Estimation Using Multiple Proxy Variables 12

1.3.1 Asymmetric Setting 13

1.3.2 Uncertainty Evaluation: A Case of Two-Way Data 15

1.3.3 Symmetric Setting 17

1.4 Summary 20

References 20

2 Disclosure Limitation and Confidentiality Protection in Linked Data 25
John M. Abowd, Ian M. Schmutte, and Lars Vilhuber

2.1 Introduction 25

2.2 Paradigms of Protection 27

2.2.1 Input Noise Infusion 29

2.2.2 Formal Privacy Models 30

2.3 Confidentiality Protection in Linked Data: Examples 32

2.3.1 HRS–SSA 32

2.3.1.1 Data Description 32

2.3.1.2 Linkages to Other Data 32

2.3.1.3 Disclosure Avoidance Methods 33

2.3.2 SIPP–SSA–IRS (SSB) 34

2.3.2.1 Data Description 34

2.3.2.2 Disclosure Avoidance Methods 35

2.3.2.3 Disclosure Avoidance Assessment 35

2.3.2.4 Analytical Validity Assessment 37

2.3.3 LEHD: Linked Establishment and Employee Records 38

2.3.3.1 Data Description 38

2.3.3.2 Disclosure Avoidance Methods 39

2.3.3.3 Disclosure Avoidance Assessment for QWI 41

2.3.3.4 Analytical Validity Assessment for QWI 42

2.4 Physical and Legal Protections 43

2.4.1 Statistical Data Enclaves 44

2.4.2 Remote Processing 46

2.4.3 Licensing 46

2.4.4 Disclosure Avoidance Methods 47

2.4.5 Data Silos 48

2.5 Conclusions 49

2.A.1 Other Abbreviations 51

2.A.2 Concepts 52

Acknowledgments 54

References 54

Part II Data Quality of Administrative Records and Linking Methodology 61

3 Evaluation of the Quality of Administrative Data Used in the Dutch Virtual Census 63
Piet Daas, Eric S. Nordholt, Martijn Tennekes, and Saskia Ossen

3.1 Introduction 63

3.2 Data Sources and Variables 64

3.3 Quality Framework 66

3.3.1 Source and Metadata Hyper Dimensions 66

3.3.2 Data Hyper Dimension 68

3.4 Quality Evaluation Results for the Dutch 2011 Census 69

3.4.1 Source and Metadata: Application of Checklist 69

3.4.2 Data Hyper Dimension: Completeness and Accuracy Results 72

3.4.2.1 Completeness Dimension 73

3.4.2.2 Accuracy Dimension 75

3.4.2.3 Visualizing with a Tableplot 78

3.4.3 Discussion of the Quality Findings 80

3.5 Summary 81

3.6 Practical Implications for Implementation with Surveys and Censuses 81

3.7 Exercises 82

References 82

4 Improving Input Data Quality in Register-Based Statistics: The Norwegian Experience 85
Coen Hendriks

4.1 Introduction 85

4.2 The Use of Administrative Sources in Statistics Norway 86

4.3 Managing Statistical Populations 89

4.4 Experiences from the First Norwegian Purely Register-Based Population and Housing Census of 2011 91

4.5 The Contact with the Owners of Administrative Registers Was Put into System 93

4.5.1 Agreements on Data Processing 93

4.5.2 Agreements of Cooperation on Data Quality in Administrative Data Systems 95

4.5.3 The Forums for Cooperation 96

4.6 Measuring and Documenting Input Data Quality 96

4.6.1 Quality Indicators 96

4.6.2 Operationalizing the Quality Checks 97

4.6.3 Quality Reports 99

4.6.4 The Approach is Being Adopted by the Owners of Administrative Data 99

4.7 Summary 100

4.8 Exercises 101

References 104

5 Cleaning and Using Administrative Lists: Enhanced Practices and Computational Algorithms for Record Linkage and Modeling/Editing/Imputation 105
William E. Winkler

5.1 Introductory Comments 105

5.1.1 Example 1 105

5.1.2 Example 2 106

5.1.3 Example 3 107

5.2 Edit/Imputation 108

5.2.1 Background 108

5.2.2 Fellegi–Holt Model 110

5.2.3 Imputation Generalizing Little–Rubin 110

5.2.4 Connecting Edit with Imputation 111

5.2.5 Achieving Extreme Computational Speed 112

5.3 Record Linkage 113

5.3.1 Fellegi–Sunter Model 113

5.3.2 Estimating Parameters 116

5.3.3 Estimating False Match Rates 118

5.3.3.1 The Data Files 118

5.3.4 Achieving Extreme Computational Speed 123

5.4 Models for Adjusting Statistical Analyses for Linkage Error 124

5.4.1 Scheuren–Winkler 124

5.4.2 Lahiri–Larsen 125

5.4.3 Chambers and Kim 127

5.4.4 Chipperfield, Bishop, and Campbell 128

5.4.4.1 Empirical Data 130

5.4.5 Goldstein, Harron, and Wade 132

5.4.6 Hof and Zwinderman 133

5.4.7 Tancredi and Liseo 133

5.5 Concluding Remarks 133

5.6 Issues and Some Related Questions 134

References 134

6 Assessing Uncertainty When Using Linked Administrative Records 139
Jerome P. Reiter

6.1 Introduction 139

6.2 General Sources of Uncertainty 140

6.2.1 Imperfect Matching 140

6.2.2 Incomplete Matching 141

6.3 Approaches to Accounting for Uncertainty 142

6.3.1 Modeling Matching Matrix as Parameter 143

6.3.2 Direct Modeling 146

6.3.3 Imputation of Entire Concatenated File 148

6.4 Concluding Remarks 149

6.4.1 Problems to Be Solved 149

6.4.2 Practical Implications 150

6.5 Exercises 150

Acknowledgment 151

References 151

7 Measuring and Controlling for Non-Consent Bias in Linked Survey and Administrative Data 155
Joseph W. Sakshaug

7.1 Introduction 155

7.1.1 What is Linkage Consent? Why is Linkage Consent Needed? 155

7.1.2 Linkage Consent Rates in Large-Scale Surveys 156

7.1.3 The Impact of Linkage Non-Consent Bias on Survey Inference 158

7.1.4 The Challenge of Measuring and Controlling for Linkage Non-Consent Bias 158

7.2 Strategies for Measuring Linkage Non-Consent Bias 159

7.2.1 Formulation of Linkage Non-Consent Bias 159

7.2.2 Modeling Non-Consent Using Survey Information 160

7.2.3 Analyzing Non-Consent Bias for Administrative Variables 162

7.3 Methods for Minimizing Non-Consent Bias at the Survey Design Stage 163

7.3.1 Optimizing Linkage Consent Rates 163

7.3.2 Placement of the Consent Request 163

7.3.3 Wording of the Consent Request 165

7.3.4 Active and Passive Consent Procedures 166

7.3.5 Linkage Consent in Panel Studies 167

7.4 Methods for Minimizing Non-Consent Bias at the Survey Analysis Stage 168

7.4.1 Controlling for Linkage Non-Consent Bias via Statistical Adjustment 169

7.4.2 Weighting Adjustments 169

7.4.3 Imputation 170

7.5 Summary 172

7.5.1 Key Points for Measuring Linkage Non-Consent Bias 172

7.5.2 Key Points for Controlling for Linkage Non-Consent Bias 172

7.6 Practical Implications for Implementation with Surveys and Censuses 173

7.7 Exercises 174

References 174

Part III Use of Administrative Records in Surveys 179

8 A Register-Based Census: The Swedish Experience 181
Martin Axelson, Anders Holmberg, Ingegerd Jansson, and Sara Westling

8.1 Introduction 181

8.2 Background 182

8.3 Census 2011 183

8.4 A Register-Based Census 185

8.4.1 Registers at Statistics Sweden 185

8.4.2 Facilitating a System of Registers 186

8.4.3 Introducing a Dwelling Identification Key 187

8.4.4 The Census Household and Dwelling Populations 188

8.5 Evaluation of the Census 190

8.5.1 Introduction 190

8.5.2 Evaluating Household Size and Type 192

8.5.2.1 Sampling Design 192

8.5.2.2 Data Collection 193

8.5.2.3 Reconciliation 194

8.5.2.4 Results 194

8.5.3 Evaluating Ownership 195

8.5.4 Lessons Learned 198

8.6 Impact on Population and Housing Statistics 199

8.7 Summary and Final Remarks 201

References 203

9 Administrative Records Applications for the 2020 Census 205
Vincent T. Mule Jr, and Andrew Keller

9.1 Introduction 205

9.2 Administrative Record Usage in the U.S. Census 206

9.3 Administrative Record Integration in 2020 Census Research 207

9.3.1 Administrative Record Usage Determinations 207

9.3.2 NRFU Design Incorporating Administrative Records 208

9.3.3 Administrative Records Sources and Data Preparation 210

9.3.4 Approach to Determine Administrative Record Vacant Addresses 212

9.3.5 Extension of Vacant Methodology to Nonexistent Cases 214

9.3.6 Approach to Determine Occupied Addresses 215

9.3.7 Other Aspects and Alternatives of Administrative Record Enumeration 217

9.4 Quality Assessment 219

9.4.1 Microlevel Evaluations of Quality 219

9.4.2 Macrolevel Evaluations of Quality 221

9.5 Other Applications of Administrative Record Usage 224

9.5.1 Register-Based Census 224

9.5.2 Supplement Traditional Enumeration with Adjustments for Estimated Error for Official Census Counts 224

9.5.3 Coverage Evaluation 225

9.6 Summary 226

9.7 Exercises 227

References 228

10 Use of Administrative Records in Small Area Estimation 231
Andreea L. Erciulescu, Carolina Franco, and Partha Lahiri

10.1 Introduction 231

10.2 Data Preparation 233

10.3 Small Area Estimation Models for Combining Information 238

10.3.1 Area-level Models 238

10.3.2 Unit-level Models 247

10.4 An Application 252

10.5 Concluding Remarks 259

10.6 Exercises 259

Acknowledgments 261

References 261

Part IV Use of Administrative Data in Evidence-Based Policymaking 269

11 Enhancement of Health Surveys with Data Linkage 271
Cordell Golden and Lisa B. Mirel

11.1 Introduction 271

11.1.1 The National Center for Health Statistics (NCHS) 271

11.1.2 The NCHS Data Linkage Program 272

11.1.3 Initial Linkages with NCHS Surveys 272

11.2 Examples of NCHS Health Surveys that Were Enhanced Through Linkage 273

11.2.1 National Health Interview Survey (NHIS) 273

11.2.2 National Health and Nutrition Examination Survey (NHANES) 274

11.2.3 National Health Care Surveys 274

11.3 NCHS Health Surveys Linked with Vital Records and Administrative Data 275

11.3.1 National Death Index (NDI) 276

11.3.2 Centers for Medicare and Medicaid Services (CMS) 276

11.3.3 Social Security Administration (SSA) 277

11.3.4 Department of Housing and Urban Development (HUD) 277

11.3.5 United States Renal Data System and the Florida Cancer Data System 278

11.4 NCHS Data Linkage Program: Linkage Methodology and Processing Issues 278

11.4.1 Informed Consent in Health Surveys 278

11.4.2 Informed Consent for Child Survey Participants 279

11.4.3 Adaptive Approaches to Linking Health Surveys with Administrative Data 280

11.4.4 Use of Alternate Records 281

11.4.5 Protecting the Privacy of Health Survey Participants and Maintaining Data Confidentiality 282

11.4.6 Updates Over Time 283

11.5 Enhancements to Health Survey Data Through Linkage 284

11.6 Analytic Considerations and Limitations of Administrative Data 286

11.6.1 Adjusting Sample Weights for Linkage-Eligibility 287

11.6.2 Residential Mobility and Linkages to State Programs and Registries 288

11.7 Future of the NCHS Data Linkage Program 289

11.8 Exercises 291

Acknowledgments 292

Disclaimer 292

References 292

12 Combining Administrative and Survey Data to Improve Income Measurement 297
Bruce D. Meyer and Nikolas Mittag

12.1 Introduction 297

12.2 Measuring and Decomposing Total Survey Error 299

12.3 Generalized Coverage Error 302

12.4 Item Nonresponse and Imputation Error 305

12.5 Measurement Error 307

12.6 Illustration: Using Data Linkage to Better Measure Income and Poverty 311

12.7 Accuracy of Links and the Administrative Data 312

12.8 Conclusions 315

12.9 Exercises 316

Acknowledgments 317

References 317

13 Combining Data from Multiple Sources to Define a Respondent: The Case of Education Data 323
Peter Siegel, Darryl Creel, and James Chromy

13.1 Introduction 323

13.1.1 Options for Defining a Unit Respondent When Data Exist from Sources Instead of or in Addition to an Interview 324

13.1.2 Concerns with Defining a Unit Respondent Without Having an Interview 325

13.2 Literature Review 326

13.3 Methodology 327

13.3.1 Computing Weights for Interview Respondents and for Unit Respondents Who May Not Have Interview Data (Usable Case Respondents) 327

13.3.1.1 How Many Weights Are Necessary? 328

13.3.2 Imputing Data When All or Some Interview Data Are Missing 328

13.3.3 Conducting Nonresponse Bias Analyses to Appropriately Consider Interview and Study Nonresponse 329

13.4 Example of Defining a Unit Respondent for the National Postsecondary Student Aid Study (NPSAS) 330

13.4.1 Overview of NPSAS 330

13.4.2 Usable Case Respondent Approach 333

13.4.2.1 Results 333

13.4.3 Interview Respondent Approach 335

13.4.3.1 Results 336

13.4.4 Comparison of Estimates, Variances, and Nonresponse Bias Using Two Approaches to Define a Unit Respondent 338

13.5 Discussion: Advantages and Disadvantages of Two Approaches to Defining a Unit Respondent 340

13.5.1 Interview Respondents 340

13.5.2 Usable Case Respondents 341

13.6 Practical Implications for Implementation with Surveys and Censuses 342

13.A Appendix 343

13.A.1 NPSAS:08 Study Respondent Definition 343

13.B Appendix 343

References 348

Index 349