Homeless People Whose Self-Reported SSI/DI Status Is Inconsistent with Social Security Administration Records

by
Social Security Bulletin, Vol. 67, No. 1, 2007

Clinicians routinely ask indigent new clients whether they receive Supplemental Security Income (SSI) payments or Social Security Disability Insurance (DI) benefits, and this information is incorporated into treatment planning. Using questionnaire responses by 7,220 homeless people with mental illness, we first determined what demographic and clinical factors were associated with reporting receipt of SSI or DI benefits and not being in the SSA database and, second, what factors were associated with reporting not receiving benefits but have SSA records indicating otherwise. The low agreement between client reports and administrative records suggests that clinicians should verify the information provided by clients, especially those who are psychotic or medically ill, because that information is often inaccurate.


Marc I. Rosen, MD, is an Associate Professor of Psychiatry at the Yale University School of Medicine, VA Connecticut Healthcare System, Department of Psychiatry. Thomas J. McMahon, PhD, is an Associate Professor of Psychiatry at the West Haven Mental Health Center, West Haven, CT. Robert Rosenheck, MD, is a Professor of Psychiatry and Public Health at the Yale Medical School, Director of the Division of Mental Health Services and Treatment Outcomes Research in the Yale Department of Psychiatry, and Director of the Department of Veterans Affairs Northeast Program Evaluation Center, West Haven, CT.

Acknowledgments: We would like to acknowledge the Social Security Administration for providing beneficiary data and explaining their database to us. This work was supported in part by the following grants: R21-DA17311, R01-DA012952, MHI 02-001, K02-DA017277 (MIR), the VISN 1 MIRECC, and P50-DA09241.

The findings and conclusions presented in the Bulletin are those of the authors and do not necessarily represent the views of the Social Security Administration.

Summary

Clinicians routinely ask people with disabling psychiatric illnesses whether they receive Supplemental Security Income (SSI) or Social Security Disability Insurance (DI) benefits. We looked at self-reported receipt of SSI or DI by 7,220 homeless people with mental illness and compared those self-reports with information in Social Security Administration (SSA) databases. Overall agreement between the two sources was only fair (kappa = 0.60), and 41.3 percent (934/2,257) of clients reporting receipt of SSI or DI were not in SSA's databases. In multivariate analyses, people reporting receipt of SSI or DI that is unconfirmed by SSA administrative records had disproportionately more severe psychotic and medical illnesses than confirmed nonrecipients. Among recipients identified by SSA, those who did not report receiving SSI or DI were more likely to claim, apparently incorrectly, that they instead received Social Security retirement benefits. Clinicians should verify basic demographic information provided by clients, especially those who are psychotic or medically ill, because that information is often inaccurate.

Introduction

People disabled by psychiatric illness depend on Supplemental Security Income (SSI) and Social Security Disability Insurance (DI) benefits to meet their basic needs. Disability payments provide critical financial support in preventing homelessness among the indigent (Sosin and Grossman 1991) and contribute to improved outcomes when homeless mentally ill people receive treatment (Rosenheck, Frisman, and Gallup 1995). Clinicians routinely ask indigent new clients if they receive SSI or DI, and this information is incorporated into treatment planning.

Given the importance of disability payments to people disabled by psychiatric illnesses, it is ironic that no prior studies have been done on the validity of self-reported SSI/DI status among the mentally ill. Some studies have described the low reliability (Jenkins and others 2005) and accuracy (Pedace and Bates 2001; Card, Hildreth, and Shore-Sheppard 2004; Jackle and others 2004) of self-reported income among poor people, but there are no studies to inform clinicians by describing specific psychiatric and medical characteristics of people whose self-reported SSI/DI status is inaccurate. The underreporting of symptoms and the inconsistency of information provided are considerable when people with substance abuse (Stephens 1972; Rounsaville and others 1981) or psychiatric disorders (Strauss, Carpenter, and Nasrallah 1978) are asked to describe their psychiatric history and symptoms. However, there is little data concerning whether homeless people with mental illness inaccurately report basic demographic information and, specifically, whether they accurately report receipt of SSI and DI.

There are several potential explanations for why clients might report SSI/DI receipt inaccurately. The misreporting of SSI/DI benefits may reflect neuropsychological deficits. Inaccurate self-reports might track related constructs like the degree of knowledge about one's medical care, which is lower in people with cognitive deficits and reading difficulties (Baker and others 1995; Kalichman and others 2000; Baker and others 2002). Another possibility is that inaccurate self-reported income is influenced by subtle social pressures to underestimate income. Evidence for the underreporting of income by poor people is that families reporting low income in the Labor Department's Consumer Expenditure Survey reported much higher expenditures, and low income and high expenses are difficult to reconcile (Jencks 1997).

The first goal of this study, conducted in 2004, was to document the degree of agreement between a client's self-report that he or she received SSI or DI benefits and SSA administrative records of whether the person was receiving benefits. We then characterized those clients whose self-reported SSI/DI status was not consistent with SSA administrative records using comprehensive clinical data, self-reported SSI/DI status, and SSA administrative data from participants in a large study of individuals who were homeless and mentally ill. This study first determined what demographic and clinical factors were associated with self-reports of SSI/DI receipt and not being in the SSA database; it then identified what factors were associated with reporting not receiving benefits but having SSA records that indicate otherwise.

Methods

Participants and Sampling

Participants were enrolled in the ACCESS (Access to Community Care and Effective Services and Supports) demonstration study, a study of service delivery strategies for homeless people with mental illness (Randolph and others 2002). In ACCESS, agencies in 18 cities offered Assertive Community Treatment (Stein and Test 1980) to 100 participants per year for 4 years. Participants were eligible if they were homeless, had a severe mental illness, and were not engaged in psychiatric treatment at the time of enrollment. Eligible participants were identified and offered case management services. After providing informed consent, a comprehensive set of assessments was completed.

Data Collection

Research assistants using structured interviews collected data. Basic demographic data included age, sex, children in residence, race and ethnicity, years of education, longest full-time job, and veteran status. Homelessness was characterized by age at the first episode of homelessness, number of times homeless, lifetime number of years homeless, and years living in the current city of residence. Legal status questions included questions about having ever been convicted or incarcerated. History of arrests (McClellan and others 1980) and victimization (Lehman 1988) within the last 60 days were also documented. Self-reported data concerning the presence or absence of 17 medical disorders and whether the client was taking prescribed medication were also recorded. Other self-reported symptoms quantified social support (Vaux and Athanassopulou 1987; Lam and Rosenheck 1999), service utilization (Rosenheck and others 2002), a history of conduct disorder (Helzer 1981), and stability of family of origin (Kadushin, Boulanger, and Martin 1981). Participants reported the number of days in the last 60 that they had been housed and the number of days in the last 30 that they had been employed. Overall quality of life was also assessed by the question "Overall, how do you feel about your life right now?" on a scale ranging from 1 (terrible) to 7 (delighted) (Lehman 1988).

Psychiatric diagnoses were those of the admitting clinicians on the case management teams. Psychiatric measures were derived from the Addiction Severity Index (ASI) psychiatric composite problem index, a depression scale derived from the Diagnostic Interview Schedule (Robins, Helzer, and Croughan 1981), and a psychotic symptoms scale derived from the Psychiatric Epidemiology Research Interview (Dohrenwend 1982). Depression was quantified as the number of symptoms of depression out of 5 endorsed by the client, and interviewer ratings of psychosis were derived from 13 items ranked on a 0–4 Likert scale.

Substance abuse was assessed by questions drawn from the Addiction Severity Index (McClellan and others 1980), and a referring clinician rated the patient's substance use on 5-point clinical rating scales anchored by 1 (abstinence) and 5 (severe dependence) (Mueser and others 1995).

Service utilization was measured by questions concerning receipt of six types of services: assistance from a public housing agency, mental health services, general health care, substance abuse services, public income support, and vocational rehabilitation. The number of services received was calculated. Finally, the research assistant rated the reliability of the participant's data on a 5-point scale.

Income Data

Participants were asked to record how much income they had received during the past month from a list of possible sources. Participants were also asked to record earnings for the current month, even if the money had not yet been received. The sources listed included earned income, Social Security retirement benefits, Supplemental Security Income, Social Security Disability Insurance, social welfare benefits from state or county governments such as general welfare and Aid to Families with Dependent Children (AFDC), and nine other potential sources of income. Participants were asked if there was anyone who "handles your money for you (like a payee or guardian)" and, if so, whether the client's checks were mailed directly to this person.

SSA's Office of Research, Evaluation, and Statistics provided client-level data on beneficiary status by cross-matching Social Security numbers of ACCESS participants with those in SSA's Master Beneficiary Record and Payment History Update System, which record payments from the DI program, and the Supplemental Security Record, which records payments from the SSI program. SSA provided data only when its files contained a corresponding Social Security number verified by date of birth. SSA's algorithm for determining whether there is a cross-match—the Enumeration Verification System—did not require the supplied dates of birth to exactly match those in SSA's databases. A Social Security number match was verified when the years of birth agreed or when the months agreed and the years differed by one year.

Data Analysis

The purpose of the study was to determine whether participants could distinguish SSI from DI from other sources of income. We were not concerned with whether participants could distinguish SSI from DI, so receipt of SSI or DI was considered a single measure (SSI/DI). Kappa was calculated to characterize the overall agreement between self-reported and SSA verification of receipt of SSI/DI. The kappa statistic describes the agreement between two dichotomous variables with a range of zero (no agreement) to 1 (perfect agreement). Then, two similar analyses were conducted. The first analysis determined demographic and clinical factors that differentiated people who reported receiving SSI/DI but were not in the SSA database from those who did not report receiving SSI/DI and were also not in the SSA database. Chi-square and t-test comparisons between the two groups were conducted on a broad range of measures. Measures that differentiated the two groups at p<.05 were entered into a logistic regression, and backward elimination was used to identify the most salient correlates at p<.01. A similar approach was employed to compare two other groups: those reporting that they did not receive SSI/DI but in fact were in the SSA databases as receiving benefits and those who reported receiving SSI/DI and were confirmed by SSA records.

Results

Sampling and Overall Agreement Between Self-Report and SSA Databases

Altogether, 16 percent of participants ([934 + 193]/7,220) reported SSI/DI status that was not verified by the SSA database (Table 1). The majority of the discordant reports were from participants who reported having received SSI/DI but were not in the SSA database (13 percent of the total sample) and 3 percent who reported not having received SSI/DI but in fact were in the SSA database. Kappa was 0.60, indicating moderate agreement between self-reports and SSA records (Cicchetti and Sparrow 1981).

Table 1. Agreement on SSI/DI receipt between self-reports and SSA records
Receipt of SSI/DI benefits verified by SSA records? Self-reported receipt of SSI/DI benefits?
No Yes
No 4,770 934
Yes 193 1,323
SOURCE: Self-report data were collected in the ACCESS demonstration and were cross-matched with the Social Security Administration's Master Beneficiary Record, Payment History Update System, and the Supplemental Security Record.
NOTES: The data include 7,220 observations.
Kappa = 0.60

Sample Characteristics by Self-Reported and SSA-Verified SSI/DI Status

The sample characteristics shown in Table 2 indicate, as expected, relatively long durations of homelessness and high rates of psychiatric comorbidity and substance abuse. All the measures in Table 2, within the groups of those who had and had not received SSI or DI according to SSA, significantly differentiated the participant group whose self-report was concordant with SSA from participants whose self-report was discordant with SSA's administrative records.

Table 2. Baseline characteristics, by SSI/DI status according to SSA records and self-reports
Characteristic Mean or percentage (standard deviation) of those with SSI/DI according to SSA Mean or percentage (standard deviation) of those without SSI/DI according to SSA
Self-report concordant with SSA (n = 1,323) Self-report discordant with SSA (n = 193) Self-report concordant with SSA (n = 4,770) Self-report discordant with SSA (n = 934)
Demographic
Age (years) 40.4(9.5) 43.6(13.7) *** 37.5(9.4) 40.3(9.2) ***
Sex (male) 67.0% 67.7% 61.9% 56.5% **
African American 51.2% 37.4% *** 44.9% 53.2% ***
Hispanic 3.1% 5.1% 6.3% 3.2% ***
English first language 3.9% 7.2% * 6.5% 4.2% **
Years of education 11.7(2.6) 11.5(3.0) 11.7(2.5) 11.1(2.6) ***
Vocational
Veteran 22.8% 26.8% 18.7% 13.2% ***
Years at longest full-time job 3.5(4.7) 4.7(7.6) ** 3.6(4.7) 2.4(4.4) ***
Days working in last 30 0.9(3.5) 1.2(4.3) 2.4(5.7) 0.7(3.2) ***
Years homeless 3.5(5.3) 3.3(5.9) 3.0(4.8) 3.9(6.0) ***
Days housed in last 60 12.8(18.3) 9.9(16.5) * 11.3(17.1) 12.6(18.0) **
Days incarcerated in last 60 1.3(5.9) 2.6(10.0) ** 2.2(8.3) 1.4(6.9) **
Income
Percentage reporting receipt of—
Social Security retirement income 3.7% 29.2% *** 0.6% 1.0%
Food stamps 35.2% 22.1% *** 48.9% 41.7% ***
Other social welfare benefit 4.5% 9.2% ** 23.7% 7.6% ***
Number of types of benefits received 0.5(0.6) 0.7(0.7) *** 0.8(0.8) 0.6(0.7) ***
Percentage reporting someone else receives and manages check 29.3% 21.2% * 4.4% 27.6% ***
Psychiatric
Schizophrenia 51.5% 52.8% 27.9% 53.9% ***
Bipolar 22.1% 19.5% 20.4% 17.2% *
Major depression 33.9% 31.8% 56.7% 32.6% ***
Lifetime psychiatric hospitalizations 8.5(12.3) 6.4(12.2) ** 3.0(6.2) 7.8(11.4) ***
Observer-rated psychosis 11.6(7.9)% 12.3(8.8)% 10.0(7.8)% 12.8(8.3)% ***
Depression symptoms (number out of 5) 2.7(2.1) 2.5(2.1) 3.5(1.9) 2.7(2.1) ***
Substance use
Clinician-rated alcohol use 2.2(1.3) 2.0(1.2) * 2.2(1.3) 2.2(1.3)
Clinician-rated drug use 2.1(1.4) 1.8(1.2) ** 2.0(1.3) 1.9(1.3)
Years of alcohol use 5.7(8.7) 4.9(9.0) 5.9(8.4) 4.6(7.8) ***
Years of cannabis use 5.9(8.6) 4.0(8.0) ** 6.0(8.2) 5.3(8.4) *
Years of cocaine use 1.8(4.5) 1.2(3.8) 2.0(4.5) 1.3(3.7) ***
Medical
HIV seropositive 4.8% 3.1% 2.5% 5.2% ***
Percentage diagnosed with seizure disorder 10.1% 10.3% 7.2% 11.6% ***
Baseline treatment in last 60 days
Percentage receiving psychiatric Rx 70.8% 60.8% ** 62.4% 71.4% ***
Percentage receiving substance abuse Rx 30.3% 23.6% 33.8% 28.5% **
Number of services accessed 2.4(1.0) 1.6(1.1) *** 1.6(1.1) 2.3(0.9) ***
SOURCE: Self-report data were collected in the ACCESS demonstration and were cross-matched with the Social Security Administration's Master Beneficiary Record, Payment History Update System, and the Supplemental Security Record.
* Significant difference from corresponding SSA concordant group at p<.05.
** Significant difference from corresponding SSA concordant group at p<.01.
*** Significant difference from corresponding SSA concordant group at p<.001.

Comparison Among Clients not Receiving SSI/DI According to SSA: Participants Self-reporting Receipt of SSI/DI versus Those not Self-reporting Receipt. In multivariate analyses, the measures that significantly (p<.01) distinguished the 934 individuals reporting receipt of SSI/DI (without SSA verification) from the 4,770 not reporting receipt (in concordance with SSA records) are listed in Table 3. The 934 participants with unverified reports of receiving SSI/DI were more impaired in several realms. They had disproportionately less education and employment and were disproportionately more likely to have been diagnosed with schizophrenia, human immunodeficiency virus (HIV), and seizure disorders.

Table 3. Logistic regression analysis of group who reported receiving SSI/DI among the sample of those without benefits per SSA records
Measure Odds ratio 99 percent confidence limits
Demographic, vocational, and housing
Age 1.05 1.03–1.06 ***
English first language 0.55 0.32–0.96 *
Years of education 0.92 0.88–0.97 ***
Veteran 0.6 0.42–0.84 ***
Years at longest full-time job 0.91 0.88–0.94 ***
Days working in last 30 1.01 1.01–1.02 ***
Days housed in last 60 0.92 0.89–0.95 ***
Days incarcerated in last 60 0.98 0.96–0.99 **
Psychiatric
Schizophrenia 1.54 1.19–2.01 ***
Major depression 0.66 0.51–0.86 ***
Number of psychiatric hospitalizations 1.05 1.04–1.07 ***
Observer-rated psychosis 1.03 1.02–1.05 ***
Depression symptoms (number out of 5) 0.88 0.83–0.94 ***
Substance Use
Years of alcohol use 0.98 0.96–0.99 ***
Years of cocaine use 0.96 0.93–1.0 *
Medical
HIV status 1.85 1.02–3.34 *
Seizure 1.58 1.06–2.36 *
Other
Other social welfare benefit (yes or no) 0.12 0.07–0.20 ***
Number of types of benefits received 0.77 0.62–0.96 *
Self-report that someone else receives and manages check 7.3 5.2–10.3 ***
Number of services accessed in last 60 days 2.62 2.32–2.96 ***
SOURCE: Self-report data were collected in the ACCESS demonstration and were cross-matched with the Social Security Administration's Master Beneficiary Record, Payment History Update System, and the Supplemental Security Record.
NOTES: Total sample size is 5,407; 934 reported receiving SSI/DI but were shown as not receiving benefits in the Social Security Administration's records.
Somers' D = 0.91.
* Significant difference from group who reported receiving SSI/DI at p<.01 by pairwise comparison.
** Significant difference from group who reported receiving SSI/DI at p<.001 by pairwise comparison.
*** Significant difference from group who reported receiving SSI/DI at p<.0001 by pairwise comparison.

Not all functional indices were worse among those with unverified claims. Within this population of homeless people, those who had unverified claims were likely to have used alcohol and cocaine for fewer years and to have been incarcerated for fewer days in the preceding 60 than were those who did not claim receipt of SSI/DI. Self-reported depressive symptoms and a diagnosis of major depression were associated with a lower likelihood of making an unconfirmed claim of receiving SSI/DI.

Benefit status differed between the two groups. Participants with unverified claims of receiving SSI/DI were more likely to report having a payee than were those who did not claim benefit receipt. Those with unverified claims also had received fewer benefits overall.

Comparison Among Clients Receiving SSI/DI According to SSA: Participants not Self-reporting Receipt of SSI/DI versus Those Self-reporting Receipt. Participants who did not report receiving SSI/DI in contradiction to SSA's records that they actually had received benefits were more likely to have reported receipt of Social Security retirement benefits and other social welfare benefits (Table 4). In a post hoc analysis, we considered the possibility that clients who thought they received Social Security retirement benefits were disproportionately aged 62 or older, and they were. Altogether, 17.4 percent (34/195) of participants who inaccurately reported nonreceipt of SSI/DI were aged 62 or older, but only 3 percent (39/1,322) of those with concordant reports of receiving SSI/DI were aged 62 or older (chi-square 77.8, p<.0001).

Table 4. Logistic regression analysis of group who denied receiving SSI/DI among the sample of those with benefits per SSA records
Measure Odds ratio 99 percent confidence limits
Days incarcerated in last 60 1.03 1.00–1.06 *
Clinician-rated alcohol use 0.82 0.68–1.0 *
Social Security retirement income 17.45 9.10–33.43 ***
Food stamps 0.53 0.30–0.91 *
Other social welfare benefit (yes or no) 5.54 2.31–13.29 ***
Number of services accessed in last 60 days 0.34 0.26–0.45 ***
SOURCE: Self-report data were collected in the ACCESS demonstration and were cross-matched with the Social Security Administration's Master Beneficiary Record, Payment History Update System, and the Supplemental Security Record.
NOTES: Total sample size is 1,516; 193 reported not receiving SSI/DI but were shown as receiving benefits in the Social Security Administration's records.
Somers' D = 0.87.
* Significant difference from group who denied receiving SSI/DI at p<.01 by pairwise comparison.
** Significant difference from group who denied receiving SSI/DI at p<.001 by pairwise comparison.
*** Significant difference from group who denied receiving SSI/DI at p<.0001 by pairwise comparison.

Discussion

Fully 41 percent (934/2,257) of clients who reported receiving SSI/DI benefits did not receive them according to SSA. Clients whose report of receiving SSI/DI was unconfirmed were more likely to have conditions associated with neurocognitive impairment: they were disproportionately psychotic, HIV-positive, diagnosed with a seizure disorder, and occupationally impaired. Clients who misreported basic demographic information may also not have understood the benefits they receive, the question asked, or how to translate their knowledge into a correct response. The clients whose report of receiving SSI/DI was not confirmed used cocaine and alcohol for disproportionately fewer years, but this finding is not inconsistent with a cognitive explanation for anomalous self-reports—some studies indicate that within populations of people with mental illness, those who use drugs may actually be higher functioning (Ries and others 2000).

Cognitive problems also may have been a factor when participants who had received SSI/DI according to SSA did not report receiving those benefits. These clients appear to have been confused by different types of "social" benefits and apparently indicated receipt of Social Security retirement benefits and social welfare benefits instead of the actual SSI/DI they were receiving.

The overreporting of SSI/DI receipt relative to administrative databases in this homeless, mentally ill population is in contrast to the underreporting of income among poor people generally (Hotz and Scholz 2002). For example, validation of data from the Survey of Income and Program Participation suggested that self-report responses underestimated SSI receipt by as much as 23 percent (Marquis and Moore 1990). The responses of homeless people with mental illness may be affected by neurocognitive difficulties that are less salient in poor people who are not defined by homelessness and mental illness.

One clinical implication of the problematic self-reports is that when a client reports receiving SSI or DI, the assertion should be verified. The client can be asked the amount of the check or how the check came to be awarded. Clients should also be questioned to make sure the check referred to is an SSI or DI check and not another kind of payment. Information about benefit receipt can be obtained when another person receives the benefit check or by examining the clients' Medicare card. Primary Medicare beneficiaries who are too young to qualify for retirement benefits presumably receive DI.

The low agreement between self-report and SSA databases among the homeless, mentally ill population has other far-reaching implications. Data concerning sources of income are collected in the U.S. Census and several surveys specifically targeting poor people (Hotz and Scholz 2002). Accurate data about use of public support payments is crucial to assessing the impact of policies such as welfare reform (Primus and others 1999) and changes in eligibility for SSI and DI (Watkins, Wells, and McLellan 1999). In health services research, self-reported Social Security numbers and dates of birth are frequently used to cross-match data from people with known clinical characteristics with another database of interest (Friedman and others 1996; Bach and others 2002). A systematic bias is unwittingly introduced to data when a failure to cross-match is not random.

Some clients who reported receiving SSI/DI but did not appear in SSA databases probably did not cross-match with SSA databases because they provided inaccurate Social Security numbers (SSNs) or inaccurate dates of birth. In the 1996 Survey of Income and Program Participation, a full 16 percent of the SSNs provided by survey participants appeared to be inaccurate because they did not match SSNs in the Summary Earnings Record (Huynh, Rupp, and Sears 2002). One reason to suspect that inaccurate SSNs were provided is that the 1,323 participants whose reported receipt of SSI/DI was validated by SSA administrative records were similar to the 934 whose self-reported receipt was not validated (Table 2). For instance, both groups included high proportions of clients who reported that someone else received their check and managed it for them (29.3 percent and 27.6 percent, respectively). The clients who are discordant with SSA records could have some sort of non-SSA fiduciary arrangement, but the 27.6 percent reporting that someone else receives their check is consistent with other estimates that approximately a third of adults under the age of 65 who receive SSA payments based on a psychiatric disability have been assigned a payee to manage their funds (Social Security Administration 2001a, Table 7; and 2001b, Table 32).

Social Security numbers have high sensitivity and specificity in validating death against the National Death Index (Williams, Demitrack, and Fries 1992), and SSA databases are highly regarded (Waldron 2001). Yet underreporting of deaths to SSA does occur and is not random—underreporting of death information provided to SSA by third parties (such as state vital record systems) is less likely when the deceased was a woman, black, younger, unmarried, or from the South (Curb and others 1985; Wentworth, Neaton, and Rasmussen 1983; Boyle and Decoufle 1990).

Benefits for the Supplemental Security Income and Disability Insurance programs provide a vital safety net for clients disabled by psychiatric disorders. It is important that each individual's benefit status be accurately determined for that client's clinical care and that studies dependent on demographic information provided by impaired clients be independently verified so that use of the Social Security safety net is accurately described.

References

Bach, P.B., E. Guadagnoli, D. Schrag, N. Schussler, and J.L. Warren. 2002. Patient demographic and socioeconomic characteristics in the SEER-Medicare database: Applications and limitations. Medical Care 40(8 Suppl): 19–25.

Baker, D.W., J.A. Gazmararian, J. Sudano, M. Patterson, R.M. Parker, and M.V. Williams. 2002. Health literacy and performance on the Mini-Mental State Examination. Aging and Mental Health 6(1): 22–29.

Baker, D.W., R.M. Parker, M.V. Williams, W.S. Clark, and J. Nurss. 1995. The relationship of patient reading ability to self-reported health and use of health services. American Journal of Public Health 87(6): 1027–1030.

Boyle, C.A., and P. Decoufle. 1990. National sources of vital status information: Extent of coverage and possible selectivity in reporting. American Journal of Epidemiology 131(1): 160–168.

Card, D., A.K.G. Hildreth, and L.D. Shore-Sheppard. 2004. The measurement of Medicaid coverage in the SIPP: Evidence from a comparison of matched records. Journal of Business and Economic Statistics 22(4): 410–420.

Cicchetti, D.V., and S.A. Sparrow. 1981. Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior. American Journal of Mental Deficiency 86(2): 127–137.

Curb, J.D., C.E. Ford, S. Pressel, M. Palmer, C. Babcock, and C.M. Hawkins. 1985. Ascertainment of vital status through the National Death Index and the Social Security Administration. American Journal of Epidemiology 121(5): 754–766.

Dohrenwend, B.P. 1982. Psychiatric Epidemiology Research Interview (PERI). New York: Columbia University, Social Psychiatry Research Unit.

Friedman, L.A., J. Hidalgo, L.M. Bartnyska, and B.J. Turner. 1996. The severity classification system for acquired immunodeficiency syndrome hospitalizations: Association with survival after discharge and inpatient resource use. Medical Care 34(2): 178–189.

Helzer, J.E. 1981. Methodological issues in the interpretations of the consequences of extreme situations. In Stressful life events and their contexts, ed. B.S. Dohrenwend and B.P. Dohrenwend, 108–129. Monographs in Psychosocial Epidemiology 2, ed. B.Z. Locke and A.E. Slaby. New York: Prodist (Neale Watson Academic Publications).

Hotz, V. Joseph, and John Karl Scholz. 2002. Measuring employment and income for low-income populations with administrative and survey data. In Studies of welfare populations: Data collection and research issues, ed. Robert A. Moffitt, Constance Forbes Citro, and Michele Ver Ploeg, 275–315. Washington, DC: National Academy Press.

Huynh, M., K. Rupp, and J. Sears. 2002. The assessment of Survey of Income and Program Participation (SIPP) benefit data using longitudinal administrative records. Working Paper No. 238, Census Bureau, Washington, DC.

Jackle, A., E. Sala, S.P. Jenkins, and P. Lynn. 2004. Validation of survey data on income and employment: The ISMIE experience. ISER Working Paper No. 2004-14, Institute for Social and Economic Research, University of Essex. Available at http://www.iser.essex.ac.uk/pubs/workpaps/pdf/2004-14.pdf (accessed October 24, 2005).

Jencks, C. 1997. Foreword to Making ends meet: How single mothers survive welfare and low-wage work, by K. Edin and L. Lein. New York: Russell Sage Foundation.

Jenkins, S.P., P. Lynn, A. Jackle, and E. Sala. 2005. Methods Briefing 4—Improving survey measurement of income and employment (ISMIE). Institute for Social and Economic Research. .

Kadushin, C., G. Boulanger, and J. Martin. 1981. Long term stress reactions: Some causes, consequences, and naturally occurring support systems, vol. 4. Legacies of Vietnam. U.S. House of Representatives, Committee on Veterans Affairs, Committee Print No. 14. Washington, DC: U.S. Government Printing Office.

Kalichman, S.C., E. Benotsch, T. Suarez, S. Catz, J. Miller, and D. Rompa. 2000. Health literacy and health-related knowledge among persons living with HIV/AIDS. American Journal of Preventive Medicine 18(4): 325–331.

Lam, J.A., and R. Rosenheck. 1999. Social support and service use among homeless persons with serious mental illness. International Journal of Social Psychiatry 45(1): 13–28.

Lehman, A.F. 1988. A quality of life interview for the chronically mentally ill. Evaluation and Program Planning 11: 51–62.

Marquis, K.H., and J.C. Moore. 1990. Measurement errors in SIPP program reports. Proceedings of the U.S. Bureau of the Census 1990 Annual Research Conference, 721–745, Department of Commerce, Washington, DC.

McClellan, T., L. Luborsky, G.E. Woody, and C.P. O'Brien. 1980. An improved diagnostic evaluation instrument for substance abuse patients: The Addiction Severity Index. Journal of Nervous and Mental Disease 168: 26–33.

Mueser, K.T., R.E. Drake, R.E. Clark, G.J. McHugo, C. Mercer-McFadden, and T.H. Ackerson. 1995. Toolkit: Evaluating substance abuse in persons with severe mental illness. The Evaluation Center @ HSRI. Cambridge, MA: Human Services Research Institute.

Pedace, R., and N. Bates. 2001. Using administrative records to assess earnings reporting error in the Survey of Income and Program Participation. Journal of Economic and Social Measurement 26(3-4): 173–192.

Primus, Wendell, Lynette Rawlings, Kathy Larin, and Kathryn Porter. 1999. The initial impacts of welfare reform on the incomes of single-mother families. Washington, DC: Center on Budget and Policy Priorities.

Randolph, F., M. Blasinsky, J.P. Morrissey, R.A. Rosenheck, J. Cocozza, and H.H. Goldman. 2002. Overview of the ACCESS program. Psychiatric Services 53(8): 945–948.

Ries, R.K., J. Russo, D. Wingerson, M. Snowden, K.A. Comtois, D. Srebnik, and P. Roy-Byrne. 2000. Shorter hospital stays and more rapid improvement among patients with schizophrenia and substance disorders. Psychiatric Services 51(2): 210–215.

Robins, L.N., J.E. Helzer, and T. Croughan. 1981. The National Institute of Mental Health Diagnostic Interview Schedule. Archives of General Psychiatry 38: 381–389.

Rosenheck, R.A., J. Lam, J.P. Morrissey, M.O. Calloway, M. Stolar, and F. Randolph. 2002. Service systems integration and outcomes for mentally ill homeless persons in the ACCESS program. Psychiatric Services 53(8): 958–966.

Rosenheck, R., L. Frisman, and P. Gallup. 1995. Effectiveness and cost of specific treatment elements in a program for homeless mentally ill veterans. Psychiatric Services 46(11): 1131–1139.

Rounsaville, B.J., H.D. Kleber, C. Wilber, D. Rosenberger, and P. Rosenberger. 1981. Comparison of opiate addicts' reports of psychiatric history with reports of significant-other informants. American Journal of Drug and Alcohol Abuse 8(1): 51–69.

Social Security Administration, Office of Policy, Office of Research, Evaluation, and Statistics. 2001a. Annual statistical report on the Social Security Disability Insurance program, 2000. Washington, DC: SSA.

———. 2001b. SSI annual statistical report, 2000. Washington, DC: SSA.

Sosin, M.R., and S. Grossman. 1991. The mental health system and the etiology of homelessness: A comparison study. Journal of Community Psychology 19: 337–350.

Stein, L.I., and M.A. Test. 1980. Alternative to mental hospital treatment. I. Conceptual model, treatment program, and clinical evaluation. Archives of General Psychiatry 37(4): 392–397.

Stephens, R. 1972. The truthfulness of addict respondents in research projects. International Journal of the Addictions 7(3): 549–558.

Strauss, J.S., W.T. Carpenter Jr., and A.T. Nasrallah. 1978. How reliable is the psychiatric history? Comprehensive Psychiatry 19(3): 213–219.

Vaux, Alan, and Mary Athanassopulou. 1987. Social support appraisals and network resources. Journal of Community Psychology 15(4): 537–556.

Waldron, H. 2001. Results of the Office of Policy's 2001 User Satisfaction Survey. Social Security Bulletin 64(4): 33–47.

Watkins, K.E., K.B. Wells, and A.T. McLellan. 1999. Termination of Social Security benefits among Los Angeles recipients disabled by substance abuse. Psychiatric Services 50(7): 914–918.

Wentworth, D.N., J.D. Neaton, and W.L. Rasmussen. 1983. An evaluation of the Social Security Administration Master Beneficiary Record file and the National Death Index in the ascertainment of vital status. American Journal of Public Health 73(11): 1270–1274.

Williams, B.C., L.B. Demitrack, and B.E. Fries. 1992. The accuracy of the National Death Index when personal identifiers other than Social Security number are used. American Journal of Public Health 82(8): 1145–1147.