Methods to Foster Transparency and Reproducibility of Federal Statistics Proceedings of a Workshop (2019) / Chapter Skim
Currently Skimming:
2 Existing Guidelines Related to Transparency
2 Existing Guidelines Related to Transparency
Pages 5-12
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 5... ...
In 1947, AAPOR was founded as an organization of individual survey research professionals with the goal of advancing survey research. From its inception, AAPOR included government, academic, and commercial members and was intended to serve not only public opinion researchers but all survey professionals.
|
From page 6... ...
The items that have to be reported immediately include who sponsored, conducted, and funded the research; the exact wording of survey questions; the specification of the population of study; the geographic location of interest; a description of the sample frame; the sample design; the sample size and error; weighting and cluster adjustments; and method(s) and dates of data collection.
|
From page 7... ...
To allay such concerns, in 2015 the Federal Committee on Statistical Methodology (FCSM) sent a letter to AAPOR detailing the federal commitment to transparency in a variety of standing policies,3 noting that AAPOR's Transparency Initiative requirements align with the disclosure requirements of statistical agencies.
|
From page 8... ...
, which requires public comment periods and documentation for any new survey data collection; and (2) OMB policy directive No.
|
From page 9... ...
OMB's survey documentation standards also contain three other etailed d guidelines, Harris-Kojetin said. Guideline 7.3.2 concerns survey replication and evaluation; Guideline 7.3.3 requires a periodic evaluation report, such as a methodology report, that itemizes all sources of identified error; and Guideline 7.3.4 calls for the retention of all survey documentation consistent with appropriate federal records disposition and archival policy.8 Harris-Kojetin pointed out that OMB's standards and guidelines are clearly survey-centric, but not exclusively so.
|
From page 10... ...
In addition, he noted, OMB memo M-14-06 provides guidance on providing and using administrative data for statistical purposes.10 However, Harris-Kojetin said that there has not been a systematic effort to develop the same kind of guidelines and standards and regulations for the use of admini trative records and for the products of complicated statistical s odels as there has been for surveys and the usual survey estimates. m A participant asked Harris-Kojetin whether, when OMB established these standards, there was a problem when providing the documentation for electronic survey instruments, given the complicated skip patterns and other characteristics.
|
From page 11... ...
In response to the question about the OMB standards, Harris-Kojetin said that the PRA requires that ongoing data collections be submitted for renewal every 3 years, so there is definitely follow-up on certain aspects of the data collection. However, he noted, in his tenure at OMB he never asked for all 18 items of survey documentation, since a fair number of things are subsumed in agencies' general documentation.
|
From page 12... ...
Eltinge described the administrative records quality checklist developed by the Federal Committee on Statistical Methodology's (FCSM's) Administrative Records Subcommittee, which is available on the Web.11 At the same time, FCSM is looking at the integration of multiple data sources.
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.