Foundations 8200

Survey Research Methods

 

Meeting Time:               4 PM – 6:50 PM Tuesdays

Instructor:                     Margaret E. Ross

                                    4018 Haley Center

                                    (334) 844-3084

                                    rossma1@auburn.edu (the first 1 = one)

Office Hours:                11 AM to 12 Noon Wednesdays

                                       3 PM to 4 PM Tuesdays and Thursdays

                                       or by appointment

 

 

 

Course Description

 

Overview of survey research, sampling, survey format, scaling, item construction, validity and reliability, ethical issues, and data analysis.

 

Course Objectives

 

Students will:

1.         Plan survey research

2.         Define constructs and/or survey content

3.         Write appropriate survey items

4.         Discuss advantages and disadvantages of measurement scales

5.         Develop appropriate survey scales

6.         Understand and interpret results of validity and reliability procedures

7.         Conduct statistical analyses to establish validity and reliability

8.         Prepare IRB for survey research

9.         Prepare survey and cover letter for mailing

10.        Recognize aspects of measurement instruments that help increase response rates

11.        Plan follow-up mailings

12.        Determine appropriate analyses of survey results

13.        Prepare a report describing the instrument development, instrument format, scaling, scoring, sampling used, and the results of the survey research

 

Suggested Resources

 

            Dillman, D. A. (2000) Mail and Internet Surveys: The Tailored Design Method. New York: John Wiley & sons, Inc.

 

            Shannon, D. M. & Davenport M. A. (2000).  Using SPSS to solve statistical problems: A self-snstructional Guide.  Merrill Prentice Hall, Upper Saddle River, New Jersey.

           

Publication manual of the American Psychological Association (any recent edition). Washington D.C., American Psychological Association.        

 

 

 

 

 

 

Student Assessment:

 

1.             Quizzes/in-class/homework projects and assignments

(you are required to be in class during in-class assignment

completion unless otherwise indicated)                                                    30%

2.         Instrument with at least 12 items developed by the researcher (YOU)      35%

3.         Information/Consent form or Cover Letter                                              15%    

4.         Report on Instrument (Individual)                                                           20%

 

·        Absolutely NO make ups … You must be in class to earn in-class points (quizzes, in-class labs, or any individual or group assignment completed in class) and you must turn in assignments on time. No late assignments will be accepted.     

·         Take-home assignments turned in late incur a 2% reduction in points per day late  

 

Weighted Grading

 

90 – 100% plus substantial contracted and graded outside project = A

80 – 100% = with no contracted outside project B

70 – 79% = C

60 – 69% = D

below 60% = F

 

Contracted Outside Project Ideas (need written product)

 

·         Complete/begin group survey research project for conference presentation or journal submission.

·         Work with professor on survey research project.

·         Special topics groups with information sheets for class, report, or presentation with power point. (also see below)

·         Other suggestions can be discussed.

 

Proposed contracts must be presented to me in writing by third class session. 

 

Special Topics Groups

  • Specific products…e.g. bulleted information sheets, presentation with power point, hands-on workshop (such as a web-based survey program) with lesson plan
  • Each member’s responsibility/contribution outlined specifically

 

Individual Project Ideas (for all students)

 

Methodologist for 7200 group with survey research project.

Dissertation instrument

Research project for publication or presentation

 

 

 

 

 

Individual Report Guidelines

 

(Information Letter/Consent Form and Instrument are to be attached)

 

Introduction that includes: (1 page only)

                        1.  statement of purpose of the study

2.  background information (list constructs based on theory, assumptions, program

goals) 

                        3. Research questions or hypotheses

Methods section that includes participant, measures, and procedures subsections (this should be substantial as it constitutes the majority of the project grade)

            Participants section should include: (approximately ˝ page)

                        1.  sampling methods

                        2.  descriptive information related to the sample

            Measures section should include: (4 to 5 pages)

                        1.  thorough description of instrument development

                        2.  thorough description of instrument (what is included, how items grouped, etc.)

3.  thorough description of scale and how items are scored and meaning of scores per

item and per scale

4.  how value(s) are obtained for analysis

5.  thorough description of how validity and reliability of scores are established

Analyses used to answer research questions

·         Follow APA Writing Style

·         Write in manuscript form (prose not listing)

·         The report and instrument must be typed

 

 

NOTES:

 

·         You will be provided with my grading rubrics for evaluating the reports and instruments.

·         The report should follow APA style.

·         Reports turned in late will be penalized 2% of total earned points per day past deadline.

 

 

 

Incompletes and Withdrawals  

 

Grades associated with incomplete course work or withdrawal from class will be assigned in strict conformity to University policy (see Auburn University Bulletin).  If you wish to drop this course you may do so by the 10th class day with no grade assignment. From the 10th class day to mid-quarter a W (withdrawn-passing) grade will be recorded in your transcripts. After this period withdrawal from the course will only be granted under unusual circumstances and must be approved by the Dean of the College of Education.

 

 

 

 

 

 

 

 

 

Academic Misconduct

 

The Department of EFLT recognizes university policy regarding academic misconduct. Violations include, but are not limited to: plagiarism, unauthorized assistance during examinations, submitting another’s work product as your own, using another’s words as your own without appropriate citation, sharing unauthorized materials with another that contain questions or answers to examinations, altering or attempting to alter assigned grades. In accordance with University policy regarding academic misconduct, students may be subject to several sanctions upon violations of the Student Academic Honesty Code. See the Tiger Cub publication for the current year for specifics regarding academic misconduct as well as student’s rights and responsibilities associated with the Code.

 

Disability Accommodations

 

Students who need accommodations are asked to arrange a meeting with me as soon as possible.  If you have a conflict with my office hours, an alternate time can be arranged.  To set up this meeting, please contact me by e-mail.  Bring a copy of your Accommodation Memo and an Instructor Verification Form to the meeting.  If you do not have an Accommodation Memo but need accommodations, make an appointment with The Program for Students with Disabilities, 1244 Haley Center, 844-2096.

 


Tentative Schedule

 

 

Week 1 - January 10 

·         Introductions

·         Syllabus and Overview

·         Class Project (Present/Publish)

·         Peer Advisory Groups

·         Reading Assignment:     "When a Survey Isn't Research"

Practical Considerations for Conducting Delphi Studies: The Oracle Enters a New Age by Eggers et al.

 

Week 2 - January 17 - Quiz over Assigned Readings

·         Reaction to Reading Assignments

·         Background Research to Define Survey Content

·         Literature

·         Theory

·         Delphi Method to Define Construct(s)

·         Program Goals

·         Interviews

·         Program Documents

  • Assignments:

·         Individual Project Purpose Statement and Research Question (SURVEY NEEDED!)

·         Article in your area of interest/field using Delphi Method summarized (typed summary due next week)

 

Week 3 - January 24

·         Research Question Due

·         Summary of Delphi Method Article Due

·         Experts

·         Delphi Method

·         Reporting on Theory and Delphi Articles (assignment)

·         What to Consider in Designing the Survey (Overview Handout pp. 1 - 3)

·         Sampling

·         Types of Items (open-ended vs. close-ended)

 

Week 4 – January 31

·         Application (Overview Handout and Item Writing)

·         Item Writing – 5 items -

·         Introduction to Scales

 

Week 5 - February 7

·         Scales Continued

·         Application - Item Writing – 5 items

 

 

 

 

 

Week 6 – February 14

·         Scales Continued

·         Application – Individual Project Item Writing (Overview Handout)

·         Format of Survey (Overview Handout)

·         Validity and Reliability Introduction

·         Reading Assignment:     Developing a Strong Program of Construct Validation: A

Test Anxiety Example by Jeri Benson

 

Week 7 – February 21 - Quiz over Assigned Readings

·         Discussion of Assigned Reading

  • Validity and Reliability
  • IRB
  • Application - LRC to write IRB

 

Week 8 – February 28

·         Application of Validity and Reliability Analyses (Computer Lab)

·         Begin writing validity/reliability section of individual report

·         Assignment:      Factors Affecting Response Rates to Mailed Questionnaires:

Quantitative Analysis of the Published Literature by Heberlein & Baumgartner

 

Week 9 - March 7 - Completed IRB Due (with questions you have about IRB)

  • Individual Projects
  • Discussion of Readings

 

Week 10 – March 14 – Quiz over Assigned Reading

·         Preparation for Mailing (Overview Handout)

·         Ethical Issues

·         Follow-up (return rates)

·         Analysis and Interpretation of Results

 

Week 11 – March 21

·        Plan for Analysis and Interpretation of Results (in-class assignment in Computer Lab)

 

March 28 no class…Spring Break

 

Week 12 - April 4

  • Reporting Results
  • LRC – Continue working on Individual Project

 

April 11 no class…AERA

 

Week 13 - April 18

Instruments and Reports Due (In LRC at computers)

  • Peer Reviews of Individual Instruments & Report

 

Week 14 - April 25

  • Round Table Presentations