Understanding Ways to Collect Data (8)

DATA COLLECTION PROCEDURE

Definition

Evaluation is the process of systematically collecting data that represents the opinion and experience of participants or other stakeholders. The main data collection techniques include literature reviews, interviews, questionnaires, participant observation, group discussions, and the collection of artifacts, documents, and photos.

1. Interviews

Interviews involve gathering information through oral questioning using a set of pre-planned core questions. They allow researchers to obtain detailed insights directly from participants and often lead to specific and constructive suggestions.

Types of Interviews

• Unstructured Interviews – Open-ended questions allow interviewees to express their opinions freely.
• Structured Interviews – Pre-determined, short, clearly worded questions, often closed-ended.
• Partially Structured Interviews – General topics are set, but the interviewer may modify or add questions as needed.
• Semi-structured Interviews – A mix of structured and unstructured approaches with both closed and open-ended questions.
• Totally Structured Interviews – Pre-determined questions, order, and coding, with responses limited to a set of choices.
• Focus-group Interviews – Less structured discussions that allow interaction among participants, leading to rich data.

Guidelines for Conducting Interviews

• Schedule interviews in advance based on the participant's convenience.
• Obtain permission before recording for ethical considerations.
• Be a good listener and avoid influencing responses.
• Encourage open sharing of experiences, feelings, and beliefs.

2. Questionnaires

A questionnaire allows data collection from a larger audience than interviews. However, unlike interviews, it cannot be customized for individuals.

Types of Questionnaires

• Closed-ended Questionnaire – Usually used in quantitative research.
• Open-ended Questionnaire – Allows participants to respond in their own words, commonly used in qualitative research.

Common Open-ended Question Formats

• What do you think about…?
• In your opinion, how…?
• How do you feel about…?
• List the causes of…

Guidelines for Administering Questionnaires

• Establish a frame of reference for participants before distribution.
• Pilot the questionnaire with a sample group (excluding actual participants).
• Implement a strict scheme for monitoring responses.

3. Focus Groups

A focus group involves multiple participants discussing a topic, allowing for interaction and a variety of viewpoints.

Advantages

• Encourages group interactions that bring out new insights.
• Provides deeper understanding of why opinions are held.
• Collects qualitative data efficiently at a lower cost.

Disadvantages

• Less control than individual interviews.
• Requires trained facilitators.
• Difficult to assemble groups and analyze data.

4. Observational Evaluation

Observation involves recording participants' behaviors, actions, and interactions. It can be participant-based (researcher actively involved) or non-participant-based (researcher observes without involvement).

Challenges in Observation

• Observer Effect – Participants may alter behavior if they know they are being observed.
• Observer Bias – The researcher’s perceptions may influence recorded observations.
• Observer Expectation – Preconceived notions about participants may impact interpretation.

5. Textual/Content Analysis

This method involves examining written or recorded materials, such as:

• Personal documents (diaries, letters).
• Institutional records (meeting minutes, newsletters).
• Media (photographs, newspapers, books, music, speeches).
• Historical archives (audio, video, digital files).

6. Personal Experience (Journaling & Other Methods)

Participants document their experiences through:

• Family stories.
• Journals on specific topics.
• Life stories in response to questions.
• Memories triggered by artifacts (e.g., photos).
• Think-aloud techniques or stimulated recall.

Final Notes

• Each data collection method has its strengths and limitations.
• Ethical considerations, such as obtaining consent and ensuring confidentiality, are crucial.
• Proper planning and execution improve the reliability and validity of collected data.