M.Sc. EXT-504 Course Content
M.Sc. EXT-504 Course Content
Credits: 3(2+1)
Course Code: EXT-504
Title: RESEARCH METHODOLOGY IN EXTENSION
WHY THIS COURSE?
Growth of any discipline is directly proportional to the creation of knowledge in that
discipline. Extension research is the backbone of extension discipline. Extension research
is a unique social science inquiry where research ideas are gathered from the field
problems and put through a systematic cycle of objective investigations that result in
significant solutions. Apart from developing theories and models that advance scientific
knowledge, extension research should also provide new insights for improving extension
policy and practice. As extension is a field oriented discipline seeking to improve the
welfare of its stakeholders, the extension professionals require critical competencies in
conducting empirical research for developing sound extension models, methods and tools.
LEARNING OUTCOMES
- Understand the concepts, paradigms, approaches and strategies of behavioural
research
- Enable to choose research design, methods and tools suitable for the research
problem
- Design research instruments skilfully and conduct research in an objective
andunbiased way
- Analyse the data through appropriate analytical methods and tools and
2
derivemeaningful interpretations
3
Unit 3: Identifying Variables and Hypotheses
Sampling - population, element, sample, sampling unit, and subject; Sampling strategies
for quantitative and qualitative research; Principles of sampling; Factors affecting the
inferences drawn from a sample; Types of sampling, Methods of drawing a random
sample, Sampling with or without replacement, Types of sampling - Probability Sampling
- Simple random sampling, Cluster sampling, Systematic sampling, Stratified random
sampling and Unequal probability Sampling; Non-probability Sampling - Reliance of
available subjects, Purposive or judgmental sampling, accidental sampling, expert
sampling, Snowball sampling, and Quota sampling; Sample size requirements for
quantitative and qualitative studies. Methods for estimating sample size; Generalisation
– Importance, Types of generalisations
4
Unit 6: Collecting Data
The process of collecting data – Selection, training, supervision, and evaluation of field
investigators; Online data collection; Errors and biases during data collection. Testing
goodness of measures through item analysis - Reliability and validity; Types of validity –
Content validity: Face and content validity, Criterion-related validity: concurrent and
predictive validity, Construct validity: convergent, and discriminant validity, factorial
validity, and nomological validity; Types of reliability – Test-Retest, Parallel forms,
Inter- item consistency reliability, Split-half reliability. Factors affecting the validity and
reliability of research instruments, Strategies for enhancing validity and reliability of
measures. Validity and reliability in qualitative research
Data coding, exploration and editing; Methods of data processing in quantitative and
qualitative studies; Quantitative data analysis - parametric and non-parametric statistical
analyses; Parametric analysis – Descriptive and inferential statistics, Hypothesis testing
- Type I and Type II errors. Concepts in hypothesis testing - Effect Size, α, β, and Power,
P Value; Multivariate data analysis – regression, factor analysis, cluster analysis, logistic
regression and structural equation modelling. Guidelines for choosing appropriate
statistical analysis; Statistical packages for data analysis; Methods of interpreting data
and drawing inferences - The Ladder of Inference; Methods of communicating and
displaying analysed data.
PRACTICALS
1. Selecting a research problem and writing problem statement
2. Narrowing down research problem to purpose, research questions and objectives
3. Choosing, evaluating and reviewing research literature
4. Selection of variables through construct conceptualisation and defining variables
5. Choosing research design based on research problem
6. Choosing right sampling method and estimating sample size
7. Developing research methods and tools – questionnaires, interview schedule,
check lists and focus group guides
8. Writing a research proposal
9. Field data collection using research methods and tools
10. Testing reliability and validity of research instruments
11. Hands on experience in using SPSS for coding, data exploration, editing,
analysis and interpretation Formulation of secondary tables based on objectives
of research.
12. Writing report, writing of thesis and research articles and Presentation of reports
5
TEACHING METHODS/ACTIVITIES
- Lecture cum discussion
- Class exercises
- Assignment(Reading/Writing)
- Student’s Book/Publication Review
- Student presentation
- Group Work
- Research Report
RESOURCES
Babbie E. 2008. The basics of social research. 4th ed. Belmont, CA, USA; Thompson
Wordsworth.
Creswell JW. 2009. Research design: Qualitative, quantitative, and mixed methods
approaches. Third edition. Thousand Oaks: Sage Publications.
Creswell JW. 2012. Educational research: Planning, conducting, and evaluating
quantitative and qualitative research. Fourth edition. Boston, MA: Pearson.
Kerlinger FN and Lee HB. 2000. Foundations of Behavioral Research. Orlando, FL: Harcourt
College Publishers.
Kumar R. 2014. Research Methodology: A Step-‐by-‐Step Guide for Beginners.
Fourth.Edition. Thousand Oaks, California: Sage Publications.
Malhotra NK. 2010. Marketing research: An applied orientation. Sixth Edition. UpperSaddle
River, NJ: Prentice Hall.
NeumanWL. 2006. Social Research Methods: Qualitative and Quantitative Approaches.
Toronto: Pearson.
Sekaran U and Bougie R. 2013.Research Methods for Business A Skill-Building
Approach. 6th Edition, Wiley, New York.
Sendhil R, Kumar A, Singh S, Verma A, Venkatesh K and Gupta V. 2017. Data Analysis Tools
and Approaches (DATA) in Agricultural Sciences.e-Compendium of Training-cum-
Workshop organised at the ICAR-IIWBR during March 22-24, 2017. pp 1-126.
Sivakumar PS, Sontakki BS, Sulaiman RV, Saravanan R and Mittal N. (eds). 2017. Good
Practices in Agricultural extension Research. Manual on Good Practices in
Extension Research and Evaluation. Agricultural Extension in South Asia. Centre for
research on innovation and science and policy (CRISP), Hyderabad. India.
Sivakumar PS and Sulaiman RV. 2015. Extension Research in India-Current Status and Future
Strategies. AESA Working Paper 2.Agricultural Extension in
South Asia.http://www.aesanetwork.org/aesa-working-paper-2-on-extension-
research-in-india- current-status-and-future-strategies-p-sethurman-sivakumar-and-
rasheed-sulaiman-v- december-2015/
6
BLOCK 1: INTRODUCTION TO BEHAVIOURAL RESEARCH
Unit 1: Nature of Behavioural Research
Methods of knowing; Science and scientific method; Behavioural research – Concept,
aim, goals and objectives; Characteristics and Paradigms of research;
Science: A body of knowledge – Verified knowledge. Method / study / approach leads to
systematic knowledge about how things operate
- As a method it uses observation and
re observation to yield principles & theories
- Future predictions based on observation of past facts
Methods of knowing
• Method of tenacity – Hold firmly on truth, frequent repetition of such truths seems to
enhance its validity
• Method of authority – Holds on established beliefs – If bible says its true – An idea
has with tradition / public sanction
• Method of priori ( Intuition) – Agree with reason – Accept by intuition
• Method of science – Common for all – verifiable - self correlation
Behavioural Research is a part of the research, which studies human behaviour as a part of the
society. It is to find explanation to understand the unexplained social phenomena to clarify
doubts and correct the misconceived facts of social life. Behavioral research is a way to
examine and understand individual and social behavior through measurement and
interpretation.
Behavioral and social sciences research helps predict, prevent, and manage illness — in
individuals and in whole populations. This research also helps people change their behaviors,
understand treatments, and learn how to stick with them. Society’s role is significant, too:
access to health care affects decision making and behavior.
Behavioral research bridges both quantitative and qualitative research to quantify human
behavior, collect new data, and systematically compare treatment and control conditions on
human behavior and choice. Behavioral experiments in labs (or "lab-in-the-field") present a
task in which one must participate and place money on one’s beliefs and preferences. Placing
money one one's beliefs simulates economic realities outside of the lab. What is unique to
behavioral research is a view that behavior is what it is, with some behaviors easier to “capture”
than are others. Datasets that have been created by companies to make sense of their operations
can be expanded with new variables that were not before considered to be of value (thoughts,
feelings, perceptions), including information on motivation and engagement over time, as HR
departments have been increasingly deploying in “People Analytics.”
7
Characteristics and Paradigms of research
The Structure of Scientific Revolution he defined research paradigm as “an integrated cluster
of substantive concepts, variables and problems attached with corresponding methodological
approaches and tools”
Ontology and research paradigms
The ontology is the reality of knowledge that exist and that the research wants to seek. For each
research paradigm there is an ontological view that the researcher seeks through research.
Monism, pluralism, idealism, dualism, materialism are some of the ontological views that one
can follow. The ontology cannot be reached without knowing the epistemology of research. In
pure sciences for example, the scientist will use a real reality as an ontological view and to
know that real reality the scientist will use objectivity as an epistemological stance, quantitative
methods as the methodology and hence the scientist is using positivism as the paradigm to find
answers to the research questions.
Reality of real reality is totally an objective way to find answers to the research questions.
While interpretivism, constructivism, and pragmatism paradigms have relativism as
ontological approach.
Epistemology and research paradigms
Epistemology is the philosophical view to seek the reality. It paves the way to find the truth
that is ontology. Epistemology and ontology are weaved together and none is possible without
each other. Realism, rationalism, relativism, and irrationalism are some of the epistemology
that are out there. Epistemology and ontology are like nail and hammer none can work without
each other. If you want to know the reality you should use an epistemology to get the answer.
In each research paradigm there are some epistemology the researcher can choose one that suits
the research question.
Methodology and research paradigms
The methodology can be quantitative or qualitative and within each of these methodology there
are several research techniques. In pure sciences quantitative research methodology is
commonly used. In social sciences qualitative research methodology is more common in use.
As a combination of both quantitative and qualitative research methodologies there is mixed-
method methodology that is more adaptable and in use in both pure sciences and social
sciences.
For a positivist, quantitative research methodology is more suitable and for a interpretivist
qualitative and mixed-method approaches are more common to be used. In interpretivism and
pragmatism statistical inquiry or analysis is not always required.
One very important point o be considered here is that once you decide about either one of the
ontology, epistemology, or methodology of the research you are bound to choose the other two
from some restricted choices. The reason being that you cannot apply subjective epistemology
to positivism or qualitative methodology to objective inquiry. This also reveals how all three
are connected to each other and combined they form a research paradigm. 8
Although ontology, epistemology, and methodology have a relationship with the research
paradigm but as a student you should know the difference between all of them. You cannot call
quantitative approach a paradigm, it is a methodology or approach to research. A research
paradigm is a worldview about conducting research. Research paradigm however provides the
students an idea to choose methods and research design. The research paradigm is the one that
addresses what should be the method to follow for the research and not the other way around.
Types of behavioural research based on applications, objectives and inquiry;
1. Fundamental research – deals with fundamental principles of sociology, conducted
for verification of old theories or establishment of new one. Discovering universal laws,
technologies Eg.Discovery of nitrogen
2. Applied research – deals with the possibilities of application of the results of the
fundamental research to social problems. Eg. Development of the processes of
manufacturing N fertilisers
3. Adaptive Research – on farm research – Determination of dose,time, methods of
application for different crops in different farming situations
4. Action Research – to find out whether or not certain activities actually lead to the
results that were anticipated
10
Unit 2: The Behavioural Research Process
Basic steps in behavioural research – Formulating a Research Problem;
Steps Involved in Conducting a Behavioral Research Study
1. Formulate a research question
1. Conduct reconnaissance observations
2. Construct an ethogram
3. Choose a sampling method
4. Collect data
5. Analyze data -run statistical analysis
6. Interpret and communicate results
7. Formulate new research question based on results
A research problem, in general, refers to some difficulty which a researcher experiences in the
context of either a theoretical or practical situation and wants to obtain a solution for the same.
An adequate statement of the research problem is one of the most important parts of the
research. Different researchers are likely to generate a variety of researchable problems from
the same situation since there are many research issues that can arise out of a general problem
situation. Your research will be able to pursue only one in depth.
Formulating the research problem allows you to make clear, both to yourself and the reader,
what the purpose of your research is. Subsequent elaboration of method should be oriented to
providing information to address that problem. The problem statement is therefore a very
important device for keeping you on track with your research. It is also one means by which
your research will be evaluated - does the research address the problem as stated
Reviewing the Literature; Identifying the variables and hypotheses; Formulating
research designs, methods and tools; Selecting sample; Collecting data; Analyzing and
Interpreting the Data; Reporting and Evaluating Research;
A literature review is a summary of the published work in a field of study. This can be a section
of a larger paper or article, or can be the focus of an entire paper.
A variable is a measurable representation of an abstract construct.
Hypothesis is the pre-assumptive statement of a proposition or a reasonable guess based upon
the available evidences, which the researcher seeks to prove through his study.
Research design
It is a plan that specifies the sources and types of information relevant to the research
problem. It is a strategy specifying which approach will be used for gathering and analysing
the data. It also includes the time and cost budgets since most studies are done under these two
constraints.
A research design appropriate for a particular research problem, usually involves the
consideration of the following factors:
11
(i) The means of obtaining information;
(ii) The availability and skills of the researcher and his staff, if any;
(iii) The objective of the problem to be studied;
(iv) The nature of the problem to be studied; and
(v) The availability of time and money for the research work.
Data collection
Primary data: Are those which are collected Secondary data: Are those which have been
a fresh and for the first time and thus collected by someone else and which
happen to be original in character have already been passed through the
statistical process
Observation method: 1. Structured and Publications of Central, state , local
Unstructured, 2. Participated and Non- government.
participant observation 3. Controlled and • Books, Magazines, Newspaper
Uncontrolled. • Reports & publications of industry ,bank,
stock exchange
Interviews • Technical and trade
journals
Questionnaire • Reports by research scholars, Universities,
economist
• Public Records
Research report is considered a major component of the research study for the research task
remains incomplete till the report has been presented and/or written. As a matter of fact even
the most brilliant hypothesis, highly well designed and conducted research study, and the most
striking generalizations and findings are of little value unless they are effectively
communicated to others.
The purpose of research is not well served unless the findings are made known to others.
Research results must invariably enter the general store of knowledge. All this explains the
significance of writing research report. There are people who do not consider writing of report
as an integral part of the research process. But the general opinion is in favour of treating the
presentation of research results or the writing of report as part and parcel of the research project.
Writing of report is the last step in a research study and requires a set of skills somewhat
different from those called for in respect of the earlier stages of research. This task should be
accomplished by the researcher with utmost care; he may seek the assistance and guidance of
experts for the purpose
Methods of behavioural research
• Qualitative method
• Qualitative
• Experimental-Manipulating variables
• Field study
• Evolutionary History of every problem
• Comparative
12
• Case study
• Interview
• Survey research
• Questionnaire methods
• Sample method
• Interdisciplinary method
• Public opinion poll
• Historical research
• Descriptive research *variables are not manipulable, already occured
13
Skills needed to design and conduct research; Writing research proposals
Skills needed to design and conduct research
Creativity: The first step in research is developing a topic or a plan for exploring a problem,
and creativity is fundamental to this effort. As members of our university’s Student
Undergraduate Research Council, we constantly come across prospective undergraduate
researchers who don’t know where to begin. Students in all disciplines are unsure, even lost,
as to how they should start deciding upon a research topic. Creativity is an essential trait that
undergraduate researchers should seek to develop and utilize within their research experience.
Judgement: Undergraduate researchers also should consider and study the importance of good
judgment as it applies to ethical dilemmas in research. Failure to exercise good ethical
judgments can seriously jeopardize the careers and integrity of not only the student researchers,
but also of their mentors, colleagues, and possibly even their college or university.
Communication: The set of skills necessary to develop and maintain an effective relationship
between an undergraduate researcher and his or her faculty mentor.
Organization: Well-honed organizational skills facilitate effective research and good science,
as well as allowing students to balance classes, studying, research, socializing, hobbies, and
maintaining a healthy lifestyle much easier. Keeping an organized journal or lab notebook of
all work is critical for analyzing data, generating new ideas or proposals, or determining the
next step in a project.
Persistence: It is the drive to never give up. But it is important to realize that persistence
involves facing failure. Failure could involve coming up with a bad research design, not
anticipating future roadblocks, or not knowing every detail of a proposed research project
Writing Research Proposal
The proposal will be 10-12 pages single-spaced, excluding references and appendices. You can
select any research problem of your choice for this proposal, but preferably in the positivist
tradition of inquiry. However, the proposed research must be original (i.e., not something you
are doing for another class or another professor), must examine a real problem (i.e., not a
hypothetical or “toy” problem), and must be of at least a conference-level quality. Your
proposal must include five sections: (1) research problem and significance, (2) literature
review, (3) theory and hypotheses, (4) research methods, and (5) research plan. Data collection
or analysis is not necessary. But if you want to do an interpretive research project instead, then
some data collection and analysis will be needed (and the above structure will also change –
talk to me about these changes). Project deliverables are due throughout the course of the
semester, as we cover corresponding topics in class. This will allow me to give you early
feedback and correct problems well before the final due date. Note that intermediate
deliverables are not graded, only your final proposal will be graded. You will also present your
final proposal during the last week of class in a 15-20 minute formal presentation (plus a 5
minute question/answer session), as you would typically do at an academic conference.
14
BLOCK 2: STEPS IN BEHAVIOURAL RESEARCH PROCESS
Unit 1: Formulating a Research Problem
The research problem and research topic - definitions; Importance of formulating a
research problem; Sources of research problems; Characteristics of a good research
problem; Research problems in quantitative and qualitative research; Steps in
formulating a research problem; Strategies for writing research problem statement;
Educational research starts with the selection of a problem. Following are the fields in which
one may look for problems for research:
a. The classroom, school, home, community and other agencies are the obvious sources.
b. Social developments and technological changes are constantly bringing forth new
opportunities for research.
c. Records of previous research should also be consulted. This includes encyclopaedia of
educational research, dissertations and similar publications.
d. Classroom discussions, seminars and exchange of ideas with the faculty members and
fellow
scholars and students will suggest many stimulating problems to be solved.
e. Consultation with an expert, researcher supervisor, researcher guide or a senior scholar
will
also be helpful.
16
Objectives - Meaning, types and criteria for judging the objectives
Objectives are expression of ends towards which our efforts are directed. An objective is that
which a person/group sets before itself as a condition to be attained.
Levels of objectives
• Fundamental objectives – raising the std of living of people
• General objectives – More defenate – ways and means of achieving higher std of living
• Working objectives – specific subject matter approach – Audience –whom you want to
change? Type of change K/S/A? Content or message you want to inculcate
Criteria for judging the objectives:
➢ Can they be defined in terms of behavioural change in people?
➢ Are they achievable?
➢ Are they specific?
➢ Are they consistent and worded clearly?
➢ Are they limited in number?
➢ Can they be measured or evaluated?
➢ Can they be achieved in limiited time?
➢ Can they be achieved in limited cost?
17
Unit 2: Reviewing the Literature
Review-meaning and importance; Types of literature review – Context, Historical,
Integrative, methodological, self-study and theoretical; Literature review for quantitative
and qualitative studies; Steps in conducting literature review – Identify key terms, locate
literature, critical evaluation and selection; organising literature and writing literature
review
A literature review is a summary of the published work in a field of study. This can be a section
of a larger paper or article, or can be the focus of an entire paper. Literature reviews show that
you have examined the breadth of knowledge and can justify your thesis or research questions.
They are also valuable tools for other researchers who need to find a summary of that field of
knowledge
The purpose of a literature review is three-fold:
(1) to survey the current state of knowledge in the area of inquiry,
(2) to identify key authors, articles, theories, and findings in that area, and
(3) to identify gaps in knowledge in that research area.
Literature reviews should be reasonably complete, and not restricted to a few journals, a few
years, or a specific methodology. Reviewed articles may be
summarized in the form of tables, and can be further structured using organizing frameworks
such as a concept matrix.
A well-conducted literature review should indicate
• whether the initial research questions have already been addressed in the literature
(which would obviate the need to study them again),
• whether there are newer or more interesting research questions available, and
• whether the original research questions should be modified or changed in light of
findings of the literature review.
The review can also provide some intuitions or potential answers to the questions of interest
and/or help identify theories that have previously been used to address similar questions.
The researcher must at the same time examine all available literature to get himself acquainted
with the selected problem.
He may review two types of literature—
• the conceptual literature concerning the concepts and theories, and
• the empirical literature consisting of studies made earlier which are
similar to the one proposed.
The basic outcome of this review will be the knowledge as to what data and other materials are
available for operational purposes which will enable the researcher to specify his own research
problem in a meaningful context. 18
After this the researcher rephrases the problem into analytical or operational terms i.e., to put
the problem in as specific terms as possible.
For this purpose, the abstracting and indexing journals and published or unpublished
bibliographies are the first place to go to. Academic journals, conference proceedings,
government reports, books etc., must be tapped depending on the nature of the problem.
In this process, it should be remembered that one source will lead to another. The earlier
studies, if any, which are similar to the study in hand should be carefully studied. A good library
will be a great help to the researcher at this stage.
Types of literature reviews
Argumentative Review
This form examines literature selectively in order to support or refute an argument, deeply
imbedded assumption, or philosophical problem already established in the literature. The
purpose is to develop a body of literature that establishes a contrarian viewpoint. Given the
value-laden nature of some social science research [e.g., educational reform; immigration
control], argumentative approaches to analyzing the literature can be a legitimate and important
form of discourse. However, note that they can also introduce problems of bias when they are
used to to make summary claims of the sort found in systematic reviews.
Integrative Review Considered a form of research that reviews, critiques, and synthesizes
representative literature on a topic in an integrated way such that new frameworks and
perspectives on the topic are generated. The body of literature includes all studies that address
related or identical hypotheses. A well-done integrative review meets the same standards as
primary research in regard to clarity, rigor, and replication.
Historical Review Few things rest in isolation from historical precedent. Historical reviews
are focused on examining research throughout a period of time, often starting with the first
time an issue, concept, theory, phenomena emerged in the literature, then tracing its evolution
within the scholarship of a discipline. The purpose is to place research in a historical context
to show familiarity with state-of-the-art developments and to identify the likely directions for
future research.
Methodological Review A review does not always focus on what someone said [content],
but how they said it [method of analysis]. This approach provides a framework of
understanding at different levels (i.e. those of theory, substantive fields, research approaches
and data collection and analysis techniques), enables researchers to draw on a wide variety of
knowledge ranging from the conceptual level to practical documents for use in fieldwork in the
areas of ontological and epistemological consideration, quantitative and qualitative integration,
sampling, interviewing, data collection and data analysis, and helps highlight many ethical
issues which we should be aware of and consider as we go through our study.
Systematic Review This form consists of an overview of existing evidence pertinent to a
clearly formulated research question, which uses pre-specified and standardized methods to
identify and critically appraise relevant research, and to collect, report, and analyse data from
the studies that are included in the review. Typically it focuses on a very specific empirical
question, often posed in a cause-and-effect form, such as "To what extent does A contribute to
B?" 19
Theoretical Review The purpose of this form is to concretely examine the corpus of theory
that has accumulated in regard to an issue, concept, theory, phenomena. The theoretical
literature review help establish what theories already exist, the relationships between them, to
what degree the existing theories have been investigated, and to develop new hypotheses to be
tested. Often this form is used to help establish a lack of appropriate theories or reveal that
current theories are inadequate for explaining new or emerging research problems. The unit of
analysis can focus on a theoretical concept or a whole theory or framework.
Steps in conducting literature review –
1. Identify key terms,
2. Locate literature,
3. critical evaluation and selection
4. organising literature and
5. writing literature review
20
Unit 3: Identifying Variables and Hypotheses
Developing theoretical, conceptual, empirical frameworks; Approaches for identifying
concepts, constructs and variables;
Although research can be exploratory, descriptive, or explanatory, most scientific research tend
to be of the explanatory type in that they search for potential explanations of observed natural
or social phenomena. Explanations require development of concepts or generalizable
properties or characteristics associated with objects, events, or people. While objects such as a
person, a firm, or a car are not concepts, their specific characteristics or behavior such as a
person’s attitude toward immigrants, a firm’s capacity for innovation, and a car’s weight can
be viewed as concepts.
Knowingly or unknowingly, we use different kinds of concepts in our everyday
conversations. Some of these concepts have been developed over time through our shared
language. Sometimes, we borrow concepts from other disciplines or languages to explain a
phenomenon of interest. For instance, the idea of gravitation borrowed from physics can be
used in business to describe why people tend to “gravitate” to their preferred shopping
destinations. Likewise, the concept of distance can be used to explain the degree of social
separation between two otherwise collocated individuals. Sometimes, we create our own
concepts to describe a unique characteristic not described in prior research. For instance,
technostress is a new concept referring to the mental stress one may face when asked to learn
a new technology.
Concepts may also have progressive levels of abstraction. Some concepts such as a
person’s weight are precise and objective, while other concepts such as a person’s personality
may be more abstract and difficult to visualize. A construct is an abstract concept that is
21
specifically chosen (or “created”) to explain a given phenomenon. A construct may be a simple
concept, such as a person’s weight, or a combination of a set of related concepts such as a
person’s communication skill, which may consist of several underlying concepts such as the
person’s vocabulary, syntax, and spelling. The former instance (weight) is a unidimensional
construct, while the latter (communication skill) is a multi-dimensional construct (i.e., it
consists of multiple underlying concepts). The distinction between constructs and concepts are
clearer in multi-dimensional constructs, where the higher order abstraction is called a construct
and the lower order abstractions are called concepts. However, this distinction tends to blur in
the case of unidimensional constructs.
Constructs used for scientific research must have precise and clear definitions that
others can use to understand exactly what it means and what it does not mean. For instance, a
seemingly simple construct such as income may refer to monthly or annual income, before-tax
or after-tax income, and personal or family income, and is therefore neither precise nor clear.
There are two types of definitions: dictionary definitions and operational definitions. In the
more familiar dictionary definition, a construct is often defined in terms of a synonym. For
instance, attitude may be defined as a disposition, a feeling, or an affect, and affect in turn is
defined as an attitude. Such definitions of a circular nature are not particularly useful in
scientific research for elaborating the meaning and content of that construct. Scientific research
requires operational definitions that define constructs in terms of how they will be
empirically measured. For instance, the operational definition of a construct such as
temperature must specify whether we plan to measure temperature in Celsius, Fahrenheit, or
Kelvin scale. A construct such as income should be defined in terms of whether we are
interested in monthly or annual income, before-tax or after-tax income, and personal or family
income. One can imagine that constructs such as learning, personality, and intelligence can be
quite hard to define operationally.
Role of theory in behavioural research
Theories are explanations of a natural or social behavior, event, or phenomenon. More
formally, a scientific theory is a system of constructs (concepts) and propositions (relationships
between those constructs) that collectively presents a logical, systematic, and coherent
explanation of a phenomenon of interest within some assumptions and boundary conditions
(Bacharach 1989).
Theories should explain why things happen, rather than just describe or predict. Note that it is
possible to predict events or behaviors using a set of predictors, without necessarily explaining
why such events are taking place. For instance, market analysts predict fluctuations in the stock
market based on market announcements, earnings reports of major companies, and new data
from the Federal Reserve and other agencies, based on previously observed correlations .
Prediction requires only correlations. In contrast, explanations require causations , or
understanding of cause-effect relationships. Establishing causation requires three conditions:
(1) correlations between two constructs, (2) temporal precedence (the cause must precede the
effect in time), and (3) rejection of alternative hypotheses (through testing). Scientific theories
are different from theological, philosophical, or other explanations in that scientific theories
can be empirically tested using scientific methods.
Explanations can be idiographic or nomothetic. Idiographic explanations are those that explain
a single situation or event in idiosyncratic detail. For example, you did poorly on an exam
22
because: (1) you forgot that you had an exam on that day, (2) you arrived late to the exam due
to a traffic jam, (3) you panicked midway through the exam, (4) you had to work late the
previous evening and could not study for the exam, or even (5) your dog ate your text book.
The explanations may be detailed, accurate, and valid, but they may not apply to other similar
situations, even involving the same person, and are hence not generalizable. In contrast,
nomothetic explanations seek to explain a class of situations or events rather than a specific
situation or event. For example, students who do poorly in exams do so because they did not
spend adequate time preparing for exams or that they suffer from nervousness, attention-deficit,
or some other medical disorder. Because nomothetic explanations are designed to be
generalizable across situations, events, or people, they tend to be less precise, less complete,
and less detailed. However, they explain economically, using only a few explanatory variables.
Because theories are also intended to serve as generalized explanations for patterns of events,
behaviors, or phenomena, theoretical explanations are generally nomothetic in nature.
While understanding theories, it is also important to understand what theory is not. Theory is
not data, facts, typologies, taxonomies, or empirical findings. A collection of facts is not a
theory, just as a pile of stones is not a house. Likewise, a collection of constructs (e.g., a
typology of constructs) is not a theory, because theories must go well beyond constructs to
include propositions, explanations, and boundary conditions. Data, facts, and findings operate
at the empirical or observational level, while theories operate at a conceptual level and are
based on logic rather than observations.
There are many benefits to using theories in research. First, theories provide the underlying
logic of the occurrence of natural or social phenomenon by explaining what are the key drivers
and key outcomes of the target phenomenon and why, and what underlying processes are
responsible driving that phenomenon. Second, they aid in sense-making by helping us
synthesize prior empirical findings within a theoretical framework and reconcile contradictory
findings by discovering contingent factors influencing the relationship between two constructs
in different studies. Third, theories provide guidance for future research by helping identify
constructs and relationships that are worthy of further research. Fourth, theories can contribute
to cumulative knowledge building by bridging gaps between other theories and by causing
existing theories to be re-evaluated in a new light.
However, theories can also have their own share of limitations. As simplified explanations of
reality, theories may not always provide adequate explanations of the phenomenon of interest
based on a limited set of constructs and relationships. Theories are designed to be simple and
parsimonious explanations, while reality may be significantly more complex. Furthermore,
theories may impose blinders or limit researchers’ “range of vision,” causing them to miss out
on important concepts that are not defined by the theory.
23
Steps in identifying variables – Domain, Concepts, Constructs, Dimensions; Indicators;
A theory is a simplified representation of a limited part of the reality
Units of theory
(i) Domain – Specific area of the reality
(ii) Concepts – Abstraction of observed aspects
(iii) Variables – Empirical form of concept
(iv) Definitions – Theoretical and operational
(v) Premises – Assumptions
(vi) Propositions and hypotheses- conjectural relationships
Definitions, premises, propositions and hypotheses; Techniques of identifying concepts,
constructs and variables - Types of concepts; Types of variables –causal relationship, the
study design; and the unit of measurement; Types of definitions-Types of propositions
and hypotheses. Characteristics of good hypotheses;
Variable and its types
A variable is a measurable representation of an abstract construct.
Depending on their intended use, variables may be classified as independent,
dependent, moderating, mediating, or control variables. Variables that explain other variables
are called independent variables, those that are explained by other variables are dependent
variables, those that are explained by independent variables while also explaining dependent
variables are mediating variables (or intermediate variables), and those that influence the
relationship between independent and dependent variables are called moderating variables.
As an example, if we state that higher intelligence causes improved learning among students,
then intelligence is an independent variable and learning is a dependent variable. There may be
other extraneous variables that are not pertinent to explaining a given dependent variable, but
may have some impact on the dependent variable. These variables must be controlled for in a
scientific study, and are therefore called control variables.
Concepts
•An empirically observable manifestation of a concept
•Symbol or label which can take different values for different objects depending on the extent
to which the property specified by a concept is present in different objects
• An abstract concept refers to two or more events (e.g., temperature, human capital
investment). A concrete concept refers to a specific event (e.g., temperature of the sun,
years of formal education).
• Concepts can be measured either quantitatively or qualitatively. There is no
epistemological reason to suspect that either type of measurement is more or less
24
scientific, objective, or valid.
• Concepts can be measured at the nominal level, indicating no inherent ranking (e.g.,
male, female; Christian, Hindu, Muslim, Jewish), the ordinal level, indicating ranking
without a continuous ordering (e.g., large, medium, small), the interval level, indicating
ranking with a continuous ordering, with no known zero-state (e.g, attitudes about
same-sex marriage expressed on a 1-7 response scale), or the ratio level, indicating
continuous ordered ranking with a known zero point (e.g., age in years).
Premise
A premise is a statement in an argument that provides reason or support for the conclusion.
There can be one or many premises in a single argument. A conclusion is a statement in an
argument that indicates of what the arguer is trying to convince the reader/listener.
Definition and Types
Construct can be measured, it must be defined. Researchers develop two kinds of definitions:
• Theoretical Definitions
• Operational Definitions
Theoretical Definitions: Theoretical definitions are basic dictionary definitions. They are
frequently called constitutive or conceptual definitions. A theoretical definition gives meaning
to the concept or construct under investigation. It should distinguish it from all other concepts
or constructs. A theoretical definition assumes both knowledge and acceptance of the theories
it depends upon. For example, a theoretical definition for the concept "customer satisfaction"
is often defined as the degree to which a customer's experience with a product or service
conforms to his or her expectations and the ideal experience.
Operational Definitions: Operational definitions define an object, event, variable, concept, or
construct in terms of the specific processes, tests, and measurements used to determine its
presence or quantity. Operational definitions transform theoretical definitions into observable
events. This is because an operational definition states which characteristics will be measured
in the assignment of a value to the concept or construct under study. Operational definitions
form the basis for the research questions, hypotheses, and the theories associated with the
research. If a researcher is concerned about levels of brand satisfaction, the researcher could
ask customers to rate their experiences with this brand and competitive brands on a five-point
scale: Very Satisfied, Satisfied, Neutral, Dissatisfied, and Very Dissatisfied
Proposition and Types
A proposition is a tentative and conjectural relationship between constructs that is stated in a
declarative form.
An example of a proposition is: “An increase in student intelligence causes an increase in their
academic achievement.” This declarative statement does not have to be true, but must be
empirically testable using data, so that we can judge whether it is true or false. Propositions are
generally derived based on logic (deduction) or empirical observations (induction).
25
Formulation of hypothesis.
Educational research should make the use of carefully formulated hypothesis. This may be
formally stated or implied.
Hypothesis. Hypothesis is the pre-assumptive statement of a proposition or a reasonable guess
based upon the available evidences, which the researcher seeks to prove through his study.
Importance of hypothesis.
1. It provides direction to the researcher. It defines what is relevant and what is irrelevant.
2. It sensitizes the investigator to certain aspects of the situation which are relevant from
the stand point of the problem at hand.
3. It is a guide to the thinking process of discovery. It is the investigator’s eye – a sort of
guiding light in the world of darkness.
4. It focuses research. Without it research would be like a random and aimless wandering.
5. It prevents blind research. It also prevents indiscriminate gathering of data which may 26
turn out to be irrelevant.
6. It places clear and specific goals before us. These clear and specific goals provide the
investigator basis for selecting samples and research procedures.
7. It serves the function of linking together related facts and information and organizing
them into one comprehensible whole.
8. It enables the investigator to understand with greater clarity his problem as well as the
data which bear on it.
9. It serves as a framework for drawing conclusions.
28
Measurement – Meaning, levels of measurement – nominal, ordinal, interval and ratio;
Criteria for choosing measurement levels for variables
Measurement means the assignments of numbers to objects or persons to represent
quantities of their attributes. The assignment of numbers is done according to some
rule. The attribute of person could include his income, preference, religion, social
class, attitude etc. Similarly we measure a product's speed, colour, size, flavour etc. It
is the characteristic of the buyer or the product which is measured and not, the person
or product itself. There are four types of scales used in marketing research to measure
attitude towards a particular product/service. These are as follows:
1. Nominal Scale
2. Ordinal Scale
3. Interval Scale
4. Ratio Scale
1 Nominal Scale: In this type of measurement numbers are used to label persons,
objects or events. For example, the variable sex may be categorized as male or
female. One may assign a number 1 to male and 0 to female. It only helps us to
identify that whenever number 1 is used we are talking about males and 0 in
case of females. Similarly if the units in the population is to be classified
according to religion viz. Hindu, Muslin, Sikh and Christian; one may label
Hindu as 101, Muslim as 102, Sikh as 103 and Christian as 104. The numbers,
here, have no meaning in the sense that the category which is assigned a higher
number is in no way more important (or bigger) than the category which is
assigned a lower number.
The classification to identify objects, events and person is also done on the basis
of the letters of English alphabets. Using the example mentioned in the
preceding paragraph one could have labeled males as A and females as B.
Similar procedure may be used for another type of classification. However, the
classification should be done in such a way that groups are mutually exclusive
and collectively exhaustive.
The only mathematical operation performed on nominally measured data is the
count in each category. Numbers assigned to represent categories (e.g. 1 for
male and 0 for female) cannot be added, subtracted, multiplied or divided. We
can only say (if sample comprises of 100 respondents) that there are 70 males
and 30 females. Also we can say that the sample comprises of say 40% Hindus,
20% Sikhs, 30% Muslims and 10% Christians. The statistical procedures
applicable for nominal scale measurement are Mode and Chi-Square.
2. Ordinal Scale: A significant amount of consumer oriented research relies on
ordinal measurement. Here numbers, letters or any other symbols are used to
rank items. Ordinal scale tells us whether an object or event has more or less of
a characteristic than some other object or event. Unfortunately this scale doesnot
indicate how much more and how much less we have of the characteristics 29 the
objects or events pocess. For example, we may be examining the marks in
Marketing for 60 students in a class. Assume that the highest score in the class is
92, the second highest 63 and the third highest 60. We rank the person getting
92 marks as 1, 63 marks as 2 and 60 marks as 3. However the difference
between the marks of first and second rank is not the same as the difference in
the marks of students obtaining second and third rank.
The common mathematical operations like addition, subtraction, multiplication
and division cannot be used with ranked data. However, statistical procedure
based on interpretation of "greater than" or "less than" are permissible: The
statistical methods applicable with ordinal data are percentiles, median and rank
order correlation.
The ordinal scale measurement is of higher level than the nominal scale
measurement. i.e. to say the ordinal scale data can also be converted into
nominal scale data and thus will pocess all the properties of nominal scale data.
As an example assume that 107 consumers are divided according to their income
and the classification is as given below:
Monthly Income
No. of Consumers (Rs.)
(Rs.)
Less than 5000 20
5001 - 8000 30
8001 - 11000 25
11001 - 13000 20
13001 and above 12
TOTAL 107
A consumer having an income of Rs. 7500 will be ranked higher than the one
having income of less than Rs. 5000 (Ordinal scale data). However, the sample of
107 consumers can be classified into 5 income categories to be labeled as A for
less than Rs.5000, B for 5001-8000, C for 8001-11,000, D for 11001-13,000 and
B for 13001 and above (nominal scale data). A consumer having a monthly
income of Rs.12, 000 will belong to category D.
3. Interval Scale: Interval scale responses are more powerful than ordinal scale responses.
They not only pocess the properties of ordinal and nominal scale measurement but also the
strength of the equality of differences between ranks. For example, the consumers may be
asked the following question. How important is price to you while buying furniture? One may
note that very important is assigned a number (1), important as (2) and so on and lastly very
unimportant is assigned a number (5). What is assumed here is that the respondent is able to
30
reply on a continuum scale and the difference between any two responses can be meaningfully
interpreted,
The general mathematical form of interval scale is given by the equation.
Y = a+ bX
The statistical procedure applicable in this case are range, mean, standard deviation and product
moment correlation. However, all the statistical procedures applicable for ordinal
and nominal scale measurements can also be used in this case.
4 Ratio Scale: Ratio scale measurements are the most powerful measurement
discussed so far as they pocess all the properties of the measurement scales
which we have discussed .Ratios of the numbers on these scales have meaningful
interpretation. They possess an unambiguous starting point. The mathematical
form of the measurement is written as
Y=bX
The examples of ratio scale measurement are Income, Distance travelled from
home to workplace, Height, Weight, Density etc. The statistical methods
applicable for this type of measurement are geometric mean, harmonic mean,
coefficient of variation etc. Also all the statistical procedures, described for the
remaining type of measurements are also applicable under this case.
As mentioned in the preceding paragraphs, the methods of analysis for data
depends upon the type of measurements used to measure it. The table below
gives the permissible statistics to be used under different types of measurement.
Table 1: Scales ox1f Measurement
Scale Permissible Statistics
Nominal Mode
Median
Ordinal Percentile
Rank Order Correlation
Mean
Interval Average deviation
Standard deviation
Geometric Mean
Ratio
Harmonic mean
31
Unit 4: Formulating Research Designs, Methods and Tools
It is a special type of research which is carried out by launching project, in the field for finding
out workable solution to the problems.
The important aspect of action research is that it adopts itself to the changes that takes place in
the community.
STEPS
• Analyze the problem with local people and decide on the objectives.
• Take appropriate action in situation and implement it with local participation.
• Monitoring and evaluation of the results with local people
• Identify constraints and suggest measures to improve upon the situation.
Translational research
Translational research seeks to produce more meaningful, applicable results that directly
benefit human health. The goal of translational research is to translate (move) basic science
discoveries more quickly and efficiently into practice.
Time horizon.
Cross-Sectional Studies: A study can be carried out in which data are collected only once,
perhaps during a period of days or weeks or months, to be able to answer a research question.
Longitudinal Studies: Researching people or phenomena at several point in time to be able to
answer the research question. Due to the fact that data are collected at two different points in
time, the study is not cross-sectional kind, but is carried longitudinally across a period of
time. Longitudinal studies take a longer period and energy and cost a lot more than cross-
sectional studies. Having said that, well-planned longitudinal studies can help you to recognize
cause-and-effect relationships.
Types of triangulations
Denzin (2006) identified four basic types of triangulations
The main aim of research is to find out the truth which is hidden and which has not been
discovered yet.
Questionnaires
• A questionnaire refers to a device for securing answers to questions by using a form
which the respondent fills in by himself.
• It consists of some questions printed or typed in a definite order.
• These forms are actually mailed to the respondent who was expected to read and
understand the questions and reply to them by writing the relevant answers in the spaces
provided.
• Ideally, speaking respondent must answer to a verbal stimulus and give a written or
verbal response.
• Its purpose is to collect information from the respondents who are scattered over a vast
area.
Interview schedules
• A schedule is a structure of a set of questions on a given topic which are asked by the
interviewer or investigator personally.
• The order of questions, the language of the questions and the arrangement of parts of
the schedule are not changed.
• However, the investigator can explain the questions if the respondent faces any
difficulty.
• It contains direct questions as well as questions in tabular form.
Tests
A test is a set of questions, each of which has a correct answer, to which the people respond.
Knowledge tests
Knowledge test is one of the sound tool to assess the knowledge of various stakeholders like
customers, farmers, students etc. The methodology behind development of knowledge test is
very important for social science research.
Knowledge test score used as aa variable to test its relationship with other variables.
Steps
• Item collection
• Screening out of statements after consultation with experts
• Item analysis based on
38
• Item difficulty
• Item discrimination
• Point biserial correlation co-efficient
Behaviour performance tests
Behavioral assessment is a structured study and analysis of a person’s behavior using various
methods like interviews, direct supervision, and self-observation. It refers to the process of
observing, explaining, and predicting human behavior with the help of new-age digital tools.
Behavioral tests evaluate behavioral competencies. Behavioral competencies comprise
knowledge, skills, and personality traits in an individual. Such competencies are critical
elements of a job that are evident in the workplace’s behavior and observable. Behavioral
competencies vary across job roles and levels. Each behavioral competency can be gauged
through a unique combination of behavioral tests, the outcomes of which can work wonders
when it comes to workforce planning.
Indexes
An index is a way of compiling one score from a variety of questions or statements that
represents a belief, feeling, or attitude.
Indexes are very useful in quantitative social science research because they provide a
researcher a way to create a composite measure that summarizes responses for multiple rank-
ordered related questions or statements. In doing so, this composite measure gives the
researcher data about a research participant's view on a certain belief, attitude, or experience
40
Unit 5: Selecting Sample
Principles of sampling
1. Selection of sample must be systematic and objective manner
2. Sample unit must be clearly define and easily identifiable
3. Sample units must be independent of each other
4. Same units of sample must be used through out the study
5. The selection process must be on sound criteria.
6. It should avoid error, bias
Type of sampling used: If absolute random sampling has been used a much larger sample is
required. On other hand if stratified sample has been selected, reliability can be achieved in a
much smaller size.
Types of sampling
Probability Sampling
• In this method the size of the parent population or universe from which the sample is
drawn must be known to the investigator.
• Probability sample provides for calculating the standard error of the distribution.
Simple random Sampling
It is also known as unrestricted random sample.
• It may be defined as a probability sampling method in which each element in the population
has an equal and independent chance of being selected.
• This sampling method is bias free, thus the sample has a high probability of being
representative of the population.
• One of the major disadvantage of SRS is that it does ensure that the element which exist in
small numbers in the population will be included in the given sample.
Cluster sampling
This also a sort of random sampling procedure . But in cluster sampling the sampling units are
not individual elements of the universe, but groups of the elements.
• For example, a researcher wants to study the problems of rural school-going children and
wants a sample of 10 percent children from the rural schools in
the district. The researcher may select at random 10 percent of the rural schools (clusters) in
the district and then use as sample all the children attending those schools.
Systematic sampling
42
• This is a non-random sampling method in which every nth element is chosen from a
list of numbered elements. Thus, every element does not have a chance of being drawn
once the starting point is selected.
• The starting point is often chosen randomly and sometimes changed several times
during the selection process to improve the chances of representativeness, especially in
ordered list.
• This method is easier, faster and less expensive to carry out, particularly with a large
population. But it is potentially a biased sampling method.
• It is also called Quasi-random sampling.
Non-probability Sampling
Non-probability sampling is that sampling procedure in which there is no way of assessing the
probability of the elements of population being included in the sample. In this type of sampling,
items for the sample are selected deliberately by the researcher instead of using the techniques
of random sampling.
Expert sampling
Expert sampling involves the assembling of a sample of persons with known or demonstrable
experience and expertise in some area. Often, we convene such a sample under the auspices of
a “panel of experts.” There are actually two reasons you might do expert sampling. First,
because it would be the best way to elicit the views of persons who have specific expertise. In
this case, expert sampling is essentially just a specific subcase of purposive sampling. But the
other reason you might use expert sampling is to provide evidence for the validity of another
sampling approach you’ve chosen. For instance, let’s say you do modal instance sampling and
are concerned that the criteria you used for defining the modal instance are subject to criticism.
You might convene an expert panel consisting of persons with acknowledged experience and
insight into that field or topic and ask them to examine your modal definitions and comment
on their appropriateness and validity. The advantage of doing this is that you aren’t out on your
own trying to defend your decisions – you have some acknowledged experts to back you. The
disadvantage is that even the experts can be, and often are, wrong.
Snowball sampling
This is essentially a sociometric sampling technique for study of small groups.
• The method is suitable for study of social change, diffusion of information, network analysis,
decision-making etc. among specific segments of society or social organizations. The method
is convenient for a small sample.
Quota sampling
• In this method, the elements of the sample are selected until the same proportion of
selected characteristics which exist in the population is reached.
• The main difference between quota sampling and proportionate stratified random
sampling is that in the former the final selection of individuals, is not random, whereas
in the latter the final selection of individuals is random.
• This method is convenient, less costly and can include the individuals from different
strata of population. But quota sampling being a non- random, potentially biased
sampling method, can lead to large sampling error.
45
Unit 6: Collecting Data
The process of collecting data – Selection, training, supervision, and evaluation of field
investigators;
Face validity
• Infers that a test is valid by definition
• It is clear that the test measures what it is supposed to measure
• It’s similar to content validity, but face validity is a more informal and
subjective assessment
Criterion-related validity
Concurrent validity
In this method a test is correlated with' a criterion which is available at the percent time. Scores
on newly constructed intelligence test may be correlated with scopes obtained on an already
standardized test of intelligence. The resulting coefficient of correlation shall be an indicator
of concurrent validity (Singh, 1997).
Predictive validity
Predictive validity may be defined as the degree to which measure predicts second future
measure (Sproull, 1988).In predictive validity, test is correlated against the criterion to be made
available sometimes in future. In this method, test scores are obtained and then line gap of
months or years is allowed to elapse, after which the criterion scores (a second measure) are
obtained. Subsequently, the test scores and the criterion scores are correlated and obtained
correlation becomes the index of predictive validity.
Construct validity
Constructs can be characteristics of individuals, such as intelligence, obesity, job satisfaction,
or depression; they can also be broader concepts applied to organizations or social groups, such
as gender equality, corporate social responsibility, or freedom of speech.
Discriminant validity specifically measures whether constructs that theoretically should not be
related to each other are, in fact, unrelated.
• Convergent validity shows you whether two tests that should be highly related to each
other are indeed related.
• Discriminant validity shows you whether two tests that should not be highly related
to each other are, indeed, unrelated.
47
Factorial validity
Factor validity is the degree to which the covariance of measured items matches the real
covariance or behaviors in real life. It is a type of validity which is the degree to which a test
is measuring what it is intended to.
For example, a test that asks a student questions about French movies is not a valid measure of
the student's mathematical abilities. This would be an invalid measurement. Factor validity is
related to context validity which is how well do the questionnaire items represent the construct
being researched. Factor analysis is used to test the factor validity of a measure or
questionnaire. Correlations between responses are clustered together by groupings of items in
the measurement.
Nomological validity
Nomological validity refers to the degree to which predictions in a formal theoretical network
containing a construct of interest are confirmed. In one sense, the difference between predictive
and nomological validity is one of degree and not kind. Predictive validity entails the
relationship of measures of a variable to a single antecedent or consequent. Nomological
validity, in contrast, involves many antecedents and/or consequents in a complex system.
Test-Retest reliability;
In this method, a single form of the test is administered twice on the same sample with a
reasonable time gap, say a fortnight. This yields two independent sets of scores. The correlation
between the two sets of scores gives the value of the reliability coefficient, which is also known
temporal stability coefficient.
Parallel forms
Parallel forms reliability (also called equivalent forms reliability) uses one set of questions
divided into two equivalent sets (“forms”), where both sets contain questions that measure the
same construct, knowledge or skill. The two sets of questions are given to the same sample of
people within a short period of time and an estimate of reliability is calculated from the two
sets.
Split-half reliability.
This method indicates homogeneity of the test. The most common is the split –half methods,
48
in which a test is divided in two halves.
One half (one set) contains the odd numbered items (1,3,5,7,etc) and the other half (other set)
the even - numbered items (2,4,6,8,etc). A test should however, not be divided into first-half
and second-half of the items. A single administrations of the two sets of items to a sample of
respondents, yields two Sets of score.
A positive and significant correlation between the two sets of scores indicates that the test is
reliable.
49
Unit 7: Analyzing and Interpreting the Data
Data coding, exploration, and editing, Methods of data processing in quantitative and
qualitative studies;
After collecting data, it has to be processed and analyzed according to the original plan and
purpose of the research. At various stages in the process of the survey, errors can creep in.
During processing of the data the aim should be to minimize these errors.
Editing of data: This is the first step in data processing. The idea is to eliminate any errors in
the data. It involves careful scrutiny of filled in questionnaires or schedules to ensure that the
data is accurate, consistent with other facts, uniformly entered and complete and have been
well arranged to facilitate coding and tabulation. The following are the points to take into
consideration when editing the data
Completeness: Check that all questions are answered adequately. Check all 10statements and
mark. If a single question is omitted it may lead to grave mistake which the researcher may not
understand at the time of interpretation
Accuracy: Many times the questions are not answered accurately. So the researcher has to
correct such inaccuracies.
Coding of data: Coding means classification of answers to a question into meaningful
categories which helps to observe its pattern. The whole point of coding is to summarize the
data e.g. 1 for male and 2 for female
Classification of data: after editing and coding is over, the process of classifying or grouping
or clubbing of data starts. Classification is done naturally according to similarities of replies.
Classification may be quantitative e.g age group 20-35, 36-50 or qualitative e.g. very efficient,
efficient inefficient, very inefficient
Tabulation of the data: according to L.R. Corner, tabulation is the orderly and systematic
presentation of numerical data in a form designed to elucidate the problem under consideration.
It is also the basis for statistical computations.
Computer processing: Computers can process large volumes of data with greater speed and
accuracy. Proper statistical packages need to be used for proper results
Inferential statistics
Inferential statistics can be defined as a field of statistics that uses analytical tools for drawing
conclusions about a population by examining random samples. The goal of inferential statistics
is to make generalizations about a population. In inferential statistics, a statistic is taken from
the sample data (e.g., the sample mean) that used to make inferences about the population
parameter (e.g., the population mean).
Types of inferential statistics :
1) Hypothesis testing: Z test, T test, F test, ANOVA test, Wilcoxen signed rank test, Mann-
Whiteny U test
2) Regression analysis: Linear, Nominal, Logistic and Ordinal regression 51
Parametric or standard tests. e.g. t-test, z-test, and F-test
t-test: t-test is a parametric test (see under samples and population) that can tell you how
significant the differences are between the means of two groups are, e.g. did the differences
just occur by chance or is there a real difference?
A large t-score indicates that the groups are different.
A small t-score indicates that the groups are similar.
z-test: A z test is a test that is used to check if the means of two populations are different or
not provided the data follows a normal distribution. For this purpose, the null hypothesis and
the alternative hypothesis must be set up and the value of the z test statistic must be calculated.
The decision criterion is based on the z critical value.
F- test: F test is statistics is a test that is performed on an f distribution. A two-tailed f test is
used to check whether the variances of the two given samples (or populations) are equal or not.
However, if an f test checks whether one population variance is either greater than or lesser
than the other, it becomes a one-tailed hypothesis f test.
Type I error: A type I error, also known as an error of the first kind, occurs when the null
hypothesis (H0 ) is true, but is rejected.
➢ A type I error may be compared with a so called false positive.
Type II error: Type II error, also known as an error of the second kind, occurs when the null
hypothesis is false, but erroneously fails to be rejected.
➢ Type II error means accepting the hypothesis which should have been rejected.
The starting point in statistical tests is the statement of NULL HYPOTHESIS. A null
hypothesis may state that there is no significant difference or association between variables. It
concerns a judgment as to whether apparent differences or relationships are true differences or
relationships, or whether they merely arise due to sampling error
Factor analysis
Factor analysis provides an approach that reduces a set of variables into one or more underlying
variables.
Factor analysis is a generic name given to a class of techniques whose purpose is data reduction
and summarisation. Very often market researchers are overwhelmed by the plethora of data.
Factor analysis comes to their rescue in reducing the number of variables. Factor analysis does
not entail partitioning the data matrix into criterion and predictor subsets; rather interest is
centred on relationships involving the whole set of variables.
Cluster analysis:
Cluster analysis: foundations rely on one of the most fundamental, simple and very often
unnoticed ways (or methods) of understanding and learning, which is grouping “objects” into
“similar” groups. This process includes a number of different algorithms and methods to make
clusters of a similar kind. It is also a part of data management in statistical analysis.
Logistic regression
Logistic regression is a statistical analysis method to predict a binary outcome, such as yes or
no, based on prior observations of a data set.
In many ways logistic regression is like ordinary regression. It requires a dependent variable,
y, and one or more independent variables.
Logistic regression can be used to model situations in which the dependent variable, y, may
only assume two discrete values, such as 0 and 1.
53
Methods of interpreting data and drawing
• text;
• tables;
• graphs; and
• statistical measures.
54
Unit 8: Reporting and Evaluating Research
55