Module IV: Data Processing, Analysis, and Report Writing
The Analytical Architecture: From Raw Data to Scientific Deliverables
Data collection yields a massive volume of raw, unorganized empirical facts that cannot be directly interpreted by decision-makers. Before meaningful business intelligence can be extracted, the raw data must undergo systematic data processing—editing, coding, classification, and tabulation. Subsequently, researchers execute descriptive and inferential statistical analyses to test hypotheses and establish generalizable truths. Finally, the entire empirical investigation culminates in the preparation and presentation of a formal research report conforming to international referencing standards. This module provides an exhaustive study of data preparation, statistical analysis theory, report structure, and citation mechanics.
1. Data Processing Operations: Editing, Coding, Classification, and Tabulation
Data processing is the intermediary phase that bridges empirical fieldwork with statistical analysis. It transforms chaotic field responses into a clean, structured, and computer-readable dataset.
A. Editing of Data
Editing is the examination of completed questionnaires and schedules to identify and rectify errors, omissions, illegible handwriting, and inconsistent responses.
- Field Editing: Conducted by enumerators or field supervisors on the exact same day of data collection, while the interview context is fresh in memory. Aims to clarify rushed shorthand abbreviations and correct obvious recording slips.
- Central Editing: Conducted at the central research office after all schedules are returned. Rigorously reviews the entire batch of schedules for logical consistency, fake response patterns (e.g., "straight-lining" identical ratings across all items), and contradictory answers (e.g., respondent reports age of 19 but reports having 20 years of work experience).
B. Coding and The Codebook Architecture
Coding is the technical process of assigning numerical numerals, alphabetical letters, or symbols to answers so that responses can be grouped into a limited number of classes and processed efficiently by statistical software (such as SPSS, R, Python, or SAS).
Specimen Research Codebook Architecture
| Variable Name | Variable Label / Questionnaire Item | Data Type | Coding Rules / Value Labels | Missing Values |
|---|---|---|---|---|
RESP_ID |
Unique Respondent Identification Number | Numeric (Integer) | Sequential: 001, 002, 003, ... | None allowed |
GENDER |
Gender of the Respondent | Nominal | 1 = Male, 2 = Female, 3 = Non-Binary | 99 = No Response |
EDUCATION |
Highest Educational Attainment | Ordinal | 1 = High School, 2 = Graduate, 3 = Post-Graduate, 4 = PhD | 99 = Unstated |
PU_1 |
Perceived Usefulness: Saves Time | Interval (Likert) | 1 = SD, 2 = D, 3 = N, 4 = A, 5 = SA | 9 = Blank |
INCOME |
Monthly Gross Household Income (INR) | Ratio (Continuous) | Actual monetary amount in INR entered directly | -999 = Refused |
C. Classification of Data
Classification is the process of arranging data into groups or classes according to their common characteristics and affinities. The four fundamental types of classification are:
- Geographical / Spatial Classification: Classified according to location or geographic regions (e.g., sales classified by States: Kerala, Karnataka, Maharashtra).
- Chronological / Temporal Classification: Classified on the basis of time periods (e.g., corporate revenue from 2018 to 2023).
- Qualitative Classification: Classified according to descriptive attributes or qualities that cannot be measured directly (e.g., religion, gender, marital status). Can be Simple (dichotomous) or Manifold (multiple sub-attributes).
- Quantitative Classification: Classified on the basis of measurable numerical magnitudes forming discrete or continuous frequency distributions (e.g., workers classified by daily wage brackets: INR 500-700, 701-900).
D. Tabulation: Structure and Principles
Tabulation is the orderly and systematic presentation of numerical data in rows and columns designed to elucidate relationships and facilitate comparative analysis.
Essential Structural Parts of a Table
- Table Number: Distinct identification number for referencing.
- Title: Clear, concise narrative explaining What, Where, and When.
- Caption (Box-Head): Column headings and sub-headings.
- Stub: Row headings placed at the extreme left.
- Body: The core matrix containing actual numerical frequencies.
- Headnote / Prefatory Note: Explains units (e.g., "In Lakh INR").
- Footnote & Source Note: Explains asterisks and original data sources.
Principles of Good Table Construction
- Self-Explanatory Clarity: The table must be fully understandable without requiring reference to the text.
- Proportional Sizing: Sized attractively to fit standard margins without overcrowding.
- Logical Ordering: Rows and columns arranged alphabetically, chronologically, or in order of magnitude.
- Totalling & Sub-Totalling: Clear grand totals to allow percentage cross-verification.
2. Analysis of Data: Descriptive and Inferential Paradigms
Data analysis involves breaking down complex data into manageable operational parts, synthesizing findings, searching for patterns, and applying statistical models.
A. Descriptive Statistical Analysis
Descriptive statistics mathematically summarize, organize, and describe the characteristics of a sample without attempting to infer or generalize beyond the sample.
| Descriptive Dimension | Statistical Metrics & Descriptions | Managerial Application |
|---|---|---|
| Measures of Central Tendency | • Arithmetic Mean: Mathematical average sensitive to extreme outliers. • Median: Middle value of ordered dataset; robust against skewness. • Mode: Most frequently occurring value; used for nominal data. |
Determining average sales, median household income, or most preferred product color. |
| Measures of Dispersion (Variability) | • Range: Difference between maximum and minimum values. • Standard Deviation (SD): Root mean square deviation from mean. • Variance: Square of SD; foundation of ANOVA models. • Coefficient of Variation (CV): (SD / Mean) x 100; relative risk measure. |
Assessing stock price volatility, consistency of production quality, or income disparity. |
| Measures of Shape | • Skewness: Degree of asymmetry around the mean. Positively skewed (tail right, Mean > Median); Negatively skewed (tail left, Mean < Median). • Kurtosis: Peakedness of distribution (Leptokurtic = sharp peak; Mesokurtic = normal; Platykurtic = flat). |
Evaluating financial return distributions (fat-tail risk in investment portfolios). |
B. Inferential Statistical Analysis: The Logic of Hypothesis Testing
Inferential statistics enables the researcher to make scientific inferences and draw probability-based conclusions about an unknown population based on empirical sample statistics.
The Hypothesis Testing Framework
- Null Hypothesis (H0): A statement of no effect, no relationship, or no difference between groups (e.g., H0: Digital advertising expenditure has no significant effect on brand awareness). It is assumed to be true until empirical evidence forces its rejection.
- Alternative Hypothesis (H1): The research proposition that indicates a true relationship, difference, or effect exists (e.g., H1: Digital advertising expenditure significantly increases brand awareness).
- Type I Error (Alpha - α): The probability of rejecting the Null Hypothesis when it is actually true (false positive). Commonly set at a 5% level of significance (α = 0.05).
- Type II Error (Beta - β): The probability of failing to reject the Null Hypothesis when it is actually false (false negative). The Power of a Test is defined as
1 - β(typically targeted at ≥ 0.80). - Level of Significance and p-value: The p-value is the exact probability of obtaining test results at least as extreme as the results actually observed, under the assumption that H0 is true.
• If p-value ≤ 0.05: Reject H0; the finding is statistically significant!
• If p-value > 0.05: Fail to reject H0; insufficient evidence.
Specimen Statistical Analysis Tables: Bivariate and Multivariate Models
Specimen Output 1: Cross-Tabulation and Chi-Square Contingency Analysis
| Educational Qualification | Digital Banking Adopter (Count / %) | Non-Adopter (Count / %) | Total Sample |
|---|---|---|---|
| Under-Graduate | 45 (45.0%) | 55 (55.0%) | 100 (100%) |
| Graduate | 90 (60.0%) | 60 (40.0%) | 150 (100%) |
| Post-Graduate & Above | 120 (80.0%) | 30 (20.0%) | 150 (100%) |
| Total | 255 (63.75%) | 145 (36.25%) | 400 (100%) |
Statistical Test Result: Chi-Square Value = 31.84, Degrees of Freedom (df) = 2, p-value < 0.001. Since p < 0.05, the Null Hypothesis is rejected; there is a statistically significant association between educational qualification and digital banking adoption.
Specimen Output 2: Multiple Linear Regression Model Summary & Coefficients
Dependent Variable: Continuance Intention to Use FinTech (CI)
Model Fit: R = 0.762, R-Square = 0.581, Adjusted R-Square = 0.577, ANOVA F-Statistic = 182.45 (p < 0.001).
| Model Predictors | Unstandardized B | Std. Error | Standardized Beta | t-statistic | p-value (Sig.) |
|---|---|---|---|---|---|
| (Constant) | 0.482 | 0.142 | - | 3.394 | 0.001 |
| Perceived Usefulness (PU) | 0.415 | 0.048 | 0.432 | 8.645 | < 0.001 |
| Perceived Ease of Use (PEOU) | 0.284 | 0.052 | 0.278 | 5.461 | < 0.001 |
| Perceived Security Risk (PSR) | -0.218 | 0.041 | -0.224 | -5.317 | < 0.001 |
Managerial Interpretation: 58.1% of the variance in customer continuance intention is explained by the three predictors. Perceived Usefulness exerts the strongest positive relative impact (Beta = 0.432), while Perceived Security Risk exerts a significant negative deterrent effect (Beta = -0.224).