Data Representation and Summary

In statistics, raw data is often extensive and difficult to interpret. Data representation and summary provides the fundamental tools to organize, visualize, and quantify key features of a dataset, making it easier to understand and draw meaningful conclusions.

### 1. Statistical Diagrams

Visual representation is the first step in analyzing data. Different diagrams are suited for different types of data.

Histograms: Used to represent **continuous data** grouped into class intervals. The key feature of a histogram is that the **area of each bar is proportional to the frequency** of that class. The vertical axis represents **frequency density**, calculated as:

Frequency Density = Frequency / Class Width

This is especially crucial when dealing with unequal class widths, a common scenario in exams. A taller bar does not necessarily mean higher frequency if its class width is very narrow.

Stem-and-Leaf Diagrams: These diagrams are useful for smaller datasets as they retain the original data values while providing a shape of the distribution. A vertical stem represents the leading digits, and the leaves represent the trailing digits. **Back-to-back stem-and-leaf diagrams** are excellent for comparing two datasets.

Cumulative Frequency Graphs (Ogives): This graph is plotted by taking the **upper class boundary** on the horizontal axis and the **cumulative frequency** on the vertical axis. The points are joined with a smooth curve or straight lines. These graphs are primarily used to estimate values:

* The median is estimated at the 50th percentile (i.e., at a cumulative frequency of n/2, where n is the total frequency).

* The lower quartile (Q1) is at the 25th percentile (n/4).

* The upper quartile (Q3) is at the 75th percentile (3n/4).

* The interquartile range (IQR), a measure of spread, is calculated as Q3 - Q1.

Box-and-Whisker Plots: This is a powerful visual tool that summarizes a dataset using five key values: the **minimum value, lower quartile (Q1), median, upper quartile (Q3), and maximum value**. The 'box' represents the IQR, containing the middle 50% of the data. The 'whiskers' extend to the minimum and maximum values. Box plots are excellent for comparing the central tendency, spread, and skewness of different datasets side-by-side.

### 2. Measures of Central Tendency

These are single values that attempt to describe the 'center' of a dataset.

* Mean (μ or x̄): The arithmetic average. It is calculated by summing all values and dividing by the count. It is sensitive to outliers.

* For raw data: μ = Σx / n

* For grouped data in a frequency table: μ = Σfx / Σf, where 'x' is the midpoint of each class interval.

* Median: The middle value when the data is arranged in ascending order. For an even number of observations, it is the average of the two middle values. It is resistant to outliers.

* Mode: The value that appears most frequently in a dataset. It is the only measure that can be used for categorical data.

### 3. Measures of Spread (Dispersion)

These measures describe how spread out or varied the data points are.

* Range: The difference between the maximum and minimum values. It is easy to calculate but is heavily affected by extreme values (outliers).

* Interquartile Range (IQR): IQR = Q3 - Q1. It measures the range of the middle 50% of the data, making it a robust measure of spread that is not affected by outliers.

* Variance (σ²) and Standard Deviation (σ): These are the most important measures of spread, quantifying the average dispersion of data points around the mean. A small standard deviation indicates that data points are clustered closely around the mean, while a large standard deviation indicates they are spread out.

* For raw data:

* Variance (σ²) = Σ(x - μ)² / n = (Σx² / n) - μ²

* The second formula is often computationally easier.

* For grouped data:

* Variance (σ²) = Σf(x - μ)² / Σf = (Σfx² / Σf) - μ²

* The standard deviation (σ) is the square root of the variance: σ = √Variance. Its advantage is that it is expressed in the same units as the original data.