Performance Evaluation: Benchmarking and Peer Group Analysis
This sub‑topic covers how portfolio performance is measured against a chosen benchmark and against similar portfolio managers (peer group). It explains why benchmarking and peer group analysis are essential for compliance, client communication and exam success. Understanding these concepts helps you answer performance‑evaluation questions in the NISM Series XXI‑A exam.
Learning Objectives
- 1Define benchmark and peer group and their role in performance evaluation.
- 2Select an appropriate benchmark for an Indian PMS portfolio.
- 3Calculate and interpret tracking error and information ratio.
- 4Identify common exam traps related to benchmarking and peer analysis.
Understanding Benchmarking
A benchmark is a standard, usually a market index or a custom composite, against which the returns of a portfolio are compared. It represents the performance that could have been achieved by investing in a passive replication of the same market segment.
For the exam, SEBI expects distributors to disclose the benchmark used for a Portfolio Management Service (PMS) and to justify its relevance. An appropriate benchmark must reflect the portfolio’s investment style, asset class, and risk profile.
Typical mistakes include selecting a benchmark that is too broad (e.g., BSE Sensex for a small‑cap equity PMS) or too narrow (e.g., a single stock index for a diversified fund). Such mismatches lead to misleading performance claims and can attract penalties.
- Benchmark choice directly influences excess return, tracking error and other ratios.
- Regulators require periodic performance reporting against the disclosed benchmark.
Students often pick the most popular index without checking asset‑class alignment. Remember: the benchmark must mirror the portfolio’s strategy, not just be a well‑known index.
Selecting an Appropriate Benchmark
When choosing a benchmark, consider the following criteria: (1) asset‑class coverage, (2) market‑capitalisation style (large‑cap, mid‑cap, small‑cap), (3) sector concentration, and (4) geographic exposure. For Indian PMS, common benchmarks include NIFTY 50, NIFTY Mid‑Cap 100, MSCI India Index, or a custom blend.
SEBI’s circular on PMS performance reporting (2020) mandates that the benchmark be disclosed in the client agreement and that any change be communicated with a justification. The portfolio manager must also disclose the methodology for calculating excess returns.
In the exam, you may be asked to identify the most suitable benchmark for a given portfolio description. Look for clues such as “focus on large‑cap equities” or “70% equities, 30% debt” to match with the correct index.
Peer Group Analysis
A peer group is a set of portfolio managers or PMS schemes that have similar investment objectives, asset‑class mix, and risk profile. Comparing a manager’s performance with peers helps assess skill versus luck.
In the Indian context, peer groups are often constructed using SEBI‑registered PMS distributors offering comparable strategies (e.g., “large‑cap growth”, “balanced debt‑equity”). Data for peer comparison can be sourced from the NISM database or third‑party rating agencies.
Exam questions may present a portfolio’s return and ask you to judge its relative standing. You must know whether the comparison is against a benchmark (absolute) or a peer group (relative) and which metrics are appropriate for each.
A benchmark is a market index; a peer group is a collection of similar managers. Mixing the two leads to incorrect calculation of excess returns.
Key Performance Metrics for Benchmark Comparison
Once a benchmark is fixed, the portfolio’s performance is evaluated using several quantitative metrics:
Excess Return – the difference between portfolio return and benchmark return over the same period. Positive excess return indicates outperformance.
Tracking Error (TE) – the standard deviation of the difference between portfolio and benchmark returns. It measures consistency of out/under‑performance.
Information Ratio (IR) – excess return divided by tracking error. A higher IR signals better risk‑adjusted outperformance.
Other qualitative metrics such as alpha, beta, and Sharpe ratio are also discussed in the syllabus, but for benchmarking the three metrics above are most exam‑focused.
Where:
n= Number of observation periods (e.g., months or quarters)R_{p,i}= Portfolio return in period i (in decimal)R_{b,i}= Benchmark return in period i (in decimal)Worked Example
Given three quarterly returns: Portfolio: 10%, 12%, 8% → 0.10, 0.12, 0.08 Benchmark: 9%, 11%, 7% → 0.09, 0.11, 0.07 Differences: 0.01, 0.01, 0.01 Step 1: Square each difference → 0.0001 each Step 2: Sum = 0.0003 Step 3: Divide by n=3 → 0.0001 Step 4: Square root → 0.01 (or 1%) Verification: sqrt(0.0003/3) = 0.01.
Where:
\overline{R_{p}}= Average portfolio return over the period (in decimal)\overline{R_{b}}= Average benchmark return over the period (in decimal)TE= Tracking Error (as a decimal)Worked Example
Using the same data as above: Average portfolio return = (0.10+0.12+0.08)/3 = 0.10 (10%) Average benchmark return = (0.09+0.11+0.07)/3 = 0.09 (9%) Excess return = 0.01 (1%) TE = 0.01 (1%) IR = 0.01 / 0.01 = 1.0 Verification: (0.10-0.09)/0.01 = 1.
Comparison of Core Benchmarking Metrics
| Metric | Formula | Interpretation |
|---|---|---|
| Excess Return | R_p - R_b | Positive = outperformance; negative = underperformance |
| Tracking Error | √(1/n Σ(R_p - R_b)^2) | Lower TE = more consistent performance |
| Information Ratio | (R_p - R_b)/TE | Higher IR = better risk‑adjusted outperformance |
Quarterly Returns: Portfolio vs. Benchmark
Scenario
An investor approaches a PMS distributor. The PMS manager reports a 12% annual return. The disclosed benchmark is the NIFTY 50, which delivered 9% in the same year. The manager also provides a peer‑group average return of 10% for three similar PMS schemes.
Solution
Step 1: Compute excess return over benchmark = 12% - 9% = 3%. Step 2: Compute excess return over peer group = 12% - 10% = 2%. Step 3: Assume quarterly returns for the portfolio are 3%, 4%, 2%, 3% and for the benchmark are 2%, 3%, 1%, 3%. Calculate TE using the formula: differences = 1%,1%,1%,0% → squares = 0.0001,0.0001,0.0001,0 → sum = 0.0003 → TE = sqrt(0.0003/4) = 0.00866 ≈ 0.87%. Step 4: Compute IR = Excess return (average) / TE = 0.03 / 0.00866 ≈ 3.46. Step 5: Interpretation – The manager outperformed the benchmark by 3% with a low tracking error, yielding a strong IR (>1), indicating skillful active management. Step 6: For the exam, remember to disclose both benchmark and peer‑group performance and to calculate TE and IR correctly.
Conclusion
The scenario illustrates how benchmark excess return, tracking error and information ratio together provide a complete picture of performance, which is exactly what NISM questions test.
Practical Steps for Portfolio Managers
1. Identify the investment mandate – asset class, style, risk tolerance.
2. Select a benchmark that mirrors the mandate; document the rationale in the client agreement.
3. Collect periodic return data for both portfolio and benchmark (monthly or quarterly).
4. Calculate performance metrics – excess return, tracking error, information ratio – using the formulas provided.
5. Prepare a performance report that includes the metrics, a narrative explanation, and a peer‑group comparison if available.
SEBI requires at least quarterly performance reporting. Missing a quarter can lead to non‑compliance and affect exam answers that ask about reporting frequency.
Regulatory Perspective
SEBI’s PMS Regulations (2020) mandate that the distributor disclose the benchmark, the methodology for calculating returns, and any changes to the benchmark. The regulations also require that the performance report include a comparison with the benchmark and, where relevant, with a peer group.
Failure to disclose the benchmark or to use an inappropriate benchmark can attract penalties under Section 15H of the SEBI Act. For the exam, remember the key regulatory clauses: disclosure in the agreement, quarterly reporting, and justification for any benchmark change.
Exam‑level tip: When a question mentions “non‑disclosure of benchmark”, the correct answer will point to SEBI’s requirement for explicit benchmark disclosure in the PMS agreement.
⭐Exam Takeaways
- Benchmark = market index reflecting the portfolio’s strategy; peer group = similar PMS managers.
- Choose a benchmark that matches asset class, market‑cap style, and risk profile as per SEBI guidelines.
- Excess Return = Portfolio return – Benchmark return; positive value signals outperformance.
- Tracking Error measures consistency; calculate as the standard deviation of return differences.
- Information Ratio = Excess Return ÷ Tracking Error; IR > 1 indicates strong risk‑adjusted outperformance.
- SEBI requires quarterly performance reports that disclose benchmark, methodology, and peer‑group comparison.
- Common exam trap: mixing up benchmark with peer group or using an unrelated index as benchmark.
Practice Questions
8 questions on Performance Evaluation: Benchmarking and Peer Group Analysis
What is a benchmark in portfolio performance evaluation?
How frequently does SEBI require PMS performance reporting?
Which of the following is NOT listed as a criterion for selecting an appropriate benchmark?
Using the example data (Portfolio: 10%,12%,8%; Benchmark: 9%,11%,7%), what is the tracking error?
In the NISM‑style scenario, the manager’s annual excess return is 3% and TE is 0.00866. What is the Information Ratio?
Which statement correctly reflects SEBI’s requirement on benchmark disclosure for PMS?
What is the common exam trap related to benchmark selection?
If a small‑cap equity PMS uses the BSE Sensex as its benchmark, what is the likely regulatory implication?