0% found this document useful (0 votes)
90 views12 pages

Sample Essay Analysis

The document provides an introduction and explanations for analysis of an examinee's New York bar exam essays and MPTs from February 2017. It explains that the analysis uses automated scripts to calculate metrics for the essays, and notes some limitations in the accuracy of these calculations. For each essay/MPT, there will be graphs, statistics, and a written analysis to identify issues and compare performance to sample above-average answers. The graphs analyze relationships between an examinee's score and factors like the percentage of words matching the question or sample answers, readability levels, sentence structures, and word usage.

Uploaded by

Michael F
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
90 views12 pages

Sample Essay Analysis

The document provides an introduction and explanations for analysis of an examinee's New York bar exam essays and MPTs from February 2017. It explains that the analysis uses automated scripts to calculate metrics for the essays, and notes some limitations in the accuracy of these calculations. For each essay/MPT, there will be graphs, statistics, and a written analysis to identify issues and compare performance to sample above-average answers. The graphs analyze relationships between an examinee's score and factors like the percentage of words matching the question or sample answers, readability levels, sentence structures, and word usage.

Uploaded by

Michael F
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
  • Introduction and Explanation
  • Essay PT 1 Graphs and Statistics
  • Essay PT 1 Detailed Analysis
  • Essay PT 1 Statistics Explanation
  • MEE Analysis
  • MPT #1 Graphs and Statistics
  • MPT #1 Statistics Explanation
  • MPT #1 Detailed Analysis
  • MPT Analysis

EXAMINEE NAME: Sample *********

NYS BAR EXAMINATION: FEB 2017


DATE OF REPORT: OCTOBER 21, 2017

INTRODUCTION AND EXPLANATIONS


I must start off with a disclaimer. This analysis is primarily based on the utilization of automated scripts to calculate words, word counts and other information. While these
calculations are deemed reliable, no representation is being made as to the accuracy of the calculations. Accordingly, keep in mind that there can be instances where the words
or word counts are not accurate. All words are converted to lower-case for comparison purposes. In addition, I do not correct typos in essays - if a word is mis-spelled, it will be
reported that way. This can sometimes result in odd results. The analysis compares both laptop (typed) essays and handwritten essays (transcribed). At the moment, there are
no distinctions made between typed and handwritten essays - at some point in the future I may make such distinctions if the analysis warrants it. Please also keep in mind that
the conversion of PDF essays to text and the transcription of the written essays may result in some words to be improperly reported or misspelled.

For each MEE Essay/MPT, there is a one page graph, a one page statistics chart, and a two page written explanation. Although this analysis is lengthy, you should read the
entire analysis and review the graphs and charts. By studying this information, you can pinpoint problems with your Essays/MPT. More detailed information on the graphs and
charts is in the Chart and Statistics explanations below.
On the charts and graphs, the Flesch Reading Ease test and the Flesch–Kincaid Grade Level test are designed to indicate comprehension difficulty when reading a passage of
contemporary academic English. On the Flesch Reading Ease test, lower scores indicate material that is more difficult to read. Reader's Digest magazine has a readability
index of about 65, Time magazine scores about 52, an average year 7 student's (eleven years old) written assignment has a readability test of 60-70 (and a reading grade level
of 6-7) and the Harvard Law Review has a general readability score in the low 30s.

The Flesch–Kincaid Grade Level test reports the number of years of education generally required to understand this text. For example, a score of 8.2 would indicate that the text
is expected to be understandable by an average student in 8th grade (usually around ages 13–14 in the United States of America). A score of 12 would indicate that the text is
expected to be understandable by an average student in the 12th grade (senior year of High School - usually around ages 17-18 in the United States of America)

Generally, the graphs and statistics are based on Essays/MPTs of the 24 examinees who failed the Feb 2017 New York UBE bar examination and submitted their MEE
Essays/MPTs to me. The examinee answer comparisons do not include the released above average essays since I have no scores for these released above-average answers.
However, in certain instances, some graphs and statistics compare your Essay/MPT statistics to the released above-average answers. Please keep in mind that the smaller
the essay sample, the decreased statistical significance of these graphs and charts.
The 'Essay to Question vs Score' graph shows what percentage of words from each examinee's essay that appeared in the Essay Question versus the score received. The
purpose of this graph is to determine whether there is a trend or relationship between scores and the amount of words an examinee uses in an essay answer that are also in
the Question. The lower the Percentage of Essay to Word, the less an examinee matched the facts in the Question to the examinee's answer. More detailed information on this
is in the Chart and Statistics explanations below.
The 'Grade Level vs Score' graph shows the Flesch–Kincaid Grade Level from each examinee's essay versus the score received. The purpose of this graph is to determine
whether there is a trend or relationship between scores and the calculated Flesch–Kincaid Grade Level of each examinee's essay answer. Keep in mind that this graph only
compares the essays submitted to me - the released above average answers are not included in this analysis.
The 'Essay to Answer 1 vs Score' graph shows what percentage of words from each examinee's essay that appeared in the first released above average essay answer versus
the score received. This analysis does not examine the quality of the content, merely the content itself. However, logic would suggest that examinees who used more of the
same words as the released above average answers would generally have a higher score since using more of the same words indicates the examinee covered more of the
same issues as the released above average answers. The purpose of this graph is to determine whether there is a trend or relationship between scores and the amount of
words an examinee uses in an essay answer that are also in first above average essay answer.

The 'Essay to Answer 2 vs Score' graph shows what percentage of words from each examinee's essay that appeared in the second released above average essay answer
versus the score received. The purpose of this graph is to determine whether there is a trend or relationship between scores and the amount of words an examinee uses in an
essay answer that are also in second above average essay answer. Logic would suggest that this trend should be similar to the 'Essay to Answer 1 vs Score' trend.

The 'IRAC Intro Sentences vs Score' graph shows the IRAC introduction by sentence percentage from each examinee's essay versus the score received. The IRAC
Introduction percentage is calculated by determining how many sentences in an essay started with an IRAC Introduction and then comparing this to the number of overall
sentences in the essay. For example, if half of an examinee's sentences started with one of these IRAC phrases, the IRAC Intro Sentence percentage would be 50%. The
purpose of this graph is to determine whether there is a trend or relationship between the percentage of IRAC phraseology used in an essay answer and the examinee's essay
score. Keep in mind that the released above average answers are not included in this analysis.
The 'IRAC Intros vs Score' graph shows the number of different IRAC introductions used in each examinee's essay versus the score received. The IRAC Intro amount is
calculated by determining how many different IRAC Intro phrases were used (out of the 35 IRAC Intro phrases). The purpose of this graph is to determine whether there is a
trend or relationship between the overall number of IRAC Intros used in an essay answer and the examinee's essay score. The released above average answers are not
included in this analysis.
The 'Different Words vs Score' graph shows the number of different words used in each examinee's essay versus the score received. The purpose of this graph is to determine
whether there is a trend or relationship between the number of different words an examinee uses in an essay answer and the examinee's essay score. The released above
average answers are not included in this analysis.
The 'Word Count vs Score' graph shows the total number of words used in each examinee's essay versus the score received. The purpose of this graph is to determine
whether there is a trend or relationship between the total number of words an examinee uses in an essay answer and the examinee's essay score. The released above average
answers are not included in this analysis.
Please also note that each above average answer is likely from a different examinee. Therefore, you will see differences in the number of IRAC introductions and other
information between the above average answers for each essay.

Copyright 2017 Seperac Bar Review LLC


Page 1 of 43
EXAMINEE NAME: Sample *********
NYS BAR EXAMINATION: FEB 2017
DATE OF REPORT: OCTOBER 21, 2017

ESSAY #1 GRAPHS: CONTRACTS QUESTION - SCORE: 59.09

Essay to Question vs Score Grade Level vs Score


60 Score Linear (Score)

55 90
80
50 70
60
Score

45 Score
50
Linear (Score) 40
40
Expon. (Score) 30
35 20
10
30 0
0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19
Percentage of Essay to Word Grade Level

Essay to Answer 1 vs Score Essay to Answer 2 vs Score


60 60

55 55

50 50

Score
Score

45 Score 45 Score
Linear (Score) Linear (Score)
40 40
Expon. (Score) Expon. (Score)
35 35

30 30
0.1 0.2 0.3 0.4 0.5 0.6 0.1 0.2 0.3 0.4 0.5 0.6
Percentage of Essay to Word Percentage of Essay to Word

IRAC Intro Sentences vs Score IRAC Intros vs Score


60 Score Linear (Score)

55 90
80
50 70
60
Score

45 Score 50
Linear (Score) 40
40
Expon. (Score) 30
35 20
10
30 0
0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0 3 6 9 12 15 18
Percentage of IRAC Intros to Sentences Number of IRAC Intros

Different Words vs Score Word Count vs Score


90
Score Linear (Score)
80
70 90
60 80
50 70
40 60
30 50
20 40
10 30
0 20
100 120 140 160 180 200 220 240 260 280 300 320 340 10
0
Different Words 0 100 200 300 400 500 600 700 800 900 1000 1100 1200 1300 1400 1500
Score Linear (Score) Word Count

Copyright 2017 Seperac Bar Review LLC


Page 2 of 43
EXAMINEE NAME: Sample *********
NYS BAR EXAMINATION: FEB 2017
DATE OF REPORT: OCTOBER 21, 2017

ESSAY #1 CHARTS AND STATISTICS: CONTRACTS QUESTION - SCORE: 59.09

Essay #1 Passing Score 50.95 AVG, MIN, MAX and RANK Best Avg Top 20 words the NCBE Answer Analysis
24 Examinees with Avg score of 47.9 Top 3 used that you did not
Essay #1 Statistics You Answer 1 Answer 2 Best AVG MIN MAX RANK AVG Rank Essay #1 Word #
Score 59.09 90 90 67.72 47.88 31.94 67.72 5 82.6 1 ucc 8
Words 503 468 476 695 462 136 846 8 546 2 hold 4.5
Characters 2192 2231 2194 3176 2109 665 3886 13 2534 3 gardener’s 4.5
Paragraphs 10 9 12 5 7.9 3 19 7 9 4 no 3.5
Sentences 18 21 22 29 21.4 3 39 15 24 5 such 2.5
Sentences per Paragraph 1.8 2.3 2.4 7.2 3.1 1 7.2 21 4.0 6 transaction 2.5
Words per Sentence 27.9 22.2 20.9 23.8 21.6 14.5 34.6 4 22.3 7 signed 2.5
Characters per Word 4.2 4.6 4.4 4.4 4.4 4 4.8 23 4.5 8 issue 2
Flesch Reading Ease 53.3 48.6 55 52 56.3 42.4 70.2 16 51.9 9 had 2
Flesch-Kincaid Grade Level 12.7 12 10.5 11.9 10.6 6.7 15.4 4 11.5 10 sold 2
IRAC Intro to Sentence 27.8% 19.1% 40.9% 31.0% 28.9% 0.0% 45.5% 16 30.3% 11 term 2
12 person 2
Word Size Breakdown You Answer 1 Answer 2 Best Avg Question 13 enter 2
Words four letters and less 41.6% 37.5% 36.7% 42.3% 42.4% 52.2% 14 into 2
Words five letters and less 56.5% 54.3% 49.3% 51.5% 55.0% 63.8% 15 her 2
Words seven letters and less 79.2% 78.4% 75.6% 77.6% 77.8% 84.8% 16 thus 1.5
Words ten letters and less 96.8% 95.2% 95.5% 94.9% 96.1% 97.1% 17 explanation 1.5
Words more than ten letters 3.2% 4.8% 4.5% 5.1% 3.9% 2.9% 18 point 1.5
19 may 1.5
IRAC Introductory Phrases You Answer 1 Answer 2 Best Average Top 10 words in above average 20 statement 1.5
The issue 0 0 0 0 0.2 answer 1 that you did not use
Under 1 1 1 1 1.0 Rank Essay #1 Word #
Here 1 0 4 3 1.6 1 no 9 Top 20 words you used that the NCBE
However 1 0 1 2 0.9 2 revocable 4 Answer Analysis did not
Furthermore 0 0 0 0 0.0 3 merchant's 4 Rank Essay #1 Word #
Thus 0 0 1 0 0.7 4 will 4 1 parties 4
Therefore 2 0 0 1 0.9 5 so 3 2 needs 4
IRAC Intros Used 5 4 9 9 7 6 express * 3 3 confirmatory 3
Different IRAC Intros Used 4 4 6 5 4 7 words 3 4 party 3
8 freely 3 5 return 2
Contracts Answer: Issue-Spotting Analysis: Your score: 59.09 9 stated 3 6 allows 2
Word/Phrase With Word Avg Pts W/O Word Avg Pts You 10 i* 3 7 duration 2
terminate 3% 24.8 95% 14.4 NO 8 merchants 2
effective 8% 21.3 89% 14.0 NO Top 10 words in above average 9 months 2
Article 2 24% 18.0 73% 13.2 YES answer 2 that you did not use 10 can 2
revocation 22% 17.7 76% 13.6 YES Rank Essay #1 Word # 11 memo 2
irrevocable 19% 17.6 78% 13.8 NO 1 while * 5 12 qualify 2
induce 5% 17.1 92% 14.6 NO 2 revocable 5 13 have 2
reasonabl* 24% 17.1 73% 13.7 NO 3 ucc 5 14 sends 2
supported by consideration 14% 17.1 84% 14.3 NO 4 no 5 15 summer 2
revoke* 35% 16.9 62% 12.9 YES 5 had 5 16 june 2
keep 32% 16.9 65% 13.2 YES 6 signed 4 17 output 2
communicat* 27% 16.6 70% 13.7 NO 7 will 4 18 grows 2
option contract 30% 16.6 68% 13.6 YES 8 gardener's 4 19 give 2
mutual 11% 16.5 86% 14.5 NO 9 words 4 20 selling 2
offeror 41% 16.4 57% 12.8 YES 10 irrevocable * 4
hold the offer open 19% 16.3 78% 14.2 NO Top 15 words in the Question that both
UCC 54% 15.9 43% 11.9 NO For the Above Average Top 10 charts above, any word above avg. answers used but you did not
intent* 30% 15.9 68% 14.0 YES marked with an asterisk (*) means that the other Rank Essay #1 Word #
amateur 38% 15.9 59% 13.7 NO above average answer also did not use this word. 1 had 3
merchant 57% 15.8 41% 11.7 YES 2 with 3
offeree 43% 15.7 54% 13.5 YES Top 10 words in the best 3 sold 2
before 38% 15.6 59% 13.9 YES answer that you did not use 4 accept 2
common law 27% 15.6 70% 14.3 YES Rank Essay #1 Word # 5 experience 1
writing* 49% 15.5 49% 13.5 YES 1 certain 9 6 no 1
promise 38% 15.5 59% 14.1 YES 2 neighbor 8 7 stated 1
bargain 14% 15.4 84% 14.6 YES 3 must 7 8 will 1
4 professional 5 9 signed 1
5 reasonable 5 10 amateur 1
6 amount 5 11 identified 1
Word Comparison Statistics You Answer 1 Answer 2 Best AVG 7 definite 4 12 #N/A #N/A
Essay To Question Comparison 39.1% 55.8% 48.6% 62.3% 42.7% 8 stated 4 13 #N/A #N/A
Essay To Answer 1 Comparison 47.1% 58.2% 48.1% 39.7% 9 will 4 14 #N/A #N/A
Essay To Answer 2 Comparison 40.7% 54.8% 42.1% 36.7% 10 contain 3 15 #N/A #N/A
Essay To Best Ans. Comparison 40.8% 51.0% 47.4% 40.2%

Score Comparison Statistics Word Essay Grade Essay Essay to Essay IRAC to Essay
You versus other Examinees Count Score Level Score Quest. % Score Sentence Score
Your Essay 503 59.1 12.7 59.1 39.1% 59.1 27.8% 59.1
Overall Essay avg (24 examinees) 462 47.9 10.6 47.9 42.7% 47.9 28.9% 47.9
Breakdown by Quartile
1st quartile avg (0-25 percentile) 371 43.0 9.4 45.6 28.3% 42.8 0.0% #DIV/0!
2nd quartile avg (25-50 percentile) 480 47.8 10.6 48.1 37.0% 43.8 26.4% 48.3
3rd quartile avg (50-75 percentile) 549 47.9 11.7 48.1 47.8% 51.5 33.3% 49.2
4th quartile avg (75-100 percentile) 846 53.6 15.4 50.0 71.0% 50.5 45.5% 45.6
Maximum and Minimum
Essay with highest 846 47.2 15.4 65.1 71.0% 47.2 45.5% 31.9
Essay with lowest 136 38.8 6.7 43.9 0.0% 80.0 0.0% 44.6

Copyright 2017 Seperac Bar Review LLC


Page 3 of 43
EXAMINEE NAME: Sample *********
NYS BAR EXAMINATION: FEB 2017
DATE OF REPORT: OCTOBER 21, 2017

ESSAY #1 CHART AND STATISTICS EXPLANATIONS: CONTRACTS QUESTION - SCORE: 59.09

The 'Essay Statistics' chart reports a variety of statistics pertaining to Essay #1. The first data column reports your essay statistics. For example, your Essay #1 consisted of 503
words. The second data column reports the essay statistics for the first released above-average answer for Essay #1. For example, the first released above average answer for
Essay #1 had a Flesch-Kincaid Grade Level of 12 as compared to your Flesch-Kincaid Grade Level of 12.7. The third data column reports the essay statistics for the second
released above-average answer for Essay #1. For example, the second released above average answer for Essay #1 consisted of 22 sentences compared to 18 sentences in
your essay. The fourth data column reports the essay statistics for the highest scoring answer (best) submitted to me for Essay #1 (based on 24 examinees). For example, the
best answer for Essay #1 had an IRAC Intro to Sentence of of 31% compared to 27.8% in your essay.

The next four data columns of the 'Essay Statistics' chart report the average (AVG), maximum (MAX), minimum (MIN) and rank (RANK) essay statistics based on the essays of
24 examinees that failed the Feb 2017 exam and submitted their essays to me (the released essays are not counted in these statistics). As a result, the AVG columns show the
mean score for each essay statistic based on the Essay #1 essays of the 24 examinees that failed the Feb 2017 exam and submitted their essays to me. For example, the
average number of IRAC Intro to Sentences (number of IRAC intros divided by number of sentences) among the 24 examinees was 28.9% (meaning an average of 71.1% of
the examinee sentences did not begin with one of the IRAC Introductory Phrases listed above). On this essay, your total words of 503 words was 41 words more than the
average Essay #1 words of 462 (based on the 24 submitted scores). Keep in mind these averages are only from those that failed - they may not accurately reflect the essay
statistics of all examinees. Please also note the analysis does not distinguish between laptop and handwritten essay scores.

The MAX and MIN columns report the highest score and lowest statistics for that category based on the Essay #1 essays of the 24 examinees that failed the Feb 2017 exam and
submitted their essays to me. Again, keep in mind these maximum and minimum numbers are only from those that failed - they may not accurately reflect the statistics of all
examinees. On this essay, your total words of 503 words was 367 words more than the minimum Essay #1 words of 136 words. In contrast, your total words of 503 words was
343 words less than the maximum Essay #1 words of 846 words (based on the 24 submitted scores).

The RANK column reports your rank for that category when compared to the scores of the 24 examinees that failed the Feb 2017 exam and submitted their scores to me. For
example, on Essay #1, your rank of 4 for 'Essay #1: Words per Sentence' means that 3 of the 24 examinees' Words per Sentence for Essay #1 were higher than your W ords per
Sentence of 27.9 while 20 of the examinees' Words per Sentence for Essay #1 were lower than your W ords per Sentence of 27.9 words per sentence. Meanwhile, the first
released above average answer for Essay #1 contained approximately 22.2 words per sentence and the second released above average answer for Essay #1 contained
approximately 20.9 words per sentence.

The 'Word Size Breakdown' chart reports compares your Essay #1 word sizes to the words in the Essay #1 Question; the two released above average answers; and the
averages of the 24 examinees that failed the Feb 2017 exam and submitted their essays to me. For example, in your Essay #1 answer, 79.22% of your words were seven letters
or less. Meanwhile, in the Essay #1 Question, 84.78% of the words were seven letters or less. In the first released above average answer for Essay #1, 78.37% of the words
were seven letters or less. In the second released above average answer for Essay #1, 75.57% of the words were seven letters or less. For the 24 examinees, on average,
77.8% of the words in their essay were seven letters or less. Therefore, your essay contained 1.4% more words that were seven letters or less as compared to the the 24
examinees that failed the Feb 2017 exam and submitted their essays to me.

The 'Score Comparison Statistics' chart compares a number of statistics to the essay scores. The first row reports your essay statistics (for example, your essay had an Essay
to Question % of 39.1% and a score of 59.09. This means that 39.1% of the words in the Question appeared in your essay answer). The second data row reports the score
comparison statistics for the Essay #1 average of the 24 examinees who submitted essays. For example, these 24 essays had an Essay to Question % of 42.7% and an average
score of 47.88. Other statistics include Word Count vs Score, Grade Level vs. Score, and IRAC to Sentence vs. Score. For example, these 24 essays had a average Flesch-
Kincaid Grade Level of 10.6 (with average score of 47.88).

The 'Breakdown by Quartile' section of the 'score Comparison Statistics' chart compares the statistics to essay scores based on Quartile averages of the 24 examinees who
submitted essays. For example, the 1st quartile average (0-25 percentile) for W ord Count was 371 words with a score of 43; the 2nd quartile average (25-50 percentile) for
Grade Level was 10.6 with a score of 48.1; the 3rd quartile average (50-75 percentile) for Essay to Question percentage was 47.83% with a score of 51.5; and the 4th quartile
average (75-100 percentile) for IRAC to Sentence percentage was 45.45% with a score of 45.6. Keep in mind that the smaller the essay sample, the decreased statistical
significance of the quartile breakdowns.

The 'Minimum and Maximum' section of the 'score Comparison Statistics' chart shows the highest and lowest statistics for each category along with their corresponding scores.
For example, the essay with the highest word count consisted of 846 words with a score of 47.19; the essay with the lowest Grade Level had a Grade Level of 6.7 with a score of
43.92; the essay with the highest Essay to Question percentage was 71.01% with a score of 47.19; and the essay with the lowest IRAC to Sentence percentage was 0% with a
score of 44.63. Again, keep in mind that the smaller the essay sample, the decreased statistical significance of these superlatives.

The 'IRAC Introductory Phrases' chart reports how often you used certain IRAC phrases in your answer and compares your essay answer to the best answer and the two above
average answers. For example, for the phrase 'The issue', your essay used this IRAC phrase 0 times in your essay (Please note that the phrase 'The issue' covers instances of
'The issue is' or 'The issue is whether' or 'The issue here' or any other variant of 'The issue...'). In contrast, the first released above average answer used this IRAC phrase 0
times and the second released above average essay used this IRAC phrase 0 times. Among the 24 examinees, 9 of the 35 of the IRAC Intros I examined were used.

In Essay #1, you used a total of 5 IRAC Introductory statements stemming from 4 different IRAC Phrases. In contrast, the first released above average essay used a total of 4
IRAC Introductory statements stemming from 4 different IRAC Phrases. The second released above average essay used a total of 9 IRAC Introductory statements stemming
from 6 different IRAC Phrases. The above average essays used approximately 23% more IRAC Intros than your essay.

Copyright 2017 Seperac Bar Review LLC


Page 4 of 43
EXAMINEE NAME: Sample *********
NYS BAR EXAMINATION: FEB 2017
DATE OF REPORT: OCTOBER 21, 2017

The 'Top 20 words the above average answers used that you did not' chart compares the words in your answer to an average of the words in the two above average answers.
For example, the above average answers used the word 'ucc' an average of 8 times in each of the released above average Essay #1 answers while you never used this word in
your Essay #1 answer. The list is sorted based on how often the words were used. For example, the 2nd most used word mentioned in the above average answers that you did
not use was the word 'hold'. It was used an average of 4.5 times in each of the released above average Essay #1 answers while you never used this word in your Essay #1
answer.

Please note that this chart is not filtered. The chart may report abbreviations or common words such as prepositions or names. Regardless, it is important to be aware what
words you did not use that the above average answers used, even if they are abbreviations or common words such as propositions. You should incorporate such common
words into your vocabulary when answering New York bar essay questions. By examining the differences, your goal should be to emulate the above average answer writing
style in your essay writing. For example, any word relating to the question or a legal principle is a topic or subject you likely missed in your answer.

The 'Top 20 words you used that the above average answers did not' chart compares the words in your answer to an average of the words in the two above average answers.
For example, you used the word 'parties' a total of 4 times in your Essay #1 answer while the above average answers never used this word. As with the prior chart, please keep
in mind that this chart is not filtered, and common words or prepositions are included in the list.
The 'Top 15 words in the Question that both above average answers used but you did not' chart compares the words in your answer to an average of the words in the two above
average answers. For example, the word 'had' was used in the Question a total of 3 times. Each above average answer used this word in their answer, but you never used this
word in your answer.
The 'Top 10 words in above average answer 1 that you did not use' chart compares the words in your answer to the word in the first above average answer and reports the top
ten words that the above average answer used that you did not. For example, the first above average answer used the word 'no' a total of 9 times in its answer, but you never
used this word in your answer. If any of these words were also not used by the other above average answer, they are marked with an asterisk.

The 'Top 10 words in above average answer 2 that you did not use' chart compares the words in your answer to the word in the second above average answer and reports the
top ten words that the above average answer used that you did not. For example, the first above average answer used the word 'while *' a total of 5 times in its answer, but you
never used this word in your answer. If any of these words were also not used by the other above average answer, they are marked with an asterisk.

The 'Top 10 words in the best answer that you did not use' chart compares the words in your answer to the word in the best answer and reports the top ten words that the best
answer used that you did not. For example, the best answer used the word 'certain' a total of 9 times in its answer, but you never used this word in your answer.

The words on these lists are words you should consider adding to your essay vocabulary, especially when dealing with Contracts type questions. For example, the 2nd most
used word in the released above average answers that you never used was the word 'hold'. It was used an average of 4.5 times in each of the released above average Essay #1
answers while you never used this word in your Essay #1 answer.

In the 'Word Comparison Statistics' chart, it compares what percentage of words in your essay appeared in the Question and in best and the above average answers. The Essay
to Question Comparison reports what percentage of the Question words appeared in the essay answers. For example, your Essay #1 answer contained 39.1% of the words in
the Question. The average among the 24 examinees was 42.7% of the words in the Question. In contrast, the first released above average answer contained 55.8% of the words
in the Question. The second released above average answer contained 48.6% of the words in the Question. For this Essay to Question Comparison, if your percentage is lower
than the above average answers, it means that you did not match the facts in the question to your answer as well as the above average answers.

In the 'Word Comparison Statistics' chart, the 'Essay to Answer 1 Comparison' compares what percentage of words in the essays that appear in the first released above average
answer. For example, your Essay #1 answer contained 47.1% of the words in the first released above average answer. The average among the 24 examinees was 39.7% of the
words in the first released above average answer. In contrast, the second released above average answer contained 58.2% of the words contained in the first released above
average answer.

In the 'Word Comparison Statistics' chart, the 'Essay to Answer 2 Comparison' compares what percentage of words in the essays that appear in the second released above
average answer. For example, your Essay #1 answer contained 40.7% of the words in the second released above average answer. The average among the 24 examinees was
36.7% of the words in the second released above average answer. In contrast, the first released above average answer contained 54.8% of the words contained in the second
released above average answer.

In the 'Word Comparison Statistics' chart, the 'Essay to Best Ans. Comparison' compares what percentage of words in the essays that appear in the best answer. For example,
your Essay #1 answer contained 40.8% of the words in the best answer. The average among the 24 examinees was 40.2% of the words in the best answer. In contrast, the first
released above average answer contained 51% of the words contained in the best answer.

The Best Avg Top 3 Column reports the averages for the top 3 highest scoring answers (the two released NYBOLE answers and the highest scoring examinee answer). For the
NYBOLE answers, I estimate the final score, but I find the estimated final score is fairly accurate. These averages provide a better insight into what the average top essay/MPT
consists of. For example, your Essay #1 answer contained 503 words while the average number of words in the top 3 answers was 546 words.

The Issue Spotting Analysis shows the words/phrases that the graders were looking for. The 'With Word' column reports how many examinees used that word along with the
average points these examinees received (green is above passing while red is below passing). For example, about 2.7% of examinees used the word/phrase 'terminate' and
received an average of 25 points for their essays (whereas a passing MEE essay received 13.3 points).

Copyright 2017 Seperac Bar Review LLC


Page 5 of 43
EXAMINEE NAME: Sample *********
NYS BAR EXAMINATION: FEB 2017
DATE OF REPORT: OCTOBER 21, 2017

MEE ANALYSIS
The purpose of the below analysis is to examine how well an MEE score corresponds with confirmable external sources such as the above average answers, point sheet, best
examinee answer, and the question itself. For example, if an examinee's MEE is highly correlated with these external sources, does the examinee receive a high grade?
Conversely, if an examinee's MEE is not highly correlated with these external sources, does the examinee receive a low grade? If another jurisdiction uses the same MEE for
their exam and releases above average exemplars, I also include these MEEs in the analysis (e.g. Arkansas is AR, Minnesota is MN). Examinees who participate in the
MEE/MPT Comparison should review cases where there is low correlation but a high score (for some insight on what to do) or a high correlation but a low score (for some
insight on what not to do). For example, if an exemplar has a low Essay to Point Sheet Comparison, what else did the grader find in that essay to warrant a high score? Since
the graders are probably constant with each exam, examinees can use this information to fashion a response similar to the responses that graders have graded favorably in the
past. On the below table, your MEE results are highlighted in yellow.

Examinee Written or Word Essay To Essay To Essay To Essay To Essay To Scaled


ID Laptop Count Question Answer 1 Answer 2 Best Point Weight Score Points % of 266

NY1 468 56% 100% 54% 51% 40% 301.3 90 24.81 9%


NY2 476 49% 58% 100% 47% 39% 293.6 90 24.81 9%
8 695 62% 48% 42% 100% 36% 287.5 67.7 18.73 7%
14 846 71% 58% 53% 59% 42% 282.8 47.2 13.13 5%
11 608 52% 46% 50% 52% 35% 233.8 58.8 16.3 6%
18 701 55% 50% 45% 45% 34% 229.3 51.7 14.36 5%
2 489 51% 44% 41% 44% 32% 212.8 44.6 12.43 5%
7 608 54% 42% 41% 40% 31% 208.2 42.9 11.96 4%
20 540 43% 44% 40% 44% 32% 203 50.3 13.99 5%
1 576 47% 43% 39% 40% 31% 200.1 53 14.7 6%
24 503 39% 47% 41% 41% 32% 199.8 59.1 16.37 6%
6 485 48% 43% 38% 39% 29% 197.6 45 12.54 5%
10 383 53% 37% 36% 42% 26% 193.5 40.7 11.37 4%
12 475 46% 38% 35% 40% 27% 187.2 37.6 10.5 4%
21 452 39% 38% 36% 37% 32% 182.2 50.3 13.99 5%
5 425 39% 37% 35% 38% 30% 178.8 65.1 18.03 7%
23 495 37% 41% 34% 35% 27% 174.3 43.9 12.24 5%
9 499 35% 38% 37% 33% 31% 173.9 44.6 12.43 5%
13 386 36% 38% 34% 36% 26% 170.3 52.6 14.6 5%
19 278 33% 37% 34% 34% 29% 165.3 55.7 15.45 6%
22 254 37% 34% 31% 30% 25% 156.1 31.9 8.97 3%
15 260 32% 33% 30% 32% 25% 152 37.6 10.5 4%
17 333 26% 32% 32% 29% 27% 144.8 45 12.54 5%
16 410 37% 30% 28% 27% 21% 142.2 40.2 11.21 4%
3 247 28% 30% 28% 28% 23% 137 44.6 12.42 5%
4 136 24% 23% 24% 21% 19% 110.2 38.8 10.84 4%
AR1 0 0% 0% 0% 0% 0% 0 80 22.08 8%
MN1 0 0% 0% 0% 0% 0% 0 80 22.08 8%

Word Essay To Essay To Essay To Essay To Essay To Scaled


Count Question Answer 1 Answer 2 Best Point Weight Score Points % of 266
You (ID 024) 503 39% 47% 41% 41% 32% 199.80 59.10 16.37 6%
Mean (28 MPTs) 430 40% 40% 37% 38% 28% 182.77 53.18 14.76 6%
Median (28 MPTs) 472 39% 38% 36% 39% 29% 184.70 48.75 13.56 5%

Copyright 2017 Seperac Bar Review LLC


Page 6 of 43
EXAMINEE NAME: Sample *********
NYS BAR EXAMINATION: FEB 2017
DATE OF REPORT: OCTOBER 21, 2017

MPT #1 GRAPHS: QUESTION - SCORE: 53.8

Essay to Question vs Score Grade Level vs Score


60 Score Linear (Score)

55 90
80
50 70
60
Score

45 Score
50
Linear (Score) 40
40
Expon. (Score) 30
35 20
10
30 0
0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19
Percentage of Essay to Word Grade Level

Essay to Answer 1 vs Score Essay to Answer 2 vs Score


60 60

55 55

50 50

Score
Score

45 Score 45 Score
Linear (Score) Linear (Score)
40 40
Expon. (Score) Expon. (Score)
35 35

30 30
0.1 0.2 0.3 0.4 0.5 0.6 0.1 0.2 0.3 0.4 0.5 0.6
Percentage of Essay to Word Percentage of Essay to Word

IRAC Intro Sentences vs Score IRAC Intros vs Score


60 Score Linear (Score)

55 90
80
50 70
60
Score

45 Score 50
Linear (Score) 40
40
Expon. (Score) 30
35 20
10
30 0
0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0 3 6 9 12 15 18 21 24 27
Percentage of IRAC Intros to Sentences Number of IRAC Intros

Different Words vs Score Word Count vs Score


90
Score Linear (Score)
80
70 90
60 80
50 70
40 60
30 50
20 40
10 30
0 20
100 120 140 160 180 200 220 240 260 280 300 320 340 10
0
Different Words 0 100 200 300 400 500 600 700 800 900 1000 1100 1200 1300 1400 1500
Score Linear (Score) Word Count

Copyright 2017 Seperac Bar Review LLC


Page 32 of 43
EXAMINEE NAME: Sample *********
NYS BAR EXAMINATION: FEB 2017
DATE OF REPORT: OCTOBER 21, 2017

MPT #1 CHARTS AND STATISTICS: BRIEF (FACTS/CONCLUSION) QUESTION - SCORE: 53.8

MPT #1 Passing Score 50.95 AVG, MIN, MAX and RANK Best Avg Top 20 words the MPT Drafter's Point
24 Examinees with Avg score of 45.7 Top 3 Sheet used that you did not
MPT #1 Statistics You Answer 1 Answer 2 Best AVG MIN MAX RANK AVG Rank MPT #1 Word #
Score 53.8 85 85 60.71 45.71 33.18 60.71 12 76.9 1 conflict 10
Words 904 3063 1625 1137 1092 374 2318 23 1942 2 roadsprinters 10
Characters 4581 16050 8506 5989 5666 1926 12312 23 10182 3 an 5.5
Paragraphs 23 1 19 24 23.2 7 65 13 15 4 may 5
Sentences 25 116 44 33 38.4 3 86 23 64 5 dawes 5
Sentences per Paragraph 2 116 3.3 2.2 2.7 1 6.4 21 40.5 6 one 3
Words per Sentence 32 26.4 35.4 31 26.6 12.8 40.6 4 30.9 7 members 3
Characters per Word 5 5.1 5 5.1 5 4.6 5.2 16 5.1 8 issue 3
Flesch Reading Ease 32.6 36.1 33.1 32.1 38.2 21.3 60 22 33.8 9 clients 2.5
Flesch-Kincaid Grade Level 16.6 14.1 16.5 16.5 14.4 7.8 20.3 3 15.7 10 analysis 2.5
IRAC Intro to Sentence 12.0% 12.9% 27.3% 9.1% 23.8% 8.7% 45.5% 4 16.4% 11 posing 2.5
12 communications 2.5
Word Size Breakdown You Answer 1 Answer 2 Best Avg Question 13 us 2.5
Words four letters and less 31.1% 23.9% 24.8% 28.2% 30.4% 22.4% 14 provide 2.5
Words five letters and less 42.1% 36.6% 37.7% 41.4% 42.0% 35.9% 15 since 2.5
Words seven letters and less 65.6% 62.1% 65.1% 63.9% 66.3% 62.6% 16 noted 2.5
Words ten letters and less 93.7% 91.4% 93.7% 93.5% 91.9% 91.3% 17 memorandum 2
Words more than ten letters 6.3% 8.6% 6.3% 6.5% 8.1% 8.7% 18 unlikely 2
19 rest 2
Top 10 words in above average 20 such 2
answer 1 that you did not use
IRAC Introductory Phrases You Answer 1 Answer 2 Best Average Rank MPT #1 Word #
The issue 0 0 0 0 0.3 1 roadsprinters 36 Top 20 words you used that the MPT
The question 0 0 0 1 0.0 2 conflict 24 Drafter's Point Sheet did not
Another issue 0 0 0 0 0.0 3 dawes 18 Rank MPT #1 Word #
Under 4 5 2 0 1.3 4 firm's 17 1 road 4
The rule 0 0 0 0 0.1 5 ms * 14 2 sprinters 4
The Rule 0 0 1 0 0.1 6 its 11 3 held 3
As a general 0 0 0 0 0.0 7 members 10 4 plaintiff 3
Generally 0 0 0 0 0.0 8 attorney 9 5 lawyer’s 2
The standard 0 0 0 0 0.0 9 adams 9 6 counsel 2
In the absence 0 0 0 0 0.0 10 bailey 9 7 following 2
Based on 0 2 0 0 0.2 8 position 2
Here 2 1 0 2 1.3 Top 10 words in above average 9 frequent 2
In this 0 0 0 0 0.1 answer 2 that you did not use 10 active 2
Assuming 0 0 0 0 0.0 Rank MPT #1 Word # 11 role 2
Although 0 0 0 2 0.5 1 roadsprinters 32 12 representative 2
Absent 0 0 0 0 0.0 2 conflict 14 13 directing 2
Because 0 2 0 1 0.1 3 may 12 14 “ 2
However 0 1 3 3 1.5 4 an 12 15 defendant 2
Instead 0 0 0 0 0.0 5 dawes 11 16 working 2
Secondly 0 0 0 0 0.1 6 firm's 8 17 actions 2
Furthermore 0 0 0 1 0.3 7 its 8 18 screen 2
Additionally 0 0 0 0 0.1 8 dawes' * 7 19 asked 2
In the 0 1 0 0 0.5 9 issue 7 20 e 2
It should be noted 0 0 0 2 0.1 10 v 7
Note 0 0 0 0 0.0 Top 15 words in the File/Library that both
In conclusion 0 0 1 1 0.1 For the Above Average Top 10 charts above, any word above avg. answers used but you did not
In closing 0 0 0 0 0.0 marked with an asterisk (*) means that the other Rank MPT #1 Word #
Thus 0 2 0 1 0.9 above average answer also did not use this word. 1 carlisle 26
Therefore 1 0 4 1 1.0 2 roadsprinters 17
As a consequence 0 0 0 0 0.0 Top 10 words in the best 3 one 17
Hence 0 0 0 0 0.1 answer that you did not use 4 dawes 15
Finally 1 1 1 0 0.2 Rank MPT #1 Word # 5 an 15
For the 0 0 0 0 0.1 1 roadsprinters 13 6 conflict 12
2 dawes 9 7 members 11
IRAC Intros Used 8 15 12 15 8.875 3 although 8 8 its 10
Different IRAC Intros Used 4 8 6 10 4.792 4 action 7 9 lawyer's 10
5 ashley 7 10 inc 9
6 conflict 6 11 them 9
Word Comparison Statistics You Answer 1 Answer 2 Best AVG 7 violation 6 12 lobbying 8
Essay To Question Comparison 30.7% 50.7% 46.4% 17.0% 29.6% 8 needed 6 13 clients 8
Essay To Answer 1 Comparison 37.2% 58.8% 41.2% 36.8% 9 attorney 6 14 may 8
Essay To Answer 2 Comparison 37.3% 59.1% 40.2% 37.0% 10 breach 5 15 thus 7
Essay To Best Ans. Comparison 44.5% 66.5% 64.5% 48.3%

Score Comparison Statistics Word Essay Grade Essay Essay to Essay IRAC to Essay
You versus other Examinees Count Score Level Score Quest. % Score Sentence Score
Your Essay 904 53.8 16.6 53.8 30.7% 53.8 12.0% 53.8
Overall Essay avg (24 examinees) 1092 45.7 14.4 45.7 29.6% 45.7 23.8% 45.7
Breakdown by Quartile
1st quartile avg (0-25 percentile) 919 40.5 13.1 52.3 25.7% 37.9 16.3% 46.6
2nd quartile avg (25-50 percentile) 1105 45.3 14.2 50.9 30.7% 47.1 21.3% 47.6
3rd quartile avg (50-75 percentile) 1520 63.0 15.4 50.9 37.6% 60.1 27.2% 49.7
4th quartile avg (75-100 percentile) 2318 60.9 20.3 53.0 50.3% 62.0 45.5% 58.0
Maximum and Minimum
Essay with highest 2318 51.3 20.3 36.9 50.3% 80.0 45.5% 60.7
Essay with lowest 374 36.9 7.8 37.7 16.3% 36.9 0.0% 0.0

Copyright 2017 Seperac Bar Review LLC


Page 33 of 43
EXAMINEE NAME: Sample *********
NYS BAR EXAMINATION: FEB 2017
DATE OF REPORT: OCTOBER 21, 2017

MPT #1 CHART AND STATISTICS EXPLANATIONS: BRIEF (FACTS/CONCLUSION) QUESTION - SCORE: 53.8

The 'Essay Statistics' chart reports a variety of statistics pertaining to MPT #1. The first data column reports your essay statistics. For example, your MPT #1 consisted of 904
words. The second data column reports the essay statistics for the first released above-average answer for MPT #1. For example, the first released above average answer for
MPT #1 had a Flesch-Kincaid Grade Level of 14.1 as compared to your Flesch-Kincaid Grade Level of 16.6. The third data column reports the essay statistics for the second
released above-average answer for MPT #1. For example, the second released above average answer for MPT #1 consisted of 44 sentences compared to 25 sentences in your
essay. The fourth data column reports the essay statistics for the highest scoring answer (best) submitted to me for MPT #1 (based on 24 examinees). For example, the best
answer for MPT #1 had an IRAC Intro to Sentence of of 9.1% compared to 12% in your essay.

The next four data columns of the 'Essay Statistics' chart report the average (AVG), maximum (MAX), minimum (MIN) and rank (RANK) essay statistics based on the essays of
24 examinees that failed the Feb 2017 exam and submitted their essays to me (the released essays are not counted in these statistics). As a result, the AVG columns show the
mean score for each essay statistic based on the MPT #1 essays of the 24 examinees that failed the Feb 2017 exam and submitted their essays to me. For example, the
average number of IRAC Intro to Sentences (number of IRAC intros divided by number of sentences) among the 24 examinees was 23.8% (meaning an average of 76.2% of
the examinee sentences did not begin with one of the IRAC Introductory Phrases listed above). On this essay, your total words of 904 words was 188 words less than the
average MPT #1 words of 1092 (based on the 24 submitted scores). Keep in mind these averages are only from those that failed - they may not accurately reflect the essay
statistics of all examinees. Please also note the analysis does not distinguish between laptop and handwritten essay scores.

The MAX and MIN columns report the highest score and lowest statistics for that category based on the MPT #1 essays of the 24 examinees that failed the Feb 2017 exam and
submitted their essays to me. Again, keep in mind these maximum and minimum numbers are only from those that failed - they may not accurately reflect the statistics of all
examinees. On this essay, your total words of 904 words was 530 words more than the minimum MPT #1 words of 374 words. In contrast, your total words of 904 words was
1414 words less than the maximum MPT #1 words of 2318 words (based on the 24 submitted scores).

The RANK column reports your rank for that category when compared to the scores of the 24 examinees that failed the Feb 2017 exam and submitted their scores to me. For
example, on MPT #1, your rank of 4 for 'MPT #1: Words per Sentence' means that 3 of the 24 examinees' Words per Sentence for MPT #1 were higher than your W ords per
Sentence of 32 while 20 of the examinees' Words per Sentence for MPT #1 were lower than your W ords per Sentence of 32 words per sentence. Meanwhile, the first released
above average answer for MPT #1 contained approximately 26.4 words per sentence and the second released above average answer for MPT #1 contained approximately 35.4
words per sentence.

The 'Word Size Breakdown' chart reports compares your MPT #1 word sizes to the words in the MPT #1 Question; the two released above average answers; and the averages
of the 24 examinees that failed the Feb 2017 exam and submitted their essays to me. For example, in your MPT #1 answer, 65.56% of your words were seven letters or less.
Meanwhile, in the MPT #1 Question, 62.59% of the words were seven letters or less. In the first released above average answer for MPT #1, 62.15% of the words were seven
letters or less. In the second released above average answer for MPT #1, 65.14% of the words were seven letters or less. For the 24 examinees, on average, 66.3% of the
words in their essay were seven letters or less. Therefore, your essay contained 0.7% less words that were seven letters or less as compared to the the 24 examinees that failed
the Feb 2017 exam and submitted their essays to me.

The 'Score Comparison Statistics' chart compares a number of statistics to the essay scores. The first row reports your essay statistics (for example, your essay had an Essay
to Question % of 30.7% and a score of 53.8. This means that 30.7% of the words in the Question appeared in your essay answer). The second data row reports the score
comparison statistics for the MPT #1 average of the 24 examinees who submitted essays. For example, these 24 essays had an Essay to Question % of 29.6% and an average
score of 45.71. Other statistics include Word Count vs Score, Grade Level vs. Score, and IRAC to Sentence vs. Score. For example, these 24 essays had a average Flesch-
Kincaid Grade Level of 14.4 (with average score of 45.71).

The 'Breakdown by Quartile' section of the 'score Comparison Statistics' chart compares the statistics to essay scores based on Quartile averages of the 24 examinees who
submitted essays. For example, the 1st quartile average (0-25 percentile) for W ord Count was 919 words with a score of 40.5; the 2nd quartile average (25-50 percentile) for
Grade Level was 14.2 with a score of 50.9; the 3rd quartile average (50-75 percentile) for Essay to Question percentage was 37.56% with a score of 60.1; and the 4th quartile
average (75-100 percentile) for IRAC to Sentence percentage was 45.45% with a score of 58. Keep in mind that the smaller the essay sample, the decreased statistical
significance of the quartile breakdowns.

The 'Minimum and Maximum' section of the 'score Comparison Statistics' chart shows the highest and lowest statistics for each category along with their corresponding scores.
For example, the essay with the highest word count consisted of 2318 words with a score of 51.26; the essay with the lowest Grade Level had a Grade Level of 7.8 with a score
of 37.67; the essay with the highest Essay to Question percentage was 50.35% with a score of 80; and the essay with the lowest IRAC to Sentence percentage was 0% with a
score of 0. Again, keep in mind that the smaller the essay sample, the decreased statistical significance of these superlatives.

The 'IRAC Introductory Phrases' chart reports how often you used certain IRAC phrases in your answer and compares your essay answer to the best answer and the two above
average answers. For example, for the phrase 'The issue', your essay used this IRAC phrase 0 times in your essay (Please note that the phrase 'The issue' covers instances of
'The issue is' or 'The issue is whether' or 'The issue here' or any other variant of 'The issue...'). In contrast, the first released above average answer used this IRAC phrase 0
times and the second released above average essay used this IRAC phrase 0 times. Among the 24 examinees, 24 of the 35 of the IRAC Intros I examined were used.

Copyright 2017 Seperac Bar Review LLC


Page 34 of 43
EXAMINEE NAME: Sample *********
NYS BAR EXAMINATION: FEB 2017
DATE OF REPORT: OCTOBER 21, 2017

The 'Top 20 words the above average answers used that you did not' chart compares the words in your answer to an average of the words in the two above average answers.
For example, the above average answers used the word 'roadsprinters' an average of 10 times in each of the released above average MPT #1 answers while you never used
this word in your MPT #1 answer. The list is sorted based on how often the words were used. For example, the 2nd most used word mentioned in the above average answers
that you did not use was the word 'an'. It was used an average of 5.5 times in each of the released above average MPT #1 answers while you never used this word in your MPT
#1 answer.

Please note that this chart is not filtered. The chart may report abbreviations or common words such as prepositions or names. Regardless, it is important to be aware what
words you did not use that the above average answers used, even if they are abbreviations or common words such as propositions. You should incorporate such common
words into your vocabulary when answering New York bar essay questions. By examining the differences, your goal should be to emulate the above average answer writing
style in your essay writing. For example, any word relating to the question or a legal principle is a topic or subject you likely missed in your answer.

The 'Top 20 words you used that the above average answers did not' chart compares the words in your answer to an average of the words in the two above average answers.
For example, you used the word 'road' a total of 4 times in your MPT #1 answer while the above average answers never used this word. As with the prior chart, please keep in
mind that this chart is not filtered, and common words or prepositions are included in the list.
The 'Top 15 words in the Question that both above average answers used but you did not' chart compares the words in your answer to an average of the words in the two above
average answers. For example, the word 'carlisle' was used in the Question a total of 26 times. Each above average answer used this word in their answer, but you never used
this word in your answer.
The 'Top 10 words in above average answer 1 that you did not use' chart compares the words in your answer to the word in the first above average answer and reports the top
ten words that the above average answer used that you did not. For example, the first above average answer used the word 'roadsprinters' a total of 36 times in its answer, but
you never used this word in your answer. If any of these words were also not used by the other above average answer, they are marked with an asterisk.

The 'Top 10 words in above average answer 2 that you did not use' chart compares the words in your answer to the word in the second above average answer and reports the
top ten words that the above average answer used that you did not. For example, the first above average answer used the word 'roadsprinters' a total of 32 times in its answer,
but you never used this word in your answer. If any of these words were also not used by the other above average answer, they are marked with an asterisk.

The 'Top 10 words in the best answer that you did not use' chart compares the words in your answer to the word in the best answer and reports the top ten words that the best
answer used that you did not. For example, the best answer used the word 'roadsprinters' a total of 13 times in its answer, but you never used this word in your answer.

The words on these lists are words you should consider adding to your essay vocabulary, especially when dealing with Brief (Facts/Conclusion) type questions. For example, the
2nd most used word in the released above average answers that you never used was the word 'an'. It was used an average of 5.5 times in each of the released above average
MPT #1 answers while you never used this word in your MPT #1 answer.

In the 'Word Comparison Statistics' chart, it compares what percentage of words in your essay appeared in the Question and in best and the above average answers. The Essay
to Question Comparison reports what percentage of the Question words appeared in the essay answers. For example, your MPT #1 answer contained 30.7% of the words in the
Question. The average among the 24 examinees was 29.6% of the words in the Question. In contrast, the first released above average answer contained 50.7% of the words in
the Question. The second released above average answer contained 46.4% of the words in the Question. For this Essay to Question Comparison, if your percentage is lower
than the above average answers, it means that you did not match the facts in the question to your answer as well as the above average answers.

In the 'Word Comparison Statistics' chart, the 'Essay to Answer 1 Comparison' compares what percentage of words in the essays that appear in the first released above average
answer. For example, your MPT #1 answer contained 37.2% of the words in the first released above average answer. The average among the 24 examinees was 36.8% of the
words in the first released above average answer. In contrast, the second released above average answer contained 58.8% of the words contained in the first released above
average answer.

In the 'Word Comparison Statistics' chart, the 'Essay to Answer 2 Comparison' compares what percentage of words in the essays that appear in the second released above
average answer. For example, your MPT #1 answer contained 37.3% of the words in the second released above average answer. The average among the 24 examinees was
37% of the words in the second released above average answer. In contrast, the first released above average answer contained 59.1% of the words contained in the second
released above average answer.

In the 'Word Comparison Statistics' chart, the 'Essay to Best Ans. Comparison' compares what percentage of words in the essays that appear in the best answer. For example,
your MPT #1 answer contained 44.5% of the words in the best answer. The average among the 24 examinees was 48.3% of the words in the best answer. In contrast, the first
released above average answer contained 66.5% of the words contained in the best answer.

The Best Avg Top 3 Column reports the averages for the top 3 highest scoring answers (the two released NYBOLE answers and the highest scoring examinee answer). For the
NYBOLE answers, I estimate the final score, but I find the estimated final score is fairly accurate. These averages provide a better insight into what the average top essay/MPT
consists of. For example, your MPT #1 answer contained 904 words while the average number of words in the top 3 answers was 1942 words.

Copyright 2017 Seperac Bar Review LLC


Page 35 of 43
EXAMINEE NAME: Sample *********
NYS BAR EXAMINATION: FEB 2017
DATE OF REPORT: OCTOBER 21, 2017

MPT ANALYSIS
The NY Essays and MPT are graded holistically. This means that the grader writes nothing on the essay/MPT itself but instead assigns the holistic score after reading the
entire answer. Holistic grading is less reliable than Analytic grading. In Analytic grading, the grader fills out a detailed scorecard that covers all of the issues a model answer
should address. This is one of many reasons as to why the Essays/MPT are less reliable than the MBE. However, I regard MPT grading as more reliable than Essay Grading
because MPT graders rely on a Point Sheet released by NCBE that covers all of the issues a model answer should address. Accordingly, high scoring MPTs are more similar
to other high scoring MPTs. As such, examinees should compare their MPT statistics to the statistics of the high scoring MPTs and make the appropriate adjustments. The
first table below illustrates your MPT score and MPT statistics as compared to other NY examinees, namely the First and Second Released Above Average Answers from
NYBOLE (Model1 & Model2), the highest scoring examinee MPT (Best) and an average of all the MPTs sent to me by examinees for this exam, both typed and hand-written
(NYAVG). The next table illustrates your MPT score and MPT statistics as compared to MPTs from other states that release MPT exemplars. Finally, there is a seperate
"StateAvg" column that averages all these released state exemplar MPTs to report the statistics of an average high scoring MPT. These statistics, coupled with the Essay/MPT
Comparison, is probably the most efficient way for an examinee to identify the deficiencies in their own MPT.

On the next page, I conduct an MPT analysis comparison based on adding each examinee’s MPT percentages for the following: (1) MPT File and Library; (2) NYBOLE
Released Answer 1; (3) NYBOLE Released Answer 2 Comparison; (4) the Highest Scoring MPT submitted by examinees; and (5) the MPT Point Sheet. For example, the First
Above Average Answer released by NYBOLE had an Essay To Question Comparison (i.e. File and Library) of 50.8%, an Essay To Answer 2 Comparison (i.e. Second released
NYBOLE above average answer) of 59.1%, an Essay To Best Ans. Comparison (i.e. highest scoring MPT of examinees who sent me their essays) of 66.5%, and an Essay To
Point Sheet Comparison (this MPT grading sheet is released by NCBE) of 57.5%. This answer was estimated to have contributed 46.9 to the examinee's final score, or 7% of a
passing score of 665 (while the MPT is worth 10% of the exam).

The purpose of such analysis comparisons is to examine how well an MPT score corresponds with confirmable external sources such as the above average answers, point
sheet, best examinee answer, and the file and library itself. For example, if an examinee's MPT is highly correlated with these external sources, does the examinee receive a
high grade? Conversely, if an examinee's MPT is not highly correlated with these external sources, does the examinee receive a low grade? If another jurisdiction uses the
same MPT for their exam and releases above average exemplars, I also include these MPTs in the analysis (e.g. Arkansas is AR1, Georgia is GA1-GA3, Indiana is IN1,
Maryland is MD1-MD2, Minnesota is MN1, Ohio is OH1, and Texas is TX1-TX4). I estimate the scores for these MPTs based on the top NY MPT scores and then I adjust
based on the size of the pool of examinees (e.g. the pool of TX MPTs is 27% the size of NY's pool of MPTs while the other states are even smaller - MD 13%, GA 12%; OH
11%; and MN 5% and AR 2%) since the best MPT from a much smaller jurisdiction may earn a lower score than the best MPT from a larger pool such as NY. Examinees who
participate in the Essay/MPT Comparison should review such cases, along with cases where there is low correlation but a high score (for some insight on what to do) or a high
correlation but a low score (for some insight on what not to do). For example, if an exemplar has a low Essay to Point Sheet Comparison, what else did the grader find in that
essay to warrant a high score? In regards to the NY MPTs, since the MPT graders are probably constant with each exam, examinees can use this information to fashion a
response similar to the responses that MPT graders have graded favorably in the past. On the below table, your MPT results are highlighted in yellow.

MPT Statistics - NY Examinees You Model1 Model2 Best NY AVG StateAvg


Score 53.8 85 85 60.71 45.71 78.0
Handwritten or Laptop Handwritten Laptop Laptop Laptop Laptop
Words 904 3063 1625 1137 1092 1802
Paragraphs 23 1 19 24 23.2 28.8
Sentences 25 116 44 33 38.4 75.6
Sentences per Paragraph 2 116 3.3 2.2 2.7 4.3
Words per Sentence 32 26.4 35.4 31 26.6 24
Flesch Reading Ease 32.6 36.1 33.1 32.1 38.2 33.2
Flesch-Kincaid Grade Level 16.6 14.1 16.5 16.5 14.4 14.0
IRAC Intros Used 8 15 12 15 8.875 17
Different IRAC Intros Used 4 0 0 0 4.792 8
Essay To Question Comparison 30.7% 50.8% 46.4% 32.0% 29.6% 41.5%
Essay To Answer 1 Comparison 37.2% 58.9% 41.4% 36.8% 48.5%
Essay To Answer 2 Comparison 37.3% 59.1% 40.2% 37.0% 49.6%
Essay To Best Ans. Comparison 44.5% 66.5% 64.5% 48.3% 54.0%
Essay To Point Sheet Comparison 40.0% 57.5% 60.6% 42.7% 38.2% 52.1%

MPT Statistics - Other State Exemplars AR1 MN1 TX1 TX2 TX3
Score 75 75 80 80 80
Handwritten or Laptop Laptop Laptop Laptop Laptop Laptop
Words 1479 1995 1520 2053 1962
Paragraphs 21 34 22 28 39
Sentences 74 93 44 82 85
Sentences per Paragraph 7.4 4.4 2.7 4.3 2.7
Words per Sentence 19.2 20.9 32.3 24.4 22.3
Flesch Reading Ease 35.1 37.1 29.4 29.8 34.8
Flesch-Kincaid Grade Level 12.8 13.1 16.2 14.5 13.4
IRAC Intros Used 18 14 12 18 25
Different IRAC Intros Used 11 7 6 9 6
Essay To Question Comparison 34.3% 44.9% 37.6% 50.3% 40.3%
Essay To Answer 1 Comparison 40.5% 53.9% 46.7% 53.7% 47.5%
Essay To Answer 2 Comparison 41.3% 53.8% 46.9% 55.2% 50.8%
Essay To Best Ans. Comparison 45.9% 59.2% 53.8% 57.7% 53.2%
Essay To Point Sheet Comparison 44.0% 57.0% 50.7% 56.6% 52.4%

Copyright 2017 Seperac Bar Review LLC


Page 36 of 43
EXAMINEE NAME: Sample *********
NYS BAR EXAMINATION: FEB 2017
DATE OF REPORT: OCTOBER 21, 2017

Examinee Written or Word Essay To Essay To Essay To Essay To Essay To Scaled


ID Laptop Count Question Answer 1 Answer 2 Best Point Weight Score Points % of 266

NY1 3,063 51% 100% 59% 66% 58% 313.9 85 46.88 18%
NY2 1,625 46% 59% 100% 65% 61% 310.4 85 46.88 18%
TX2 2,053 50% 54% 55% 58% 57% 273.5 80 44.16 17%
MN1 1,995 45% 54% 54% 59% 57% 268.6 75 41.44 16%
14 2,318 48% 52% 53% 62% 54% 268.1 51.3 28.48 11%
2 2,017 41% 52% 50% 62% 50% 255.4 36.9 20.62 8%
TX3 1,962 40% 48% 51% 53% 52% 244.3 80 44.16 17%
11 1,327 38% 46% 46% 55% 51% 236.7 59.1 32.78 12%
4 1,137 32% 41% 40% 100% 43% 236.3 60.7 33.64 13%
18 1,770 38% 47% 47% 56% 49% 235.9 51.7 28.72 11%
TX1 1,520 38% 47% 47% 54% 51% 235.6 80 44.16 17%
1 1,665 37% 48% 45% 53% 47% 229.4 51.4 28.58 11%
7 1,139 36% 45% 43% 50% 44% 218.8 51.6 28.66 11%
21 1,154 35% 42% 41% 51% 44% 212.5 51.6 28.66 11%
AR1 1,479 34% 41% 41% 46% 44% 206 75 41.44 16%
8 1,105 32% 41% 39% 54% 40% 205.4 50.6 28.12 11%
16 1,105 30% 38% 37% 52% 37% 194.7 49.6 27.54 10%
24 904 31% 37% 37% 45% 40% 189.7 53.8 29.86 11%
19 934 27% 34% 37% 45% 38% 181 58.4 32.34 12%
5 947 27% 36% 36% 45% 37% 180.3 51.6 28.66 11%
6 1,024 28% 34% 36% 45% 36% 178.3 36.7 20.56 8%
3 919 26% 32% 35% 41% 36% 170.9 42.9 23.9 9%
20 954 26% 32% 33% 46% 34% 170.9 35.2 19.7 7%
12 802 27% 32% 33% 43% 35% 169.4 36.9 20.62 8%
17 1,026 26% 32% 33% 41% 34% 165.3 43.7 24.34 9%
9 920 23% 31% 32% 41% 32% 158.2 36.9 20.62 8%
10 590 21% 28% 29% 37% 31% 146.4 42.2 23.52 9%
22 803 24% 28% 28% 38% 27% 144.8 33.2 18.62 7%
13 596 21% 28% 30% 34% 30% 143.8 36.7 20.56 8%
23 684 22% 26% 26% 35% 28% 137.5 37.7 21.06 8%
15 374 16% 21% 22% 30% 21% 110.7 36.9 20.62 8%
GA1 0 0% 0% 0% 0% 0% 0 80 44.16 17%
GA2 0 0% 0% 0% 0% 0% 0 80 44.16 17%
GA3 0 0% 0% 0% 0% 0% 0 80 44.16 17%

Word Essay To Essay To Essay To Essay To Essay To Scaled


Count Question Answer 1 Answer 2 Best Point Weight Score Points % of 266
Examinee (ID 024) 904 31% 37% 37% 45% 40% 189.70 53.80 29.86 11%
Mean (34 MPTs) 1,174 30% 38% 38% 46% 38% 188.02 55.80 30.95 12%
Median (34 MPTs) 1,066 30% 38% 37% 46% 39% 192.20 51.60 28.66 11%

Copyright 2017 Seperac Bar Review LLC


Page 37 of 43

EXAMINEE NAME:
NYS BAR EXAMINATION:
DATE OF REPORT:
Sample *********
FEB 2017
OCTOBER 21, 2017
INTRODUCTION AND EXPLANATIONS
EXAMINEE NAME:
NYS BAR EXAMINATION:
DATE OF REPORT:
Sample *********
FEB 2017
OCTOBER 21, 2017
ESSAY #1 GRAPHS: CONTRACTS QUE
EXAMINEE NAME:
NYS BAR EXAMINATION:
DATE OF REPORT:
Sample *********
FEB 2017
OCTOBER 21, 2017
ESSAY #1 CHARTS AND STATISTICS
EXAMINEE NAME:
NYS BAR EXAMINATION:
DATE OF REPORT:
Sample *********
FEB 2017
OCTOBER 21, 2017
ESSAY #1 CHART AND STATISTICS
EXAMINEE NAME:
NYS BAR EXAMINATION:
DATE OF REPORT:
Sample *********
FEB 2017
OCTOBER 21, 2017
The 'Top 20 words the above av
EXAMINEE NAME:
NYS BAR EXAMINATION:
DATE OF REPORT:
Sample *********
FEB 2017
OCTOBER 21, 2017
MEE ANALYSIS
NY1
468
56%
100%
EXAMINEE NAME:
NYS BAR EXAMINATION:
DATE OF REPORT:
Sample *********
FEB 2017
OCTOBER 21, 2017
MPT #1 GRAPHS:  QUESTION - SCO
EXAMINEE NAME:
NYS BAR EXAMINATION:
DATE OF REPORT:
Sample *********
FEB 2017
OCTOBER 21, 2017
MPT #1 CHARTS AND STATISTICS:
EXAMINEE NAME:
NYS BAR EXAMINATION:
DATE OF REPORT:
Sample *********
FEB 2017
OCTOBER 21, 2017
MPT #1 CHART AND STATISTICS EX
EXAMINEE NAME:
NYS BAR EXAMINATION:
DATE OF REPORT:
Sample *********
FEB 2017
OCTOBER 21, 2017
In the 'Word Comparison Statis

You might also like