Subjectivity and Judgement

Grading is not made unreliable merely because it contains judgement. The real distinction is between disciplined judgement and unsupported opinion. A collectible presents physical evidence—wear, marks, fading, completeness, manufacture, alteration, structural damage and overall appearance—but it does not contain a ready-made grade waiting to be discovered.

The grader must identify the evidence, decide what it means within the relevant collecting field and translate the complete condition profile into a limited grading vocabulary. Subjectivity enters that translation. Trustworthiness comes from making the judgement visible, constrained and repeatable rather than pretending it has disappeared.

Central grading principle

The evidence should be observable, but its significance must often be judged.

Collector scenario

Two careful collectors, one boxed toy, two grades

Both collectors identify a small rear-corner split, light shelf wear, an original insert and a figure that appears unused. One calls the object Excellent because the display face is strong and the contents are complete. The other calls it Very Good because the split weakens the packaging and that field places substantial weight on structural integrity.

The useful question is not simply which label is correct. It is whether both collectors defined the same graded unit, saw the same evidence, used the same standard and gave defensible weight to structure, completeness and presentation. Their disagreement may reveal a legitimate boundary judgement—or a hidden difference in method.

Orientation

Subjective does not mean arbitrary

Good grading does not remove judgement. It constrains judgement through evidence, definitions, comparison, declared standards and a repeatable procedure.

Objective observation

Independently detectable evidence

A corner is rounded. A page is detached. Centring is approximately 65/35. Ink has been added. A scratch crosses the principal image. One component is absent.

Evaluative judgement

Interpretation against a standard

The corner wear is moderate. The replacement materially affects originality. The scratch is too prominent for the proposed grade. The detached page controls the outcome.

Arbitrary opinion

A conclusion without traceable support

“It just feels like an 8.” “I like it, so I graded it higher.” “It is rare, so it deserves more tolerance.” Personal preference has replaced a grading method.

Core model

The three layers of grading judgement

Many disputes remain confused because observation, interpretation and classification are collapsed into one statement. Separating them creates an auditable path from object to grade.

Layer one

Observation: what is present?

Identify the physical evidence before assigning significance. Record wear, marks, fading, tears, losses, repairs, missing components, production irregularities, structural weakness and any limits on inspection.

  • A crease is present.
  • One accessory is missing.
  • Ink has been added to the surface.
  • The reverse has not been photographed.

Layer two

Interpretation: how significant is it?

Judge severity, location, visibility, structural effect, normality for the issue and interaction with other defects. This is where controlled subjectivity enters.

  • The crease is structurally minor but visually prominent.
  • The paint loss affects the figure's most recognisable feature.
  • The mark appears consistent with manufacture rather than later damage.

Layer three

Classification: what grade is supported?

Translate the complete condition profile into the declared grading vocabulary. The grade should follow the evidence and standard, not precede them.

  • The crease sets a ceiling below Near Mint.
  • The item sits at the upper end of Very Good.
  • A provisional range is more honest than an exact number.

Recognition

Where subjectivity enters the process

Judgement is required because defects cannot be understood by counting alone. Their importance depends on degree, position, interaction, context and the chosen standard.

Severity

Defects exist by degree

Minor, moderate, heavy, slight, prominent and distracting are not pure measurements. A grader must decide where an observed defect sits on a severity continuum and whether it is superficial, structural, stable or progressive.

Location

Position changes importance

A small scratch through a face, title, signature or principal image may matter more than a larger mark on a hidden underside. Total damaged area alone does not describe visual or structural significance.

Accumulation

Minor defects can become a major profile

Soft corners, light scratching, modest edge wear, slight fading and a small stain may each appear tolerable in isolation. Together they may place the item well below a high grade.

Weighting

Condition axes are not always equal

A severe crease, missing component, detached page, repair or altered edge may control the grade even when colour, gloss or presentation remain strong. The task is to distinguish grade-limiting evidence from secondary evidence.

Presentation

Similar defect lists can look different

Two objects may contain comparable technical flaws yet differ in balance, freshness, coherence and distraction. Eye appeal can refine a boundary judgement, but it must never erase major damage, restoration or incompleteness.

Standard

The same fact can carry different meaning

A production flaw, small mark or missing element may be treated differently across collecting fields and grading systems. The applicable standard must be named before the grade can be judged responsibly.

Why fixed point deductions fail

“One scratch equals minus one grade” appears objective but immediately breaks down. Scratches differ in length, depth, width, contrast, location, orientation, structural effect, visibility and origin. A short surface line on a hidden reverse is not equivalent to a deep scratch through a portrait, title or signature.

The more useful question is not how many defects exist, but what each defect is, how serious it is, where it appears, how it affects the object and whether it exceeds the tolerance of the proposed grade.

Judgement

The controlling issue and the total condition profile

A grade must account for both the most consequential defect and the way all condition evidence combines.

Grade ceiling

When one defect controls the grade

A severe crease, structural break, missing component, detached page, alteration, restoration, repainting or major stain may prevent an object reaching a higher grade even when other features are strong.

The collector should name this issue explicitly: “The crease prevents a Near Mint grade and is the principal grade-limiting defect.”

Cumulative condition

When no single flaw tells the whole story

Several minor defects may collectively produce a lower-grade object even though none appears individually decisive. The grade must reflect the whole profile rather than the most convenient isolated fact.

A useful rule is: the most consequential defect usually sets the ceiling; the complete condition profile determines the position beneath that ceiling.

Condition axes

Assess complex objects by component before assigning an overall grade

Component assessment reduces the risk that a strong display face, attractive colour or desirable feature conceals structural weakness, incompleteness or alteration elsewhere.

Surface

Preservation of the visible material

Scratches, stains, gloss loss, oxidation, cleaning, abrasions, indentations and added colour.

Edges and corners

Peripheral wear and deformation

Chipping, tears, fraying, splitting, compression, rounding, crushing and missing material.

Structure

Soundness, attachment and function

Loose bindings, detached elements, stress fractures, weak joints, broken mechanisms and instability.

Colour and finish

Change in appearance over time

Fading, yellowing, colour shift, uneven exposure, loss of lustre, discolouration and patchiness.

Completeness

Presence of the defined graded unit

Original accessories, inserts, packaging elements, pages, components and attachments.

Originality

Alteration, replacement and restoration

Repainting, trimming, replaced parts, retouching, cleaning, repairs and reproduction components.

Manufacture

How the object originally left production

Print defects, rough cuts, weak strikes, casting seams, overspray, crimps, binding irregularities and assembly variation.

Presentation

Combined visual effect

The balance, prominence and interaction of all defects when the object is viewed as a whole.

Eye appeal

Necessary refinement or dangerous loophole?

Eye appeal can describe the combined visual effect of condition-related characteristics, but it becomes unreliable when it acts as permission to ignore evidence.

Defensible use

  • The technical evidence has already been recorded.
  • The item lies near a genuine grade boundary.
  • The grading system permits presentation to influence placement.
  • The adjustment remains within defined tolerances.
  • The reasoning can be explained to another collector.

Misuse

  • Overriding structural damage, restoration or incompleteness.
  • Turning rarity, fashion, price or desirability into condition.
  • Allowing attractive items to escape stated defect limits.
  • Using taste as an unexplained source of grade inflation.
  • Calling an object high grade merely because it displays well.

Context

Technical, market and descriptive grading

Different traditions may operate beneath similar grade labels. The collector should know what kind of judgement the system is designed to express.

Technical grading

Emphasises physical evidence: wear, marks, structural integrity, originality, alteration, surface preservation and completeness. Commercial preference should have minimal influence.

Market grading

Interprets condition through established field conventions, accepted production quality, issue-specific expectations and market acceptance. It does not mean choosing the grade that produces the desired price.

Descriptive grading

Records overall grade alongside component condition, major defects, completeness, restoration, originality, presentation and uncertainty. For complex collectibles, this can be more informative than a bare number.

Descriptive example

Overall Very Fine. Figure appears Near Mint with light paint rub to the left hand. Bubble remains clear but has a lower-corner dent. Card has moderate edge wear and a small price-sticker pull. One accessory is missing. A single “7” cannot communicate all of this.

Boundaries

A strong lower-grade example is not automatically the next grade

Grade boundaries are judgement zones. The higher grade should be awarded only when the complete condition profile remains acceptable within that grade—not merely because the object is better than an average example of the lower grade.

Boundary test

  • Does the object fully satisfy the higher grade?
  • Does it only barely satisfy that level?
  • Is it exceptional for the grade below?
  • Does a defect formally disqualify the higher grade?
  • Would a qualifier, details grade or component description be clearer?

Bias control

Human judgement needs procedural safeguards

Experience can improve judgement, but confidence alone does not control ordinary cognitive bias. Graders need habits that make bias easier to detect and correct.

Anchoring

Starting from someone else's grade

A seller's description, slab label, auction estimate or prior opinion becomes the starting point. Control it by recording evidence before consulting previous grades where practical.

Halo effect

One strong feature hides unrelated weaknesses

Brilliant colour, lustre, a bold signature or rarity can make the whole object feel better than its complete condition profile warrants. Inspect each axis independently.

Horn effect

One disliked feature dominates too much

Toning, writing, a price sticker or a cosmetic flaw may provoke excessive downgrading even when the standard treats it as limited. Ask whether it formally caps the grade or merely affects appeal.

Confirmation bias

The provisional grade filters later evidence

Once a number is formed, contradictory evidence may be minimised. Conduct a deliberate second pass looking for reasons the first judgement may be wrong.

Ownership bias

Personal history changes perception

Purchase price, rarity, effort, sentiment and hoped-for value can soften judgement. Reinspect the object as though it were an unfamiliar example being offered to you for purchase.

Context effect

Recent comparisons distort the scale

An item can look unusually strong after poor examples or unusually weak after exceptional ones. Compare against fixed references, not only against the last objects examined.

Action

A disciplined grading judgement workflow

The sequence matters. Grade last, after defining the unit, inspecting the object, separating fact from interpretation and identifying the controlling evidence.

01

Define the graded unit

State whether the assessment covers the item alone, item and packaging, a complete set, a signature, an assembled object or individual components.

Ask: Are two graders judging the same thing?

02

Declare the standard

Record the grading service, guide, scale, category, version and whether technical, market, descriptive, qualified or details conventions apply.

Ask: What does this grade word or number mean here?

03

Inspect before grading

Describe the evidence without assigning a number. This reduces anchoring and makes omissions easier to detect.

Ask: What is physically present, absent or uncertain?

04

Separate fact from interpretation

Keep observable evidence distinct from severity and significance. For example: three colour-breaking spine ticks are present; one is moderate because it crosses the title field.

Ask: Which statements could another examiner verify directly?

05

Assess each condition axis

Review surface, edges, corners, structure, colour, completeness, originality, manufacture and presentation rather than relying on a single overall impression.

Ask: What might an attractive front be hiding?

06

Identify grade ceilings

Ask whether a defect prevents the object reaching particular grades regardless of its strengths elsewhere.

Ask: Which issue is potentially disqualifying?

07

Judge cumulative effect

Consider whether several individually minor defects create a materially weaker whole condition profile.

Ask: Do the defects reinforce one another?

08

Use presentation cautiously

Only after technical assessment should eye appeal influence a boundary decision, and only where the standard permits it.

Ask: Is presentation refining the judgement or overriding evidence?

09

Compare with calibrated references

Use published descriptions, photographic examples, known graded specimens, personal reference sets and previous comparable decisions.

Ask: What examples define the upper and lower boundary?

10

Challenge the provisional grade

Make the strongest case for the grade below. Ask whether you are excusing a defect because the object is rare, valuable, old or personally desirable.

Ask: Would I grade it the same if it were common and inexpensive?

11

Record the reasoning and confidence

Write a concise explanation identifying the controlling issue, relevant strengths, inspection limits and what further evidence could change the result.

Ask: Can another collector reconstruct how this conclusion was reached?

Evidence model

Make the reasoning traceable

For every significant observation, record evidence, meaning and grading consequence. This exposes unsupported leaps and makes later review possible.

Evidence

A diagonal 18 mm crease begins at the lower-right corner and enters the principal image.

Meaning

It breaks the surface, remains visible under normal light and occupies a focal display area.

Grading consequence

The crease prevents a Near Mint grade and is the principal grade-limiting defect.

Uncertainty

Photographic grading and grade ranges

Remote assessment increases subjectivity because photographs can conceal or exaggerate surface, texture, colour, structure and restoration. Precision should decrease when evidence quality decreases.

What photographs may not show reliably

Gloss loss, shallow dents, fine scratches, rippling, transparency, warping, odour, brittleness, looseness, internal damage, cleaning and subtle colour alteration. Lighting, sharpening, compression and viewing angle can all change apparent severity.

Responsible wording

  • Apparent grade from supplied images.
  • Estimated range pending physical inspection.
  • Surface condition cannot be fully assessed.
  • Reverse, interior or underside not shown.
  • Would move higher or lower if the unresolved feature is confirmed.

A range such as “strong 7 / possible low 8,” “Fine to Very Fine,” or “likely 8 with surface uncertainty” is not a failure to decide when it accurately represents a real boundary or inspection limit. The aim is not to sound precise. It is to communicate condition faithfully.

Calibration

Judgement becomes reliable through comparison, not confidence alone

Calibration turns repeated experience into controlled expertise and helps identify personal tendencies before they become systematic grading errors.

Build reference sets

Keep clear grade representatives, upper and lower boundary examples, common production flaws, common restoration, strong and weak examples within the same grade and known problem cases.

Grade blind where possible

Hide price, seller description, population data, previous grade and owner identity until the independent assessment is complete.

Regrade after a delay

Compare the defects identified, severity language, final grade and written explanation. Repeated drift reveals where the method is unstable.

Analyse disagreement

Establish whether graders differed in observation, severity, manufacture, standard, graded unit, eye appeal or boundary placement. The cause matters more than the fact that two numbers differ.

Disagreement

Reasonable variation versus grading failure

Subjectivity explains some variation. It does not excuse careless observation, unsupported conclusions or changing the criteria to reach a desired result.

Reasonable variation

  • Adjacent grades on a genuine boundary case.
  • Small differences in severity terminology.
  • Limited disagreement about eye-appeal influence.
  • Different weighting of dispersed minor defects.
  • Uncertainty caused by incomplete images or access.

More serious failure

  • Missing a major defect, repair or absent component.
  • Ignoring restoration or alteration.
  • Applying the wrong standard or graded unit.
  • Allowing price, rarity or sentiment to influence grade.
  • Giving an exact grade despite inadequate evidence.

Collector risk

How subjective judgement can be exploited or misunderstood

Grade shopping

Repeated submission may eventually produce a preferred higher grade, but it also demonstrates that a boundary judgement is not a fixed physical measurement.

Label dependence

Buying the number rather than the object can hide unattractive quality within the grade, weak originality, poor component condition or defects that matter personally to the collector.

Boundary-price distortion

A small grading difference may produce a large price difference even when the physical distinction between the objects is slight.

Hidden qualifiers

An overall grade can obscure missing parts, damaged packaging, restoration, poor page quality, replacement accessories or a weaker reverse.

Myths

Myths and realities

Myth

A subjective grade is merely an opinion.

Reality

A defensible grade is an expert conclusion constrained by observable evidence, a declared standard, comparison and repeatable method.

Myth

Measurement removes subjectivity.

Reality

Measurements still require decisions about where and how to measure, what counts as irregular manufacture and which tolerances belong to each grade.

Myth

Every defect should receive a fixed point deduction.

Reality

Defect significance depends on nature, severity, position, interaction, structure and the collectible being assessed.

Myth

Eye appeal permits technical defects to be ignored.

Reality

Eye appeal can refine a boundary judgement. It cannot legitimately erase serious damage, alteration, restoration or missing components.

Myth

Old or rare objects deserve a higher grade.

Reality

Age and rarity affect context, scarcity and value. They do not improve physical condition.

Myth

Two different grades prove grading is meaningless.

Reality

Adjacent disagreement may be reasonable at a boundary. Missing major defects, applying the wrong standard or giving unsupported precision is a different matter.

Documentation

Language that strengthens a grading record

Useful wording identifies the evidence, controlling issue, boundary position and inspection limits. It does not hide behind confidence or vague praise.

Prefer

  • “The front presents at a higher level than the reverse.”
  • “The grade is controlled by the crease rather than the corner wear.”
  • “Strong colour improves presentation but does not remove the structural defect.”
  • “The mark appears production-related, pending physical inspection.”
  • “The object lies near the upper boundary of the grade.”

Avoid

  • “Looks mint to me.”
  • “Good for its age.”
  • “Basically perfect.”
  • “It should grade highly because it is rare.”
  • “Everyone grades differently.”

Specialist threshold

Escalate when the judgement depends on evidence beyond ordinary inspection

Seek an appropriate specialist when condition cannot be separated confidently from manufacture, when restoration or cleaning is suspected, when a material may be unstable, when hidden structure affects the grade, or when a high-value boundary decision requires controlled lighting, magnification or comparative expertise.

The specialist is not valuable merely because they provide a more confident number. Their value lies in better observation, field-specific standards, reference material and a defensible explanation of uncertainty.

Key takeaways

  • Grading is a translation of complex condition evidence into a limited vocabulary; judgement is unavoidable.
  • Responsible subjectivity begins by separating observation, interpretation and classification.
  • The most consequential defect may set the grade ceiling, but the complete condition profile determines the final position.
  • Eye appeal may refine a boundary judgement; it must not erase major damage, alteration, restoration or incompleteness.
  • Age, rarity, value, ownership and personal tolerance must be kept separate from physical condition.
  • Grade ranges, qualifiers and provisional wording are signs of discipline when evidence is incomplete or genuinely borderline.
  • The most trustworthy grader can show where judgement entered, what evidence constrained it and why the result is defensible.

Continue learning

Related topics