Research Planning

Research planning is the deliberate design of an investigation before substantial evidence gathering begins. In collectibles, it connects a question to a defensible conclusion by deciding what is being investigated, why it matters, what evidence could answer it, where that evidence will be sought, how conflicts will be judged, how limits will be recorded and when the work is sufficient for its purpose.

This is not bureaucracy added to a hobby. It is protection against a familiar failure: screenshots, marketplace claims, catalogue extracts and community opinions accumulate, yet the collector can no longer explain which proposition was tested or why the final answer deserves confidence. A good plan does not prejudge the answer. It establishes how the answer will be sought, challenged and expressed without manufacturing certainty.

COLLECTOR SCENARIO

More searching, but no clearer answer

A collector finds a boxed item with one date on the leaflet, another on the packaging and a dealer description calling it an early issue. They open six browser tabs, save auction photographs and ask a specialist group. An hour later they have more material, but they have mixed at least four questions: what the object is, when the packaging was printed, whether the leaflet belongs with it and whether the dealer's early-issue claim is justified.

The better first move is quieter: write the primary question and separate the others. Each claim requires different evidence. Without that distinction, useful facts can be collected while the wrong problem is answered.

Orientation

What a research plan is meant to control

The useful unit of research is normally the claim, not the whole object. Planning makes that claim visible, limits the investigation and defines the standard by which the evidence will later be judged.

CONTROL THE QUESTION

Convert broad curiosity into a testable problem

Researching an object is too broad. A plan identifies the proposition that needs testing: which printing this is, whether a component belongs with the object, whether a colour difference is a production state, or whether an ownership story can be documented.

CONTROL THE SCOPE

Prevent one investigation becoming five

Identification can drift into pricing, rarity, company history, designer biography and provenance. Related subjects may matter, but they should be separated into core, supporting, out-of-scope and future questions so the original investigation can still finish.

CONTROL THE EVIDENCE

Match each claim to evidence capable of supporting it

A sale listing may locate a comparison object but cannot by itself prove production quantity. A copyright date may establish a not-before date but not the manufacture date of the copy in hand. Planning prevents convenient evidence being asked to do work it cannot responsibly do.

CONTROL THE CONCLUSION

Decide how uncertainty and stopping will be handled

The plan should define what would count as confirmed, probable, possible or unresolved, what evidence could change the view, and when further searching would be disproportionate or require specialist support.

Method

The planned research journey

Research methodology is iterative, but it should not be shapeless. The plan governs the early stages and sets the rules for the later ones. New evidence may change the question, but the record should show when and why that happened.

01

Define the problem

State the collecting decision or knowledge need. Is the work supporting identification, purchase due diligence, catalogue classification, authentication, provenance reconstruction, valuation, insurance, publication or a dispute?

02

Formulate the primary question

Write one neutral question that is specific, answerable in principle and narrow enough to manage. It should not assume the conclusion it is meant to test.

03

Set the scope and definitions

Define the objects, dates, regions, features, evidence types and outputs included. Define unstable terms such as variant, edition, state, issue, authentic, original, complete and rare.

04

Identify candidate explanations

List plausible alternatives before interpreting the evidence. For an apparent variant these might include deliberate change, normal production variation, ageing, repair, replacement, photography effects or modern alteration.

05

Design the evidence model

Specify what would support, weaken or distinguish each explanation. Separate identification, dating, production, distribution, provenance, market and contextual evidence rather than allowing confidence to leak between them.

06

Plan the search and examination

Prioritise sources, search terms, object photography, measurements, handling conditions, comparison groups and recording methods before the evidence becomes contentious.

07

Evaluate, compare and triangulate

Judge relevance, proximity, independence, specificity, source authenticity, competence, bias and corroboration. Seek agreement across different evidential routes rather than repeated versions of the same claim.

08

Conclude provisionally and preserve the trail

Record the conclusion, confidence, contradictory evidence, open questions, rejected alternatives and stopping reason. A catalogue entry records the current state of knowledge; it does not close the subject forever.

Framing

Write the question without writing the answer

A primary question should be specific, neutral, evidence-led and answerable in principle. “Prove that this is the rare first version” is advocacy. “Which production category best explains the observed features?” is research.

Supporting questions should break the problem into tests that contribute directly to the primary question. For an apparent blue-backed rulebook, those tests might ask whether the difference is repeatable, whether it clusters with other printing features, whether dated evidence places it in sequence, and whether fading, repair or image processing could explain the appearance.

QUESTION THAT PREJUDGES THE RESULT

“How can I prove this is a prototype?”

QUESTION THAT CAN TEST ALTERNATIVES

“Which stage of production best explains this object's features and history?”

Candidate explanations for an undocumented difference

  • Deliberate production state: an intentional change introduced during manufacture or authorised distribution.
  • Incidental production variation:ordinary differences in ink, paper, moulding, cutting, assembly or supplier materials.
  • Post-production change: fading, oxidation, storage, repair, restoration, cleaning or component substitution.
  • Documentation or photography effect:lighting, scanning, colour balance, enhancement or inaccurate description.
  • Modern alteration or fabrication: a later modification or reproduction presented as an undocumented historical state.

Scope

Draw boundaries before the subject expands

Scope is not merely a word count or deadline. It defines which objects, periods, places, features, evidence routes and outputs belong to this investigation. What is excluded should be recorded as deliberately as what is included.

OBJECT SCOPE

What counts as part of the study?

One physical object, one product, a particular printing, all known states, one mould family, a regional release, a promotional campaign or a population of examples. State exclusions as clearly as inclusions.

TIME SCOPE

Which chronology is being studied?

Design, manufacture, original distribution, ownership history and market appearances are different timelines. A publication date should not be confused with a later sale date or the date a surviving copy was acquired.

GEOGRAPHIC SCOPE

Which markets or production locations matter?

Country, language, distributor, retailer, factory, regulatory region and export destination may all affect what counts as an issue or first release. A first edition in one market may not be first elsewhere.

FEATURE SCOPE

Which characteristics will be examined?

Text, typography, logos, colour, dimensions, weight, material, binding, collation, packaging, accessories, markings, serial structure, defects and internal components should be selected because they answer the question, not merely because they are visible.

EVIDENTIAL SCOPE

Which evidence routes are permitted?

Physical examination, archives, catalogues, auction records, collector reports, oral testimony, scientific analysis, provenance work and market statistics each have different costs and limitations. Decide what the project can responsibly use.

OUTPUT SCOPE

What will the research produce?

An identification note, catalogue entry, variant matrix, population census, provenance timeline, valuation report, database record, article or authentication opinion requires a different level of formality and evidence.

Definitions

Stabilise collector terminology

Collector language is often category-dependent and historically inconsistent. Edition, printing, impression, state, issue, variant, release and prototype may be used differently across books, cards, toys, games, coins and manufactured objects. The plan should state the working definition instead of assuming every source uses the same one.

A defensible working definition of variant

A recurring and identifiable difference between examples of the nominally same product that arose before or during original manufacture or authorised distribution.

Unless the project explicitly studies them, this definition excludes damage, fading, owner modification, restoration, replacement components, random manufacturing irregularities and modern reproductions. Another project may choose a different definition, but it should make that choice visible.

Rarity needs a measure

Production quantity, confirmed surviving population, public appearances, ratio to a comparison item, regional availability and ownership concentration answer different questions. “Hard to find” is an impression until the project defines what is being counted and over what period.

Authenticity needs a proposition

Period-authentic, made by the claimed producer, officially distributed, retaining original components, materially unaltered and genuinely associated with a person are separate claims. An item may satisfy one and fail another.

Evidence design

Ask each evidence stream to do one job

Evidence should be organised by function before it is ranked by perceived prestige. Strong provenance does not automatically prove a precise production sequence. A good catalogue match does not prove that the packaging is original to the individual object. Each route should earn its own confidence.

IDENTIFICATION

Evidence showing what the object is

Marks, format, construction, dimensions, materials, catalogue numbers, contents, packaging and comparison with accepted examples.

DATING

Evidence showing when it was made, issued or owned

Dated catalogues, advertisements, invoices, price lists, correspondence, photographs, announcements, manufacturing codes, postal marks and ownership records.

PRODUCTION

Evidence showing how it was made

Printer or factory records, mould characteristics, production samples, tooling marks, material analysis, assembly sequence, supplier records and informed participant testimony.

DISTRIBUTION

Evidence showing how it entered circulation

Distributor catalogues, dealer lists, retailer advertisements, order forms, shipping cartons, regional labels, promotional documents and contemporary reviews.

PROVENANCE

Evidence showing ownership and custody

Receipts, inventories, auction and dealer records, labels, inscriptions, correspondence, photographs, wills, estate documents and insurance schedules.

MARKET

Evidence showing commercial exchange

Realised prices, unsold listings, asking prices, offer duration, buyer premiums, currency, date, venue, condition and completeness. Each variable affects comparability.

Source strategy

Plan where to look and in what order

Source order should reflect the question, but a useful default is to document the object, locate contemporary material, search authoritative archives, consult specialist literature, examine auction and dealer records, review collector knowledge, seek informed testimony and use scientific or technical testing only where justified. Then return to the object in light of what was learned.

PRIMARY

Close to the object, event or period

The object, packaging, instructions, catalogues, advertisements, receipts, correspondence, manufacturing records, photographs, sales ledgers and participant testimony. Primary does not mean infallible: advertisements exaggerate, invoices contain errors and memories decay.

SECONDARY

Analysis and interpretation of primary evidence

Reference books, specialist catalogues, journal articles, museum essays, historical studies and researched websites can establish terminology, chronology and existing interpretations, and point towards archives or original records.

DISCOVERY

Useful for locating evidence, weak as final proof

Search snippets, aggregators, crowd-edited summaries, social posts and AI-generated text can reveal names, phrases and possible sources. They should normally be treated as leads until the underlying evidence is found and assessed.

Build a search-term matrix before searching

Record formal and collector names, catalogue and stock numbers, former company names, designers, distributors, retailers, licence holders, series, countries, languages, date ranges, abbreviations, spelling variations and previous owners. Different sources require different search language: a library catalogue may use a corporate author, while an auction archive may depend on the former collection or lot wording.

  • Record the database or archive, date, terms, filters and pages reviewed.
  • Keep no-result searches as part of the evidence trail.
  • Save stable references, images or copies where rights and access allow.
  • Record the follow-up action so the same work is not repeated unknowingly.

Object evidence

Plan the examination before handling the object

Object examination is not simply looking closely. The plan should control lighting, magnification, measurement, scales, photography, handling and whether packaging may be opened. Destructive testing should be prohibited unless it is necessary, proportionate, authorised and undertaken by an appropriate specialist.

MINIMUM PHOTOGRAPHIC RECORD

  • Front, back, sides, top and bottom.
  • Marks, labels, seams, fasteners and internal components.
  • Damage, repairs and suspected alterations.
  • Scale reference and comparison views.
  • Lighting and colour-control information where colour is evidential.

MEASUREMENT PROTOCOL

  • State units, precision and instrument used.
  • Define exactly where each measurement begins and ends.
  • State whether packaging and accessories are included.
  • Set a realistic tolerance for handmade or mass-produced variation.
  • Repeat the same method across all comparison objects.

Controlled values make comparison possible

Prose remains important, but repeated features should be recorded consistently: logo position, staple count, print colour, base marking, insert presence and modification status. A difference of one millimetre or a subtle shade is meaningless if each example was measured or photographed differently.

Comparison

Surviving examples are not a neutral sample

Objects visible online are more likely to be valuable, attractive, complete, unusual, graded, English-language or held by active collectors. A census built from volunteered examples may overrepresent advanced collections and rare states. Frequent market appearances do not prove high original production, and absence from the visible market does not prove rarity.

Define the population before counting the sample

“All copies ever produced,” “all known survivors,” “all museum holdings,” “all examples observed between 2015 and 2025” and “all objects submitted by collectors” are different populations. The result should never silently move from one to another.

Record how each comparison entered the study: physical examination, owner submission, auction images, dealer inventory or institutional record. Include accepted examples, nearby production periods, known reproductions, altered objects, related products and different regions. One unusual object rarely establishes a recurring variant by itself.

A compact evidence matrix

ClaimRequired evidenceCurrent position
Issued commerciallyCatalogue, advertisement, invoice or distributed examplesCatalogue found; no invoice - probable
Colour intentionalRepeated examples and correlated production featuresFour consistent examples - highly probable
Earlier than red versionDated advertisements, receipts or owner photographsConflicting dates - unresolved
Only 500 producedProduction record or contemporary statementLater dealer claim only - unsupported

Judgement

Set evidence rules before the difficult source appears

A universal hierarchy is dangerous because the strongest evidence depends on the question. Direct physical examination may be decisive for construction but irrelevant to an undocumented owner. The plan should therefore define evaluation criteria before a prestigious, expensive or emotionally attractive source tempts the collector to change the standard.

RELEVANCE

Does it address the exact proposition?

Evidence about the product family may not resolve the exact printing, regional issue or ownership event. Broadly related material should not be presented as direct support.

PROXIMITY

How close is it to the event?

A contemporary record, later recollection, second-hand report and collector tradition occupy different evidential positions. Closer is often useful, but still requires interpretation.

INDEPENDENCE

Are apparently separate sources actually separate?

Five listings copying one dealer description form one evidential chain, not five confirmations. Trace claims backwards wherever possible.

SPECIFICITY

Can the source be checked?

Exact names, dates, identifiers, photographs, references and repositories are stronger than vague recollection or unsourced certainty.

COMPETENCE

Was the source in a position to know?

A designer may know the design history but not production quantity. A salesperson may know distribution but not the printing sequence. Expertise must match the claim.

BIAS AND INCENTIVE

What might shape the account?

Commercial interest, ownership, reputation, dispute involvement, desire for rarity or memory protection do not automatically invalidate evidence, but they affect weight and disclosure.

Triangulation is more than collecting several sources

Dating a boxed toy might combine a physical route (logo, materials and legal wording), a documentary route (catalogues and advertisements), a provenance route (a dated receipt or photograph), a market route (earliest traceable appearance) and a technical route (packaging construction or print process). Agreement across independent routes increases confidence. Disagreement identifies the part of the claim that needs more work.

Evidence quantity is not the same as evidence independence. Ten websites repeating the same auction description remain one claim until a separate evidential origin is found.

Uncertainty

Plan how conclusions will be worded

Confidence labels are useful only when they correspond to defined criteria. They should not decorate a conclusion or conceal uncertainty behind a numerical-looking badge.

CONFIRMED

Direct, strong evidence with meaningful independent corroboration.

HIGHLY PROBABLE

Strongly supported with only minor unresolved gaps.

PROBABLE

The best-supported explanation, but meaningful uncertainty remains.

POSSIBLE

Consistent with the evidence but not distinguished from alternatives.

UNRESOLVED

The available evidence does not favour one explanation responsibly.

DISPROVED

Contradicted by reliable evidence relevant to the exact claim.

Keep fact, inference and speculation visibly separate

OBSERVED FACT

The examined copy has a three-line copyright notice.

DOCUMENTARY FACT

The 1983 distributor catalogue lists stock number 1047.

INFERENCE

The stock-number change probably accompanied the packaging revision.

SPECULATION

The revision may have followed retailer complaints.

Stopping

Decide when the investigation is sufficient

Research can continue indefinitely. “Complete” rarely means that no new evidence could ever appear. It means the question has been answered to the standard required for the intended decision, or that further work cannot presently reduce the uncertainty at a proportionate cost.

  • The primary question has been answered to the required standard.
  • All priority sources have been searched and recorded.
  • Remaining sources are inaccessible or disproportionate in cost or risk.
  • New evidence is repeating established findings rather than changing them.
  • Unresolved uncertainty cannot currently be reduced.
  • The next meaningful step requires specialist examination or testing.
  • A publication, purchase or decision deadline has been reached and the limitations are disclosed.

Documentation

Preserve the reasoning, not only the answer

Records should allow another informed person - including the future collector - to see what was searched, which objects were examined, which criteria were applied, why some evidence was accepted, what was rejected and how the conclusion changed over time.

Object record

Identifier, title, category, materials, dimensions, markings, condition, completeness, photographs and current location.

Source record

Creator, title, date, type, repository, URL or reference, access date, copy or image, and rights restrictions.

Claim record

The proposition, supporting and contradicting evidence, confidence, researcher and date assessed.

Comparison record

Comparison object, features examined, similarities, differences, image references and significance.

Provenance event record

Owner, custodian, location, date range, transaction, source and confidence without silently bridging gaps.

Research log

Action, date, result, decision, no-result searches, follow-up and superseded interpretations.

Collector judgement

Three scenarios where planning changes the answer

CLAIMED FIRST PRINTING

Test defined characteristics, not seller vocabulary

A planned investigation identifies the title and copyright data, printer or publisher identifiers, collation, binding, jacket features, contemporary announcements, comparison copies and evidence of later changes. It also tests alternatives: later printing of the first edition, book-club issue, regional issue, rebound copy, married jacket or facsimile.

The output is an identification conclusion with a feature list, confidence, images, source references and unresolved issues - not merely the repeated phrase “first printing.”

ALLEGED PROTOTYPE

Replace the prestige label with a production-stage question

Prototype may conceal a design mock-up, pattern, proof, test shot, engineering sample, pre-production sample, sales sample, approval sample, unreleased production object, incomplete production object or modern customisation. The plan asks which stage is alleged, what features support it, whether comparison samples exist and whether the provenance reaches a company, employee or contractor.

The conclusion should name the supported category rather than preserving “prototype” simply because it increases interest or value.

UNDOCUMENTED COLOUR VARIANT

Test whether the difference is real, repeatable and historically meaningful

Calibrate the photography, examine the object, compare paper and print pattern, locate other examples, look for shared production codes, test fading or chemical change, search distribution evidence and check whether the difference correlates with date or geography.

The responsible result may be deliberate variant, ordinary production variation, ageing effect, later alteration or unresolved. A visible difference is the beginning of the investigation, not the catalogue classification.

Failure modes

Where research plans most often break down

Starting with the answer

The collector searches for proof of rarity, prototype status or authenticity rather than testing competing explanations.

Allowing scope to expand invisibly

The original identification question disappears inside company history, pricing, biography or general collecting lore.

Counting repetition as corroboration

Many pages repeat the same unsupported claim, giving one evidential chain the appearance of consensus.

Treating absence as proof

No example found becomes no example exists, without accounting for terminology, private ownership, regional isolation or incomplete archives.

Relying on photographs for material conclusions

Images cannot reliably establish weight, texture, internal construction, repair, component substitution or subtle printing processes.

Changing the standard after seeing the result

Criteria are tightened for contradictory evidence and relaxed for evidence supporting the preferred theory.

Failing to record rejected explanations

The final conclusion looks inevitable because the alternatives and the reasons for rejecting them have disappeared.

Using value as authentication evidence

An expensive sale proves that money changed hands, not that the attribution, provenance or variant classification was correct.

Myth versus reality

Planning is discipline, not rigidity

MYTH

Research planning suppresses discovery.

REALITY

Planning establishes direction while preserving the ability to revise the question when unexpected evidence reveals a better problem.

MYTH

Only academic projects need a plan.

REALITY

A one-page collector plan can prevent expensive buying, classification and sale-description errors.

MYTH

A primary source settles the question.

REALITY

Primary sources can be promotional, incomplete, mistaken, altered or misunderstood. They still need contextual evaluation.

MYTH

More sources always mean stronger evidence.

REALITY

Repeated dependent claims may add almost nothing. Relevance, independence and corroboration matter more than volume.

MYTH

Every visible difference deserves variant status.

REALITY

Differences may come from tolerances, ageing, storage, repair, replacement, image processing or random production irregularity.

MYTH

Research ends when the catalogue entry is written.

REALITY

Cataloguing records the current conclusion and its evidence. New objects, archives or technical findings may require visible revision.

Escalation

Know when collector research should stop and specialist work should begin

Specialist support is not a substitute for a clear question. The research plan should state the exact technical or evidential issue the specialist is being asked to resolve. “Please authenticate this” is often less useful than a defined set of questions about material, manufacture, handwriting, restoration, title or production sequence.

Specialist thresholds

  • High financial exposure, public attribution or reputational consequence.
  • Possible forgery, disputed title or legal allegation.
  • Culturally sensitive, sacred, displaced or contested material.
  • Scientific testing, hazardous materials or conservation intervention.
  • High-value signatures, rare production methods or specialist bibliography.
  • Inaccessible languages, archival handwriting or complex statistical population claims.

Ethics

Plan for the consequences of being believed

Research conclusions can alter price, reputation, ownership claims and the treatment of culturally significant objects. Ethical controls therefore belong in the plan rather than being added after publication.

Do not manufacture certainty

Probability should not be presented as fact because a stronger claim increases value or prestige.

Disclose relevant interests

State when the researcher owns the object, intends to sell it, is paid by the owner or created the proposed classification.

Protect confidential information

Private owners may not consent to publication of names, addresses, prices, correspondence or exact locations.

Respect cultural context

Institutional and market records are not always the only legitimate knowledge; consultation may be required.

Correct errors visibly

Preserve the correction and superseded conclusion rather than silently rewriting the record.

Prohibit unjustified destructive testing

Testing must be necessary, proportionate, authorised and undertaken with suitable expertise.

Practical tool

A compact collector research plan

  1. 01What exactly am I trying to establish, and what decision will the answer support?
  2. 02Which terms need defining before I compare sources or objects?
  3. 03Which objects, dates, regions, features and evidence routes are in scope?
  4. 04What alternative explanations exist before I favour one?
  5. 05What evidence would support, weaken or distinguish each explanation?
  6. 06Which sources are closest to the event, and which are merely discovery leads?
  7. 07How will photographs, measurements, comparisons, searches and citations be recorded?
  8. 08Are apparently separate sources genuinely independent?
  9. 09What evidence contradicts my preferred conclusion or would change my mind?
  10. 10What confidence can I honestly claim, and what stopping rule applies?

GOVERNING PRINCIPLE

The strongest conclusion is often the one that preserves its limits

The purpose of planning is not to make collecting look academic. It is to make reasoning controlled, transparent and proportionate: the question is narrower than the subject, terminology is stable, claims are matched to suitable evidence, objects are recorded consistently, alternatives are tested, commercial claims are not accepted automatically and future evidence can be added without reconstructing the investigation from memory.

“The currently documented evidence supports classification as a distinct early production state, probably preceding the standard issue, but the exact sequence and production quantity remain unresolved” is not a weak answer. It is a planned conclusion that tells the next collector what is known, what is inferred and what still requires evidence.

Key takeaways

  • Plan the claim, not merely the object or subject area.
  • Define scope, terminology and competing explanations before substantial searching.
  • Match evidence to the exact function it can responsibly perform.
  • Record searches, rejected alternatives, contradictions and unresolved questions.
  • Distinguish source quantity from source independence and corroboration.
  • Use stopping rules and specialist thresholds to keep effort and risk proportionate.
  • Write conclusions at the level of confidence the evidence has actually earned.

Continue learning

Related topics