Screening and Training Methods for Sensory Panelists

When a food company needs to confirm that a product meets its quality standards, chemical instruments can measure moisture content, pH, or fat levels – but they cannot tell you whether a product actually tastes right, smells fresh, or has the right mouthfeel. That job belongs to sensory panelists. These trained individuals serve as the human measuring instruments of the food industry, and the accuracy of their judgments depends almost entirely on how well they have been screened, selected, and trained. Getting this process right is not optional – it is the backbone of reliable sensory evaluation.

Why the right panelists matter 🔗

Sensory evaluation is a critical component in product development and quality control, particularly in food, beverage, and related industries. It bridges the gap between objective laboratory measurements and subjective human perception. But this bridge is only as strong as the people building it. A panelist who cannot detect subtle bitterness, or one who carries a strong bias toward a particular product, will generate data that is neither accurate nor reproducible.

Panel members are an important tool of sensory analysis, and their value depends on the objectivity, precision, and reproducibility of their judgments. This is why the process of building a sensory panel begins long before anyone tastes a single sample – it starts with a structured screening and selection phase.

Stage 1: Screening – testing for sensory acuity 🔗

Screening is the first filter. Its purpose is to identify candidates who have the baseline sensory capabilities required for the job. During screening, the general sensory capabilities of candidates are tested – including color vision, anosmia, odor and taste thresholds, and acuity in recognizing differences in texture – along with their general sensory language skills when describing sensory sensations.

Several standardized tests are used at this stage. International standards for this process primarily focus on color vision (ISO 11037), taste perception (ISO 3972), and odor sensitivity (ISO 5496). Here is what each test typically involves:

Color vision test 🔗

Candidates with color blindness or abnormal color vision are unsuitable for evaluating product appearance. The most widely used diagnostic tool is the Ishihara test, which uses colored plates embedded with numbers visible only to those with normal color perception. A qualified optician can also carry out this assessment for more precision.

Basic taste detection test 🔗

This test checks whether a candidate can correctly identify the four or five basic tastes – sweet, sour, salty, bitter, and umami. Solutions of each taste are prepared at defined concentrations, presented alongside plain water as a blank, and candidates must identify each correctly. Inability to detect differences and identify taste quality after several repetitions indicates poor sensitivity and renders the candidate unsuitable.

Odor recognition test 🔗

Candidates are presented with a series of odoriferous substances – both familiar (coffee, onion, garlic, spices) and unfamiliar – and asked to identify each. The materials are typically presented as liquid extracts in opaque containers to eliminate visual cues. Candidates who correctly identify fewer than 65% of the odorous substances are considered unsuitable for sensory work involving odor evaluation.

Matching and texture characterization tests 🔗

In matching tests, candidates are given a set of samples and asked to pair them based on similarity, then describe the sensations they perceive. Texture tests assess whether candidates can distinguish between attributes such as crispiness, chewiness, smoothness, and firmness – qualities that are especially important when evaluating dairy, meat, or baked goods.

Candidates who fail any of these tests are not necessarily poor evaluators in general – they are simply not suitable for the specific type of product or attribute being assessed. According to ISO 8586:2023, the selection of candidates takes into account the intended application, the performance of the candidates at interviews, and their potential rather than their current performance.

Stage 2: Selection – beyond sensory ability 🔗

Passing the screening tests is necessary but not sufficient. Selection goes further, evaluating qualities that affect how a panelist performs over time. Three factors carry particular weight.

Motivation and availability 🔗

A panelist who is genuinely interested in sensory work performs more consistently than one who participates reluctantly. Availability and commitment to participate in repeated evaluation sessions are crucial to ensure continuity in testing, particularly in longitudinal studies or quality control contexts. Candidates who travel frequently or carry heavy workloads are often poor fits for panel membership.

Health status 🔗

Sensory perception is directly affected by health. Respiratory infections, allergies, medications, and even chronic conditions can alter taste or smell. Panelists must be in good health and free of food allergies or intolerances that could interfere with their evaluations. This is a practical requirement, not a formality – an ill panelist is as unreliable as a miscalibrated instrument.

Absence of strong bias 🔗

Selection criteria include screening for panelists without strong biases toward or against certain products, as these biases can skew results. Someone who intensely dislikes a particular food category, or conversely has an unusually strong preference for it, is unlikely to provide neutral, objective evaluations. The goal is a panelist with a neutral attitude toward the product being tested.

Communication ability also factors into selection. The ability to communicate and describe the sensations perceived when judging a food product is particularly important – panelists must not only detect differences but articulate them precisely using agreed-upon terminology.

Recruitment can come from internal staff – such as those in quality control laboratories or processing units – or from external candidates. To maintain a functioning panel of 10 active assessors per session, the ISO guideline suggests recruiting around 40 candidates and selecting approximately 20 panelists, accounting for attrition, scheduling conflicts, and performance variation over time.

Stage 3: Training – building skill and consistency 🔗

Once candidates are selected, training begins. This phase is not a brief orientation – it is a systematic program that develops a panelist’s ability to detect, describe, and reproduce sensory judgments accurately. The purpose of training is to develop trainees’ ability to detect, recognize, describe, and discriminate sensory stimuli, and to provide opportunities for trainees to use this expertise.

Familiarization with product attributes 🔗

Early training sessions expose panelists to a wide range of samples that represent the full spectrum of attributes they will be asked to evaluate – including control samples representing ideal quality and samples with deliberately introduced defects. Training is imparted on the concerned product by including control samples (the ideal product) as well as those having the full range of flavor, body, texture, and appearance defects. This exposure builds the internal reference library that panelists draw on during actual evaluations.

Sensory terminology training 🔗

A shared vocabulary is essential. Without it, one panelist’s “astringent” is another panelist’s “dry,” and data becomes impossible to compare. Selected individuals undergo extensive training to develop a shared sensory vocabulary, and trained panelists learn to use reference standards and rating scales consistently. This involves group exercises where panelists discuss and agree on the definitions and intensities of each descriptive term until consensus is reached.

Scoring method training 🔗

Panelists must learn how to use the specific scales and scoring tools relevant to their evaluations. This includes numerical scales, categorical scales, and intensity rating systems. External standards are usually used to define attributes and standardize the scale for each assessor, and developing and refining a vocabulary are essential parts of sensory profile work. For example, on a 9-point sweetness scale, panelists learn to consistently place a given sample at the same intensity point – not because they are told to, but because they have practiced against reference standards enough times that the placement becomes reliable.

Threshold and discrimination training 🔗

This component of training exposes panelists to stimuli at varying concentrations, starting below detection levels and moving upward. The objective is to establish and lower each panelist’s detection and recognition thresholds. Sensitivity tests assess a panelist’s ability to detect and identify specific sensory attributes at varying intensities, including threshold tests that determine the lowest concentration a panelist can detect or recognize. Triangle tests – where panelists are presented with three samples, two of which are identical, and must identify the odd one – are also used to sharpen discrimination ability.

Calibration: keeping the panel aligned 🔗

Training alone is not a one-time fix. Sensory perception drifts. Panelists may unconsciously shift their use of a scale over time, or adapt to certain stimuli so that their sensitivity decreases. Calibration sessions address this. Some panels calibrate using reference standards before an evaluation to keep panelist ratings anchored.

During calibration sessions, panelists evaluate a set of product samples and discuss their ratings as a group to reach a consensus, with the panel leader facilitating these discussions and helping panelists refine their understanding of sensory attributes and associated vocabulary. The panel leader plays a central role throughout – recruiting, training, running calibration sessions, and monitoring individual panelist performance over time.

Systematic and continuous training helps address individual scoring differences by aligning panelists’ use of scales and improving scoring consistency. Statistical tools – including analysis of variance and principal component analysis – are used to detect outliers or panelists whose evaluations are drifting from the group. Those who consistently underperform may be retrained or, if necessary, replaced.

Types of panelists and their training requirements 🔗

Not all sensory panels serve the same purpose, and training requirements vary accordingly. The three primary types of sensory panelists are trained panelists, expert panelists, and consumer panelists, each bringing unique strengths to the evaluation process.

Trained panelists receive systematic instruction to identify and describe specific sensory attributes with accuracy and consistency. They are essential for difference tests and quality control work. Expert panelists possess deep, specialized knowledge in a particular category – wine, coffee, or cheese, for instance – and can provide nuanced feedback that goes beyond what a trained panel typically offers. Consumer panelists are not trained for technical evaluation; instead, they represent the target market and provide preference and acceptability data. They are selected based on demographics and product usage, not sensory acuity.

The depth and duration of training scales with the role. A consumer panelist may need only a brief orientation. A trained panelist working on a descriptive analysis panel may require weeks of sessions before being cleared for formal evaluations. An expert assessor, as defined under ISO 8586:2023, progresses through stages – from screened trainee to trained assessor – before receiving additional training and validation to reach expert status.

The outcome: consistency and reproducibility 🔗

The entire purpose of rigorous screening, selection, and training is to produce a panel that delivers consistent and reproducible results. Consistency means a panelist gives similar evaluations for the same product across different sessions. Reproducibility means different panelists evaluate the same product similarly. By using calibrated scales and frequent training sessions, trained panels can maintain consistent evaluation standards across multiple sessions.

When these two qualities are present, the data from a sensory panel becomes genuinely useful – it can inform product reformulation decisions, flag quality deviations during production, and provide reliable benchmarks against competitors. When properly implemented with careful screening of panelists, effective training, and proper statistical interpretation, sensory evaluation can provide many benefits and form a basis for accurate decisions.

A well-screened, properly selected, and thoroughly trained sensory panel is not an administrative formality – it is the difference between data that drives better products and data that misleads the people making them.

What do you think? If factors like fatigue, mood, or health can temporarily alter a panelist’s sensory perception, how should panel leaders account for these variables in real-world evaluation sessions? And given the significant time and resources required to build a trained sensory panel, how should smaller food producers approach sensory quality control when a full panel is not feasible?

References

1. https://auctoresonline.org/article/selection-and-performance-of-sensory-panelists-a-comprehensive-review-of-factors-influencing-sensory-evaluation-outcomes
2. https://www.foodandnutritionjournal.org/volume8number3/implication-of-sensory-evaluation-and-quality-assessment-in-food-product-development-a-review/
3. https://www.dlg.org/en/mediacenter/dlg-expert-reports/food-sensory-technology/dlg-expert-report-02-2020-practice-guide-for-sensory-panel-training-part-3
4. https://www.mdpi.com/2076-3417/11/24/11977
5. http://dairy-technology.blogspot.com/2014/01/screening-selection-and-training-of.html
6. https://blog.ansi.org/ansi/iso-8586-2023-training-of-sensory-assessors/
7. https://egyankosh.ac.in/bitstream/123456789/9636/1/Unit-10.pdf
8. https://fiveable.me/principles-food-science/unit-12/sensory-panel-selection-training/study-guide/6ojqcjXJkA3Hbrv5
9. https://www.sciencedirect.com/topics/food-science/sensory-panel
10. https://compusense.com/post/panel-performance-descriptive-analysis-key-insights-food-non-food-products/