Opsio - Cloud and AI Solutions
Red apples in four lanes on blue roller conveyors entering a grey optical grading hood in a fruit packhouse, with a water flume, fruit bins and packing lanes alongside

AI Visual Inspection for Food & Beverage

Camera inspection that finds bruising and rot on fresh produce, bake-colour and breakage faults on baked goods, and fill-level and cap faults on bottles and cans, at full line speed.

What is AI visual inspection for food and beverage?

AI visual inspection for food and beverage is automated food quality inspection in which cameras and deep learning models check every item at line speed. Opsio sets it up for three defect families: fresh-product damage such as bruising, rot and bone fragments; shape and bake-colour deviations; and container and closure faults such as wrong fill level and cocked caps.

Key facts

  • Inference runs on edge hardware beside the line in under 50 ms per image.
  • Cameras use GigE Vision or USB3 Vision; results reach PLCs over OPC UA, Modbus or PROFINET.
  • Bruising under the skin of produce is imaged with NIR or hyperspectral cameras, not RGB alone.
  • Bone in meat and fish is found by X-ray, combined with colour and NIR cameras for fat and trim.
  • The cameras run alongside metal detection and X-ray and do not replace HACCP critical control points.
  • Washdown areas use stainless steel camera enclosures rated IP69K for high-pressure, hot-water cleaning.
  • Decisions and reject images are logged per batch to support BRCGS and IFS records.

Main defect families

Fresh-product damage
Bruising, rot, mould, blemishes, blood spots, bone fragments and foreign material on produce, meat and fish.
Shape and bake-colour deviations
Baked or formed pieces outside size, shape, colour, topping or inclusion specification.
Container and closure faults
Wrong fill level, missing or cocked caps, label errors, seam faults and missing codes on bottles and cans.

Last reviewed by Praveena Shenoy, Head of AI & Data, Opsio, a Swedish cloud and AI services company. Part of Opsio's AI Visual Inspection service.

Why is food quality inspection hard at line speed?

Food is a natural product, so no two good items look alike. A tomato, a salmon fillet and a cookie all vary in colour, size and texture within specification, which rules out the fixed templates that rule-based vision depends on. The model has to learn what normal variation looks like before it can flag a real defect.

Speed and environment add pressure. Packhouse sorters, oven bands and filling lines run at hundreds to thousands of items per minute, wet product touches and overlaps, and the station is hosed down every day with hot water and chemicals. An ejector that fires a few milliseconds late hits the wrong apple and lets the bruised one through.

Manual grading fails exactly where food defects hide. A person at a sorting table sees one side of each item for a fraction of a second, cannot see bruising under the skin and has no fixed reference for bake colour under changing light. Escapes are expensive: a bone fragment, a glass chip or an undeclared allergen means complaints, retailer penalties or a public recall.

Three food and beverage inspection use cases

Each use case follows one stage: fresh product at intake, baked goods after the oven, and containers on the filling line.

Fresh and raw: produce sorting, meat and fish

Close-up of wet tomatoes on a white plastic modular conveyor belt, one with a dark soft bruise and one beside it with a split skin near the stem
Tomatoes on a sorting conveyor with a soft bruise and a split skin.

Situation

Your intake line grades tomatoes, apples or potatoes on multi-lane roller sorters at several items per second per lane, or trims fillets and cuts on a hygienic belt. Graders pick out what they see, a colour sorter misses bruising under the skin, and fat, trim and fillet shape are judged against a sample board. This is high-speed vision inspection: the decision must land before the item reaches the ejector.

Defects

  • BruisingPressure damage from harvest or transport that crushes tissue under the skin, often invisible in colour for hours.
  • Rot and mouldFungal or bacterial decay that starts at wounds or the stem end and spreads to neighbouring items.
  • Size and shape gradingDiameter and form measured against class limits, because buyers pay by size class.
  • Colour grading (ripeness)Surface colour mapped to ripeness stage, since uneven ripening gives mixed colour within one lot.
  • Surface blemishesScars, russeting, hail marks and insect damage that move the item to a lower class.
  • Stems and foreign materialStems, leaves, stones and plastic picked up at harvest.
  • Fat distribution and marbling gradingthe pattern of fat within the muscleThe share and spread of fat in a cut, which sets grade and price and varies with breed and feed.
  • Bone fragments and cartilagePin bones missed by filleting machines and chips from deboning, a physical hazard for consumers.
  • Blood spotsDark red haemorrhages in fillets and meat caused by handling, stunning or bleeding faults.
  • Foreign objectsGlove pieces, plastic and rubber that enter from belts, tools and packaging.
  • Trim qualityLeftover skin, membrane, excess fat or ragged edges where trimming missed the specification.
  • Fillet shapeGaping, torn or misshapen fillets outside the target outline, caused by machine settings or soft raw material.

Inspection setup

For produce, RGB GigE Vision cameras with 8 to 16 mm lenses look down through a diffuse LED tunnel while rollers turn each item, so several frames cover the whole surface. An NIR or hyperspectral camera beside them picks up bruising under the skin. Resolution is typically 0.2 to 0.5 mm per pixel.

For meat and fish, top-down colour and NIR cameras grade fat, blood spots, trim and shape on a contrasting belt; an X-ray unit finds bone, and both results merge into one decision per item. Every camera sits in an IP69K stainless enclosure. The station ejects by air jet, diverts to a lower-class lane or flags for re-trim.

Outcome

One station grades and rejects fresh product at full lane speed. You get size, colour and defect class for every item, with an image per eject. Graders handle only flagged items, and the X-ray stays your bone control while the cameras cover visible defects.

Baked goods and confectionery

Rows of chocolate chip cookies on a stainless oven conveyor, one broken in two with crumbs, and two darker over-baked cookies with smeared, uneven chocolate topping
Cookies leaving the oven with one broken piece and darker over-baked pieces with uneven topping.

Situation

Your oven band carries cookies, crackers or bars in rows across a wide belt, thousands of pieces per minute, and many then pass an enrober or topping applicator before packing. An operator watches the band and pulls samples for colour and weight, so a drifting oven zone can run for many minutes before anyone acts.

Defects

  • Shape and size out of specPieces too large, too small, too thin or out of round, caused by dough properties, depositor wear or spread in the oven.
  • Under- or over-baking (colour)Bake colour lighter or darker than the reference, caused by oven zone temperature, band speed or dough moisture.
  • Topping coverage and distributionSeeds, sugar, chocolate or icing missing, clumped or off-centre, caused by applicator blockages or uneven product flow.
  • BreakageCracked or broken pieces from transfers, cooling stress or handling, which cause complaints and jam wrapping machines.
  • Misshapen or merged piecesdoublesPieces distorted or fused on the band because the depositor misfired or dough spread too far, which breaks pack counts.
  • Missing inclusionsChips, nuts or fruit pieces absent or too few, often from settling in the hopper, which changes the product against its recipe.

Inspection setup

Top-down colour line-scan cameras span the full band after the oven and again after enrobing, with diffuse LED bars on both sides to keep shadows short. A colour reference strip in the field of view holds bake colour against a fixed target. A laser-triangulation 3D sensor adds height and volume per piece, which catches thin, domed and stacked pieces that look normal from above; see how 3D dimensional measurement works. Resolution is typically 0.3 to 0.5 mm per pixel on bands up to about 1.2 m wide.

Each lane gets its own decision: an air jet or pick-and-place robot removes the faulty piece, a row is diverted before packing, or the result is logged as an oven trend for the shift leader.

Outcome

You see every piece instead of a sample, and oven drift shows up as a trend within minutes. Bake colour, size and topping coverage become numbers per lane that feed SPC (statistical process control) charts. The gain you can plan for is earlier correction of oven and applicator settings, with broken and pale pieces caught before the wrapper.

Bottling and canning

Clear glass bottles of amber liquid with blank white labels on a filling line conveyor in front of a white backlight panel, two with tilted crown caps and uneven fill heights
Bottles passing a backlight panel, two with cocked crown caps and varying fill levels.

Situation

Your filling line moves glass, PET or cans through filler, capper or seamer, labeller and coder, typically at several hundred to more than 1,000 containers per minute. A fill-level detector and a code reader cover part of the risk, and seams are torn down in the lab a few times per shift. The rest relies on operators watching a fast conveyor.

Defects

  • Fill levelUnder- or over-filled containers caused by filler valve faults, foaming or product temperature, a legal and customer issue.
  • Cap presence and seal (tamper band, cocked caps)Missing, cocked or high caps and broken tamper bands caused by capper head wear or misfed closures, which risk leaks.
  • Label alignment and wrinklesLabels skewed, flagged, wrinkled or missing because of glue, label stock or wet containers.
  • Foreign objects in empty containersGlass fragments, debris or residue in containers before filling, most common in returnable bottles.
  • Can seam defectsfaults in the double seam that joins lid and can bodyVisible droops, vees, cut-overs and seam wrinkles caused by seamer roll wear or set-up, which can lead to leaks and spoilage.
  • Best-before code presenceMissing, partial or smeared date and lot codes caused by printer faults, which breaks traceability and labelling rules.

Inspection setup

Empty-bottle inspection sits before the filler: a camera looks up through the base over a backlight, sidewall cameras view the body and a ring light lights the finish (the threaded neck). After the capper, a backlight camera finds the meniscus in clear bottles; for cans and opaque containers, fill level is measured by X-ray. Two to four cameras or a mirror tunnel give a 360° view of caps, bands and labels, the method used for label inspection on printed packaging; PET light-transmission checks follow those for blow-moulded containers. A low-angle ring light shows seam faults after the seamer; lab teardown stays your seam control.

Each fault fires a pusher or segment rejector timed off the conveyor encoder, and a confirmation sensor proves the container left the line.

Outcome

You get one record per container covering fill, closure, label and code, not separate point checks. When the station reads the capper or seamer head index, faults trace to the head that caused them, so maintenance acts on a head number. More on bottle defect detection with vision AI.

How does automated inspection run on a food line?

The same six steps apply on a sorter, an oven band and a filling line; food adds hygiene, product variation and ejector timing.

Wet stainless steel camera enclosure on a stainless frame above a white food conveyor carrying crumbed product, with a row of stainless air-jet nozzles along the belt edge
Hygienic stainless camera enclosure over a food conveyor with air-jet ejector nozzles.
  1. 1

    Trigger and part presentation

    Rollers, singulating belts or bottle guides present each item in a known position. A conveyor encoder and a photo-eye trigger each image, so the station tracks every item between camera and ejector.

  2. 2

    Image acquisition

    GigE Vision area-scan or line-scan cameras with C-mount lenses sit in IP69K stainless enclosures with sloped tops and polycarbonate windows. Diffuse LED tunnels, backlights or ring lights are chosen per defect, with NIR, hyperspectral or 3D sensors where colour alone cannot see the fault.

  3. 3

    Edge inference and latency budget

    Models run on NVIDIA Jetson or Intel OpenVINO hardware beside the line in under 50 ms per image. The camera-to-ejector distance is set so belt speed times total latency, including valve response, always fits.

  4. 4

    Decision and actuation

    The pass or fail result goes to the line PLC over PROFINET, EtherNet/IP, OPC UA or Modbus TCP. The PLC fires air jets, pushers or diverter flaps at that item's encoder count, and a sensor confirms the reject.

  5. 5

    Traceability and data retention

    Each decision is stored with batch, lot, line, time and image. Reject images stay on the edge server for a period you set, and summaries go to your MES or quality system for HACCP and BRCGS records.

  6. 6

    Active-learning loop

    Uncertain results are queued for operator review. New varieties, recipes and container formats are added through labelled examples and SageMaker retraining, then deployed to the edge after testing.

Which imaging method suits which food defect?

Choose the modality from the physics of the defect; the model classifies.

Defect familyBest-suited imagingWhy
Bruising and rot under the skinNIR or hyperspectral line-scanDamaged tissue changes NIR absorption before its colour changes.
Size, shape, colour grading and blemishes (fruit sorting)RGB area-scan or line-scan in a diffuse LED tunnel, with item rotationDiffuse light removes glare on wet skins; rotation shows the whole surface.
Fat, marbling, blood spots and trimTop-down colour plus NIR camerasFat and lean differ in colour and NIR reflectance.
Bone fragments and cartilageX-ray food inspection, combined with the camera resultBone is inside the product and denser than flesh; cameras cannot see it.
Bake colour, topping and inclusionsColour line-scan with a colour reference, after the oven and after enrobingA fixed colour target holds bake colour steady across shifts.
Height, volume and merged pieces3D laser triangulationHeight separates thin, domed or stacked pieces that look normal from above.
Fill level inspectionBacklight camera for clear containers; X-ray for cans and opaque containersThe meniscus is a sharp edge against a backlight; metal and opaque walls need X-ray.
Cap inspection, tamper bands and labelsMulti-camera or mirror 360° view with diffuse lightCocked caps, broken bands and label wrinkles can be on any side of the container.
Foreign object detection in empty containersBase camera over a backlight, sidewall cameras, ring light on the finishDebris and chips show as spots against even light.
Can seam inspectionHigh-resolution area-scan with a low-angle ring lightRaking light makes droops, vees and wrinkles cast shadows; seam dimensions still need teardown.
Best-before and lot codesArea-scan with OCR/OCV (optical character recognition and verification)The camera confirms the code is present and legible on every container.

Integration with HACCP, BRCGS and your plant systems

The station reads recipe and batch data and writes results back, so inspection records sit with your other food safety records.

PLC and line control
Reads recipe, line speed and encoder; writes pass/fail, reject commands and alarms over PROFINET, EtherNet/IP, OPC UA or Modbus TCP.
MES, ERP and SPC
Reads batch, lot and product master data, including allergen content; writes counts by defect class per batch to MES and SPC.
HACCP and foreign-body controls
Supports your HACCP plan as an additional quality control. It does not replace metal detection or X-ray where these are critical control points; their validation, testing and reject checks stay as they are.
BRCGS and IFS records
Designed to meet the record expectations of BRCGS and IFS audits: timestamped decisions, reject images, operator overrides, model version and test results per shift.
Allergen and label claims
Checks that label, code and closure match the product running, using ERP master data, to support allergen and label-claim verification under EU Regulation 1169/2011 and similar rules.
Hygienic design
IP69K stainless enclosures, sloped surfaces and polycarbonate windows instead of glass, to fit your washdown and glass policy.
Where data lives
Images and decisions stay on the edge server in your plant; summaries and training images go to an EU AWS region you choose, or stay on-premises.

From first test to your line in five steps

Each step is adapted to food lines: perishable samples, washdown hygiene and short planned stops.

  1. 1

    Opsio runs tests in the AI Lab

    You send a sample set, typically 300 to 500 good items and 30 to 100 examples per defect class, such as bruised and rotten fruit, broken or dark cookies, or under-filled and cocked-cap bottles. For perishable product, Opsio agrees chilled shipping or images at your site. Opsio tests cameras, NIR and lighting, trains a first model, and measures detection rate and false-reject rate per defect class.

    You provide
    Labelled good and defective samples, specification limits, line speed and photos of the intended station position.
    Opsio delivers
    Imaging trials, a first model and per-class detection and false-reject results.
  2. 2

    Present results and pricing

    Opsio presents results per defect class with example images of catches, escapes and false rejects, plus the camera, lighting and enclosure bill of materials, a check that latency fits your belt speed and ejector distance, and a fixed quote for the station and managed service.

    You provide
    Quality and engineering leads for the review, plus PLC and MES details.
    Opsio delivers
    Results report, bill of materials, cycle-time and ejector-timing check, and a fixed quote.
  3. 3

    Decision and PO/MSA signing

    You decide whether to go ahead, based on the results and the quote. The purchase order and master services agreement are signed, covering scope, acceptance criteria per defect class, ownership of images and models, hygiene and site access rules, and support levels.

    You provide
    Go/no-go decision, purchase order and agreed acceptance criteria.
    Opsio delivers
    Master services agreement, project plan and named project team.
  4. 4

    Installation in the Opsio AI Lab

    Opsio builds the production station in the AI Lab on the real cameras, lighting, IP69K enclosures and edge hardware. The station is run against fresh samples and the agreed acceptance criteria, and documentation for your HACCP review and change control is prepared.

    You provide
    Fresh sample batches and sign-off on the factory acceptance test.
    Opsio delivers
    Pre-commissioned station, factory acceptance test results and change-control documentation.
  5. 5

    Installation at the customer location

    The pre-commissioned station is installed during a planned stop, wired to your PLC and MES, and run in shadow mode next to current inspection. Once results meet the acceptance criteria, live rejection is switched on, operators are trained and the active-learning loop starts.

    You provide
    Line access during a planned stop, PLC connection and operators for training.
    Opsio delivers
    Installation, integration, shadow-mode run, operator training and managed service start.

Pricing for the feasibility study, production stations and the managed service is on the AI Visual Inspection service page.

AI visual inspection for Food & Beverage: questions

How does optical sorting work?

Optical sorting works by imaging each item as it passes a camera and firing an air jet to remove the ones that fail. Product moves on a belt, on rollers or in free fall past colour, NIR or hyperspectral cameras. A model classifies each item in milliseconds, and a valve bank timed to the item's position ejects rejects into a separate stream. AI adds defect classes, such as bruising under the skin, that fixed colour thresholds handle poorly.

What does fruit sorting software do?

Fruit sorting software turns camera images into a grade for each fruit. It measures size, shape and colour, classifies blemishes, bruising and rot, and sends each item to an outlet lane by class. With AI, the grading rules are learned from labelled examples of your varieties, so a new variety or season is added by labelling images rather than rewriting thresholds.

What are examples of hyperspectral imaging in food?

Common examples of hyperspectral imaging in food are bruise detection in apples, fat and lean measurement in meat, nut and grain sorting, and foreign-material detection on produce lines. The camera records many narrow wavelength bands, so materials that look alike in colour can be told apart by their spectrum. On production lines, a few selected NIR bands often give most of the benefit at lower cost.

Is fish bone detection done with X-ray?

Yes, fish bone detection is done with X-ray, because pin bones sit inside the fillet where cameras cannot see them. Opsio's cameras handle the visible defects on the same line: blood spots, trim, fillet shape and fat lines. In a combined system, the X-ray result and the camera result are merged into one reject decision per fillet. The X-ray remains your bone control and keeps its own validation.

What cannot be detected by X-ray?

X-ray cannot reliably detect low-density foreign bodies such as plastic film, paper, cardboard, wood, hair and insects, because they absorb about as much as the food around them. It also does not see surface colour, blemishes or blood spots. Cameras can find many of these when they are on the visible surface, which is why food plants often run cameras and X-ray together, each for the hazards it suits.

What are double seam defects?

Double seam defects are faults in the folded joint between a can body and its lid. Visible ones include droops, vees, cut-overs, sharp seams and wrinkles; others, such as short body hook or low overlap, need teardown or seam scanning to measure. A camera after the seamer catches the visible faults on every can and points to the seamer station that produced them, while lab teardown remains your seam control.

What is a cap inspection?

A cap inspection checks that every bottle or jar has its closure fitted correctly. The camera looks for missing caps, cocked or high caps, broken or missing tamper bands and, on some lines, the right cap colour for the product. It runs after the capper, usually with two to four cameras or mirrors for a 360° view, and rejects faulty containers before labelling or packing.

How does fill level inspection work?

Fill level inspection measures how high the liquid stands in each container and rejects under- and over-fills. In clear glass or PET, a camera in front of a backlight finds the meniscus edge. In cans and opaque containers, an X-ray beam measures the level through the wall. The result is compared with the target for that product, and a pusher removes the container if it fails.

What is empty bottle inspection?

Empty bottle inspection checks containers for damage and debris before they are filled. Cameras view the base over a backlight, the sidewall from several angles and the finish (the threaded neck) from above, finding chips, cracks, glass fragments and residue. It matters most for returnable glass, where bottles come back with foreign objects, and it removes a hazard before product goes into the container.

What does label inspection software check?

Label inspection software checks that the right label is on the container and applied correctly. It verifies presence, position, skew, wrinkles and flags, reads the best-before date and lot code, and compares the label with the product running. Matching the label to the batch from your ERP is the practical check against allergen and label-claim mix-ups, a common cause of food recalls.

Is HACCP QA or QC?

HACCP is a preventive food safety system, so it sits under quality assurance, while the checks it relies on are quality control. A camera station is a QC check that produces records. It can support HACCP monitoring and verification, but it only becomes part of a critical control point if your HACCP team decides so, validates it and defines the critical limits, corrective actions and records for it.

What are the 7 basic HACCP principles?

The seven HACCP principles are: conduct a hazard analysis, determine critical control points, set critical limits, establish monitoring, define corrective actions, establish verification and keep records. Vision inspection data fits mainly into monitoring, verification and records: per-item decisions, reject counts, images and model versions, timestamped by batch. It supports these principles; it does not replace your metal detection or X-ray critical control points.

Is it safe for food to go through X-ray?

Yes, food that passes an X-ray inspection system is safe to eat. The dose used for inspection is very low, it does not make food radioactive, and regulators such as the US FDA set limits for X-ray inspection of food. Opsio's cameras do not use X-ray; where bone or dense foreign-body detection is needed, an X-ray unit runs alongside the cameras as a combined system.

Book a 20-minute walkthrough for food & beverage

Pick the defects that cost you most, and we will show you live how a vision model finds them on a line like yours.

  • Live on your defect type, no slides
  • A reply within one business day
  • No obligation
Your call is with
  • Vaishnavi ShreeDirector & MLOps Lead
  • Praveena ShenoyCountry Manager, India

We use your details to answer your request, as described in our Privacy Policy.