AI Glossary / Computer vision and multimodal AI / Beginner
Computer vision
Definition
Computer vision is the field of developing methods that extract useful information from images, video and other visual measurements. Tasks include recognizing objects, locating features, estimating motion, reading text and recovering scene geometry, using both classical algorithms and machine-learning approaches.
What it means
People can glance at a scene and identify objects, relationships and possible actions. A computer receives numerical measurements and must turn them into a useful representation for a specific task. Recognizing that an image contains a bicycle differs from locating every bicycle, tracing its outline or estimating how it moves. Computer vision is therefore a collection of problems and methods rather than one universal ability to see. Modern learning systems can be powerful, but they still depend on data, task definitions and operating conditions. A confident output is not the same as a verified interpretation of the scene.
How it works
A typical workflow begins with image acquisition and preparation, such as decoding, resizing or calibration. An algorithm extracts features or learns representations from data. A task-specific component then produces outputs such as class labels, bounding boxes, segmentation masks, text strings or geometric estimates. Post-processing and decision rules connect those outputs to an application.
Training-based systems require representative examples and appropriate labels or other learning signals. Classical methods may rely more directly on edges, geometry, matching or engineered features. Many practical pipelines combine both. Evaluation should use data that reflects deployment conditions, including difficult lighting, occlusion, unusual objects and changed camera setups. The right metric depends on what the system is meant to do.
Three practical examples
- A warehouse system locates packages in camera images and flags damaged labels for staff review. Detection and reliable identification are separate steps.
- A document application recognizes printed text and preserves layout information so users can search scanned material.
- A mobile robot estimates movement from successive images and combines visual information with other sensors to support navigation.
Think of it this way
Think of an observer assigned one precise visual job, such as counting boxes on a shelf. A well-designed vision system can perform that job without understanding everything in the scene. The analogy is limited because computers and people process visual information differently, and success at one task does not imply broad human-like awareness or judgment.
Worked example
Suppose a detector returns 12 package boxes in a test image. Review shows that 9 correspond to real packages and 3 are false detections. There are actually 10 packages in the image, so one was missed. Precision is 9/12=75%, and recall is 9/10=90%, under the agreed rule for matching predictions to real objects.
These two measures reveal different errors. Reporting only that the system found 12 boxes would not show either problem. The example is intentionally small; meaningful evaluation requires many representative images and a clear matching rule, including how much a predicted box must overlap the reference annotation to count as correct.
Illustrative case study
Fictional example: Maple Dispatch tests a camera system for counting parcels on a conveyor. It performs well on separated boxes but misses partly hidden parcels and sometimes counts printed pictures of boxes. The team collects these cases, revises its evaluation set and adds a review route for uncertain counts. It also checks performance after changing the overhead lighting. The pilot illustrates the importance of deployment conditions; it does not establish a general accuracy claim or justify removing human oversight from every exception.
Common misconceptions and mistakes
Computer vision is not limited to deep learning, and image processing is not automatically semantic understanding. A model that labels an object does not necessarily know its physical properties or intentions. High performance on one dataset may not transfer to another camera or environment. More training images help only when their quality and relevance support the task. A confidence score is not automatically a calibrated probability of correctness. Finally, visual systems can miss important events or learn irrelevant cues, so evaluation must reflect the real cost of different errors.
Business use
Businesses should begin with a concrete decision or workflow, not a vague requirement for an AI camera. Define the objects or measurements needed, expected conditions and the consequences of false positives and misses. Compare the system with existing processes and simpler alternatives. Plan data collection, annotation quality, monitoring and exception handling. If images contain people or sensitive information, handle access and retention according to the actual use context. A useful deployment combines task performance with reliable integration, maintainable equipment and a clear process for investigating errors.
People also ask
Is computer vision the same as image classification?
No. Classification is one task; detection, segmentation, tracking, text recognition and geometry estimation are others.
Does every vision system need labeled training data?
No. Some classical methods use explicit mathematical models, while learning approaches vary in their supervision requirements.
Can a model work well in testing and fail after installation?
Yes. Changes in lighting, viewpoint, image quality or object appearance can create a gap between test and deployment conditions.
Check your understanding
A model accurately labels an image as containing a dog. Does that show it can draw the dog's exact outline?
Answer: No. Image classification and segmentation require different outputs and separate evaluation. Success at one does not establish success at the other.
Related terms
- Optical flow
- Feature extraction
- Image recognition
- image classification
- object detection
- semantic segmentation
- multimodal AI
Learn next
Learn the differences among classification, detection and segmentation, then examine precision and recall on a small labeled dataset. Study data quality and deployment variation before choosing a model architecture or making business performance claims.
More in Computer vision and multimodal AI
- Computational complexity - Computational complexity studies how the resources required for a computation grow with input size.
- Computational imaging - Computational imaging combines physical measurement and computation to form images or recover scene information.
- Computational photography - Computational photography uses algorithms together with captured light measurements to form, improve, or extend photographic images.
- Computer vision dazzle - Computer vision dazzle is a visual camouflage approach that explores whether changes in appearance can disrupt particular computer vision systems while...
- Condensation algorithm - The Condensation algorithm is a probabilistic visual-tracking method that represents uncertainty with a collection of weighted samples.
- Connected-component labeling - Connected-component labeling assigns a distinct label to each connected group of foreground pixels in an image.
Sources
OpenCV, official computer-vision project: https://opencv.org/ OpenCV, official introductory course topics: https://courses.opencv.org/courses/course-v1%3AOpenCV%2BBootcamp%2BCV0/about Primary project and educational excerpts consulted; application-specific and editorial review remain pending. The detection calculation and fictional case are original.
Previous: Computer experiment Next: Computer vision dazzle