AI Glossary / Computer vision and multimodal AI / Intermediate
Forensics
Definition
Forensics is the systematic examination of evidence to investigate what happened and support justified conclusions. In this computer-vision context, image and media forensics examines photographs or videos for clues about their origin, processing history, manipulation and relationships to other media.
What it means
An image can be questioned in several different ways. Was part of it inserted or removed? Does it derive from another image? Are its apparent capture details consistent with its file history? These are distinct forensic questions, and one tool rarely answers all of them.
Media forensics can examine pixels, file structure, metadata and contextual evidence. AI-based detectors are one possible component. Their outputs are indicators that require interpretation within the question and evidence available.
A finding about image processing does not automatically establish that a depicted event is false. Routine editing, recompression and resizing can leave traces. Conversely, an unedited photograph can be used with a misleading caption or presented as showing a different time and place.
How it works
An examination begins with a defined question and preservation of the available source material. The examiner records what file was obtained and distinguishes original evidence from working copies or derived visualizations.
Analysis may test for inconsistent compression, duplicated regions, lighting clues, sensor-related patterns or other relevant signals. Provenance analysis can compare multiple images to investigate derivation relationships. Automated systems may classify an image or mark regions that warrant closer review.
Findings should state their scope and limitations. Performance depends on the manipulation type, data quality and processing history. Repeated compression or screenshots can remove useful traces or create misleading patterns. A strong workflow considers alternative explanations and separates observed facts from inferences.
Three practical examples
1. Editorial verification: A newsroom examines whether an image contains signs of compositing and checks its source history before deciding how to describe it.
2. Research integrity: A publisher investigates suspected duplication between scientific image panels, considering whether the relationship has an innocent documented explanation.
3. Business content review: A marketplace uses media-analysis signals to prioritize product photographs for review. A detector flag initiates examination rather than serving as a complete account of how the image was created.
Think of it this way
Think of examining a document for different inks, erased areas and relationships to earlier drafts. Such clues can reveal aspects of its history, but one unusual mark does not explain the whole story.
Digital media differs because copying, recompression and software processing can transform the evidence. A forensic visualization is also a derived view of data, not a self-explanatory picture of truth.
Worked example
Consider a fictional detector tested on 1,000 images, of which 100 are manipulated under a defined benchmark. Suppose it flags 80 of those 100 and also flags 45 of the 900 unmanipulated images.
Its sensitivity on that test is 80/100 = 80%. Its false-positive rate is 45/900 = 5%. Of the 125 flagged images, only 80 are benchmark positives, so the precision is 80/125 = 64%.
The calculation shows why a detector's positive output is not equivalent to certainty. These invented figures do not characterize any product, and a different prevalence or image distribution would change the interpretation. Nor does this binary benchmark describe every possible forensic question or establish whether an image's accompanying claim is true.
Illustrative case study
Fictional case: Rowan News receives a striking event photograph through several reposts. An automated tool highlights an unusual region, but the team cannot obtain the original file. An analyst notes that repeated resizing and recompression limit what can be inferred from that copy.
The editors seek an earlier version, compare scene details with independent material and contact the supplied source through their normal verification process. They document what remains unresolved instead of presenting the heat map as proof of fabrication. This case illustrates combining evidence and stating limitations; it is not a legal procedure or a reported investigation.
Common misconceptions and mistakes
A manipulation detector is not a universal truth detector. Pixel analysis cannot alone validate the meaning of a caption or the circumstances of an event.
A highlighted region is not automatically a location where an object was fabricated. Processing artifacts and model error can produce similar signals.
Missing metadata does not prove malicious alteration. Many ordinary sharing workflows remove it. Metadata can also be changed, so its presence is not independent proof of authenticity.
A lack of detected anomalies does not establish that no manipulation occurred. The method may not cover that manipulation or the available copy may no longer retain useful evidence.
Business use
Media forensics can support editorial review, content-integrity workflows and investigation of suspicious visual records. Its business value depends on clear questions, preserved evidence and calibrated interpretation rather than dramatic detector displays.
Evaluate tools on the media types and processing histories expected in practice. Track false alarms, missed cases and inconclusive results. Keep the provenance of files and analytical outputs clear, and route consequential conclusions through an appropriate review process rather than relying on a single automated score.
People also ask
Is media forensics the same as deepfake detection?
No. Deepfake detection is one area within a broader field that also studies conventional editing, source clues and provenance.
Can a detector prove an image is authentic?
A negative result only means that the method did not find its targeted evidence under the available conditions. It is not universal proof.
Are all edits deceptive?
No. Cropping, color adjustment and annotation can be legitimate. The question is what changed, how the image is presented and what conclusion the evidence supports.
Check your understanding
A detector is 80% sensitive in a test. Does a flagged image therefore have an 80% probability of being manipulated?
Answer: No. Sensitivity describes how often the detector flags known positives. Interpreting a flag also requires information about false positives, prevalence and whether the test conditions match the image being examined.
Related terms
- Metadata
- False positive
- image provenance
- manipulation detection
- manipulation localisation
- deepfake detection
- digital evidence
Learn next
Separate three questions for a sample image: its file history, possible pixel manipulation and the truth of the claim made about it. Study a documented forensic benchmark and its error measures. Practice writing findings that distinguish observation, inference and unresolved uncertainty.
More in Computer vision and multimodal AI
- Flash / no-flash photography - Flash / no-flash photography uses a pair of images of the same scene, one captured with flash and one using ambient light, to support a combined or improved...
- Focal stacking - Focal stacking, commonly called focus stacking, combines photographs taken at different focus settings into a composite with a greater range of apparently...
- Focus peaking - Focus peaking is a camera or display aid that highlights image edges judged likely to be in focus.
- Forward mapping - Forward mapping is an image-warping approach that takes locations in a source image and calculates where they go in a destination image.
- Forward operator - A forward operator is a mathematical rule that maps an underlying object, signal or set of parameters to the observations a model predicts.
- Fourier slice theorem - The Fourier slice theorem states that the one-dimensional Fourier transform of a parallel projection of a two-dimensional function equals a line through the...
Sources
Primary sources: NIST, “User Guide for NIST Media Forensic Challenge Datasets,” https://www.nist.gov/publications/user-guide-nist-media-forensic-challenge-mfc-datasets ; NIST Open Media Forensics Challenge, https://mfc.nist.gov/ . Additional primary research: Hany Farid, “Digital Image Ballistics from JPEG Quantization,” https://digitalcommons.dartmouth.edu/cs_tr/291/ . Relevant returned descriptions were reviewed. The detector figures and newsroom scenario are fictional teaching examples.
Previous: Foreign key Next: Foreshortening