AI Glossary / Natural language and speech / Intermediate
Hearst patterns
Definition
Hearst patterns are recurring word-and-grammar patterns used to identify possible hyponym relationships in text: relationships in which one concept is a kind of another. Named after researcher Marti Hearst, they include constructions such as “vehicles such as buses and bicycles.” An extraction system can use that wording to propose that buses and bicycles are types of vehicles.
What it means
A document often explains a category by listing examples. Hearst patterns turn some of those explanations into candidate structured relationships. In “fasteners such as bolts and rivets,” fasteners names the broader category, while bolts and rivets name narrower kinds.
The result is directional. Saying that a bolt is a kind of fastener does not say that every fastener is a bolt. Nor does it establish that a bolt is a kind of rivet. This direction matters when a search system, glossary, or knowledge graph uses extracted links to connect concepts.
How it works
A simple pipeline locates a cue phrase, identifies the noun phrases around it, and maps their positions to broader and narrower concepts. Patterns can use cues such as “such as,” “including,” or “and other,” with different arrangements of the category and example phrases. Grammar and phrase boundaries help determine which words belong together.
The pipeline then stores proposed links with their source sentence. Further processing may normalize plural forms, connect mentions to concept identifiers, remove duplicates, and check whether a proposed relationship makes sense in context. These steps are implementation choices rather than a single mandatory Hearst-pattern algorithm.
Pattern matching supplies evidence, not certainty. Quotation, negation, hypothetical descriptions, unusual lists, and ambiguous words can change interpretation. Some lists group related things without expressing a clean kind-of relationship. Many genuine relationships also occur in wording that a small pattern inventory will miss.
Three practical examples
1. Glossary building: Editors search technical documents for phrases that introduce examples of a category, then review the proposed links before adding related-term navigation.
2. Enterprise search: A search team collects candidate equipment categories from maintenance manuals. Approved relationships may help connect a broad query with documents naming particular equipment types.
3. Knowledge-graph preparation: A data team extracts candidate kind-of edges from source text, preserving sentence and document references so reviewers can inspect why each edge was proposed.
Think of it this way
Think of a printed shelf label followed by a short list of example products. The label helps explain where the examples belong. Hearst patterns look for comparable clues in prose. The analogy has limits: ordinary documents are not carefully maintained shelf inventories, and an author can quote an incorrect label, use a word ambiguously, or list related objects rather than actual subtypes.
Worked example
Consider this invented sentence: “The kit contains fasteners such as bolts and rivets.” A pattern identifies fasteners as the broader noun phrase and bolts and rivets as the coordinated examples. After an explicitly chosen singular-normalization step, the proposed links are bolt → fastener and rivet → fastener, where the arrow means “is a kind of.”
There are two extracted links. Neither fastener → bolt nor bolt → rivet follows. The sentence also says something about a kit's contents, but that is a different relationship and is not represented by these two kind-of edges.
Now add a second occurrence of the same sentence. The pipeline may retain four mention-level pieces of evidence but only two unique concept edges after deduplication. More repeated mentions do not create more distinct kinds. Finally, compare “The manual incorrectly lists cables as fasteners such as bolts.” A naive surface match could produce a misleading edge; preserving the context enables review instead of treating a matched phrase as an unquestionable fact.
Illustrative case study
Fictional case: A hardware retailer wants visitors to browse its educational articles by product family. Its team extracts category candidates from approved supplier descriptions using a small pattern inventory.
Reviewers notice that some passages mix accessories, materials, and product types within the same list. They reject those candidate kind-of links, retain the supporting text for accepted links, and keep separately defined relationships for accessories. The team evaluates a sample of both accepted and missed cases before expanding the inventory. This scenario illustrates curation decisions; it does not claim a measured extraction accuracy or business result.
Common misconceptions and mistakes
A common mistake is treating every list as a taxonomy. “A drill with batteries and a case” relates items without stating that batteries or cases are kinds of drills. Another is reversing the broader and narrower concepts when the phrase order changes.
Do not assume that one successful pattern covers all useful language. Domain terminology, coordination, and sentence structure affect coverage. Also distinguish a concept's subtype from an individual object's membership: “this particular drill” and “cordless drill” may require different relation types in the chosen knowledge representation. Define the target schema before importing edges.
Business use
For business use, these patterns offer an interpretable way to propose relationships from existing documents. Reviewers can see the wording behind each suggestion. Start with a clear relation definition, approved sources, and a manageable pattern inventory. Measure precision on reviewed candidates and investigate missed relationships separately. Preserve provenance and rejection reasons so later changes do not silently reintroduce known errors.
People also ask
Are Hearst patterns machine-learning models?
The patterns themselves are linguistic extraction templates. They can be used in a rule-based pipeline or as part of a larger learning system.
Does a match prove a relationship?
No. It proposes a relationship that must be interpreted in context.
Can they find every hyponym relation?
No. Many relationships are implicit or expressed using constructions outside the selected inventory.
Check your understanding
Why does “bolts and rivets” yield no bolt → rivet edge in the worked example?
Answer: Both are listed as narrower kinds of fasteners; coordination does not make one a subtype of the other.
Related terms
- Hypernym
- Lexico-syntactic pattern
- Taxonomy
- Information extraction
- Noun phrase
- Relation extraction
- Hyponym
- provenance
Learn next
Mark broader and narrower noun phrases in five original category-example sentences. Write the directed edges and keep the evidence sentence beside each one. Then compare kind-of, part-of, and used-with relationships to see why similar-looking lists need different interpretations.
More in Natural language and speech
- Greedy decoding - Greedy decoding is a method for generating a sequence by choosing the highest-scoring available next token at each step.
- Gricean maxims - Gricean maxims are conversational expectations proposed by philosopher H. Paul Grice to help explain cooperative communication.
- Heaps's law - Heaps's law is an empirical relationship describing how the number of distinct terms in a text collection tends to grow as more word occurrences are observed.
- Hidden units - Hidden units are computational units inside a neural network, between its inputs and its final outputs.
- Hobbs algorithm - The Hobbs algorithm is a historical, syntax-based method for finding candidate antecedents of pronouns in text.
- Homonymy - Homonymy is the relationship between distinct meanings that share a word form but are not treated as meaningfully related in the analysis being used.
Sources
Primary source: Marti A. Hearst, Automatic Acquisition of Hyponyms from Large Text Corpora (1992): https://aclanthology.org/C92-2082.pdf . The introduction, pattern examples, and discussion of coarse relationships and coverage were read. The kit examples, review workflow, and deduplication arithmetic are original teaching material. Candidate links require contextual and schema review.
Previous: Heaps's law Next: Heatmap