AI Glossary / Natural language and speech / Beginner
Parallel corpus
Definition
Definition: A parallel corpus is a collection of corresponding texts in two or more languages, where the texts express translated versions of the same material. For many language-technology tasks, corresponding passages or sentences are aligned so that a system can learn or inspect their relationship.
What it means
What it means: A folder containing English and Spanish documents is not automatically a parallel corpus. The documents must have a translation relationship. Two independent news reports about the same event may form part of a comparable corpus, but their sentences need not be translations of each other.
A parallel corpus can contain human translations, machine-generated translations or a mixture, provided its provenance is described accurately. Alignment can exist at document, paragraph, sentence or word level. Calling a collection parallel does not guarantee that every available alignment is correct or that every source passage has a counterpart.
How it works
How it works: Corpus construction starts by identifying corresponding documents, obtaining usable text and preserving language and source information. The next step segments the material and aligns related units. An alignment may connect one sentence to one sentence, one to several, or several to one; untranslated material may have no counterpart.
Quality checks look for incorrect language labels, missing content, mismatched versions, duplicate passages and non-translations. A model trained on aligned examples can learn associations between source and target expressions. Those associations reflect the collection's domains, style and quality. A corpus of parliamentary proceedings, for example, is not automatically representative of informal customer messages.
Three practical examples
Three practical examples:
1. A translation team combines approved versions of product instructions in two languages. Aligned segments support terminology review and translation-model experiments.
2. Researchers study how a particular expression is translated across contexts. The parallel relationship lets them inspect actual translation choices, rather than assume a dictionary equivalent fits every sentence.
3. A multilingual search project uses corresponding passages to evaluate whether a system retrieves the right translation. It keeps evaluation documents separate from training material so repeated passages do not make the task artificially easy. The corpus supports the experiment but does not alone establish general search quality.
Think of it this way
Think of it: A parallel corpus resembles two editions of the same guide laid side by side with links connecting corresponding passages. The links let a reader move between versions. The analogy has limits: a translator may split, combine, reorder or omit material, so perfectly matching page or sentence numbers cannot be assumed.
Worked example
Worked example: Imagine an English mini-document with E1, “The office is closed today,” and E2, “Please return tomorrow.” Its Spanish translation has three sentences: S1, “La oficina está cerrada.” S2, “Hoy no abrimos.” S3, “Vuelva mañana, por favor.” Treat S1 and S2 together as the translator's expanded rendering of E1, and S3 as the rendering of E2.
The intended links are E1 to the span S1 - S2, and E2 to S3. There are two aligned units, although there are two source sentences and three target sentences. A routine that merely pairs sentence number one with number one and number two with number two would mismatch E2 and leave S3 unused.
If both intended links are manually confirmed and one is incorrectly produced, alignment accuracy over these two reference units is 1/2. State that unit explicitly: counting sentences, links or individual words would answer different questions. The example is deliberately small and allows a freer translation rather than claiming word-for-word equivalence.
Illustrative case study
Illustrative case study: Fictional Northline Manuals prepares bilingual training material from approved product guides. An initial export aligns sentences by their order in each file. Review reveals that some translators combine short warnings, causing later pairs to drift.
The team restores document identifiers, permits span alignments and samples pairs for bilingual review. It also separates older product versions so a revised warning is not paired with an outdated translation. The resulting dataset receives a documented review status rather than an unsupported “perfectly clean” label. This fictional case illustrates corpus preparation and traceability; it reports no measured translation improvement.
Common misconceptions and mistakes
Common misconceptions and mistakes: Parallel does not mean word-for-word or equal-length. Similar topics do not establish translation equivalence. A large count of pairs does not guarantee diverse or accurate data, since duplicates and repeated boilerplate can dominate. Machine-generated pairs should not be silently described as human translations. Sentence alignment and word alignment are separate tasks. Finally, a correct translation may still be unsuitable as training material for a different domain, audience or terminology policy.
Business use
Business use: Previously approved translations can become a useful organisational resource when their versions, ownership and review status are retained. Prioritize reliable alignment and representative content over an impressive row count. Keep terminology decisions and source context accessible so reviewers can resolve ambiguous pairs. For model evaluation, choose held-out documents that represent the intended users and check for overlap with training data. Measure translation quality directly; the existence of a parallel corpus is an enabling resource, not a promised return on investment.
People also ask
People also ask: Is a bitext the same thing?
Bitext commonly refers to a text and its translation in another language; parallel corpus is often used for collections of such material and can also cover more than two languages.
Must every sentence align one-to-one?
No. Translation can split or merge sentences, and some passages may have no counterpart.
Can a parallel corpus include synthetic translations?
Yes, but the generated side and production method should be identified. Synthetic pairs differ in provenance and potential errors from independently produced human translations.
Check your understanding
Check your understanding: You collect fifty English articles and fifty French articles about renewable energy, but none is known to translate another. Is the collection necessarily parallel?
Answer: No. Shared topic and equal document counts are insufficient. It may be a comparable multilingual collection. To call it parallel, establish translation relationships and document the relevant alignment level.
Related terms
- Machine translation
- Translation memory
- Backtranslation
- bitext
- comparable corpus
- sentence alignment
- word alignment
- corpus cleaning
Learn next
take a short text and an approved translation, then link corresponding passages without assuming identical sentence counts. Mark omissions, merges and uncertain links. Finally design a review sample and a document-level evaluation split that prevents duplicated passages from appearing on both sides.
More in Natural language and speech
- Optical braille recognition - Optical braille recognition is the process of recognizing braille from an image and converting the recognized patterns into a digital representation.
- Palatal sound - Definition: A palatal sound is a speech sound whose primary constriction is formed with the front of the tongue body near or against the hard palate.
- Palato-alveolar sound - Definition: A palato-alveolar sound is a speech sound produced with the tongue blade forming a constriction just behind the alveolar ridge, typically with a...
- Parse tree - A parse tree is a tree-shaped representation of a grammatical analysis.
- PARSEVAL - PARSEVAL is a family of measures for evaluating constituency parses by comparing their constituent boundaries, and commonly their labels, with a reference...
- Parsing - Parsing is the process of analyzing an expression's structure according to a grammar or structural model.
Sources
Sources: Jurafsky and Martin, Speech and Language Processing, Chapter 13, parallel training data, sentence alignment and synthetic bitext: https://web.stanford.edu/~jurafsky/slp3/13.pdf . Philipp Koehn, Europarl: A Parallel Corpus for Statistical Machine Translation, 2005, primary description of a parliamentary translation corpus: https://aclanthology.org/2005.mtsummit-papers.11.pdf . Historical corpus descriptions are not current size claims. The bilingual alignment example and Northline Manuals case are original illustrations.
Previous: Parallel computing Next: Parallel mesh generation