Transformers for text processing¶
Transformers provides APIs and tools to easily download and train state-of-the-art pretrained models. Credits: Huggingface documentation
Text generation¶
In [1]:
from transformers import pipeline
# Create the text-generation pipeline with GPU
generator = pipeline("text-generation", device=0) # Specify the GPU device index
In [2]:
# Generate text from a prompt
generator("In this notebook, we show you how to")
Out[2]:
Summarization¶
In [3]:
# Create the summarization pipeline with GPU
summarizer = pipeline("summarization", device=0) # Specify the GPU device index
In [4]:
# text from the CERN website
summarizer(
"""
What is the Higgs boson?
Animation to show that a particle can also be thought of as a wave in a field
In quantum field theory, particles can be described as waves in a field (Image: Piotr Traczyk/CERN)
To answer this question needs an exploration into the quantum world and how particles interact…
The particle that we now call the Higgs boson first appeared in a scientific paper written by Peter Higgs in 1964. At that time, physicists were working on describing the weak force – one of the four fundamental forces of Nature – using a framework called quantum field theory.
Particle, wave or both?
Quantum field theory describes the microscopic world of particles very differently to everyday life. Fundamental “quantum fields” fill the universe and dictate what nature can and cannot do. In this description, every particle can be represented by a wave in a “field”, similar to a ripple on the surface of a vast ocean. One example is the photon, the particle of light, which is a wave in the electromagnetic field.
Force carriers
When particles interact with one another, they exchange “force carriers”. These force carriers are particles and can also be described as waves in their respective fields. For example, when two electrons interact, they do so by exchanging photons – photons are the force carriers of the electromagnetic interaction.
Symmetry
Another important component of this picture is symmetry. Just like a shape can be called symmetrical if it doesn’t change when rotated or flipped, similar requirements are placed on the laws of Nature.
For example, the electrical force between particles with an electrical charge of one will always be the same, irrespective of whether the particle is an electron, muon or proton. Such symmetries form the basis and define the structure of the theory.
"""
)
Out[4]:
Translation¶
In [ ]:
# sentencepiece is needed for this example
# pip install **and restart the notebook**
!pip install sentencepiece
In [1]:
from transformers import pipeline
# Create the translator pipeline with GPU
translator = pipeline("translation", model="Helsinki-NLP/opus-mt-en-fr", device=0)
#translator = pipeline("translation", model="Helsinki-NLP/opus-mt-en-fr")
In [4]:
# text from the CERN website
translator(
"""
The accelerator complex at CERN is a succession of machines that accelerate particles to increasingly higher energies.
Each machine boosts the energy of a beam of particles before injecting it into the next machine in the sequence.
In the Large Hadron Collider (LHC) – the last element in this chain – particle beams are accelerated up to the record energy of 6.5 TeV per beam.
""")
Out[4]:
In [ ]: