corpus WHO European Region YouTube with examples

Examples related to the corpus submodule.

YouTube

• Richard Feynman - The Character of Physical Law (1964) - Complete - Better Audio “https://www.youtube.com/watch?v=kEx-gRfuhhk”

# Authors: The scikit-plots developers
# SPDX-License-Identifier: BSD-3-Clause

import os
import json
import sys
import textwrap
from pathlib import Path

import scikitplot as sp
from scikitplot import corpus
from scikitplot.corpus import (
    DocumentReader,
    CorpusPipeline,
    SentenceChunker,
    SentenceChunkerConfig,
    ExportFormat,
    CorpusDocument,
    SourceType,
    SentenceBackend,
    EnricherConfig,
    NLPEnricher,
)

pipeline = CorpusPipeline(
    chunker=SentenceChunker(SentenceChunkerConfig(backend=SentenceBackend.NLTK)),
    output_path=Path("output/"),
    format=ExportFormat.CSV,
)
pipeline

<scikitplot.corpus._pipeline.CorpusPipeline object at 0x78241cc5e5d0>

# Unfortunately, most IPs from cloud providers are blocked by YouTube.
# result = pipeline.run_url("https://www.youtube.com/shorts/VMZ40dVugAk")

# result = pipeline.run("https://www.youtube.com/shorts/VMZ40dVugAk")
# result

# print(result.documents)

# print(result.documents[0].text, result.documents[1].text)

# rich1 = NLPEnricher(EnricherConfig("nltk", lemmatizer="nltk", stemmer="snowball")).enrich_documents(result.documents[:1])
# rich1

# print(rich1[0].keywords, rich1[0].lemmas, rich1[0].stems)

Tags: model-type: classification model-workflow: corpus plot-type: text level: beginner purpose: showcase

Related examples

corpus A Tale of Two Cities .mp3 with examples

corpus A Tale of Two Cities .mp3 with examples

corpus WHO European Region local .zip with examples

corpus WHO European Region local .zip with examples

corpus WHO European Region local or url per file with examples

corpus WHO European Region local or url per file with examples

corpus Knowledge and Information local .png with examples

corpus Knowledge and Information local .png with examples