B_Kc J @ s d Z d d k Td d k Td d k Td d k Td d k Td d k Td d k Td d k Td d k Td d k
Td d k Td d k Td d k
Td d k Td d k Td d k Td d k Td d k Td d k Td d k Td d k Td d k Td d k Td d k Td d k Td d k Td d k Td d k Td d k Td d k Td d k Z d d d d d d d
d d d
d d d d d d d d d d d d d d d d d d d d! d" d# d$ d% d& d' d( d) d* d+ d, d- d. g+ Z d S(/ s
NLTK corpus readers. The modules in this package provide functions
that can be used to read corpus fileids in a variety of formats. These
functions can be used to read both the corpus fileids that are
distributed in the NLTK corpus package, and corpus fileids that are part
of external corpora.
Corpus Reader Functions
=======================
Each corpus module defines one or more X{corpus reader functions},
which can be used to read documents from that corpus. These functions
take an argument, C{item}, which is used to indicate which document
should be read from the corpus:
- If C{item} is one of the unique identifiers listed in the corpus
module's C{items} variable, then the corresponding document will
be loaded from the NLTK corpus package.
- If C{item} is a fileid, then that file will be read.
Additionally, corpus reader functions can be given lists of item
names; in which case, they will return a concatenation of the
corresponding documents.
Corpus reader functions are named based on the type of information
they return. Some common examples, and their return types, are:
- I{corpus}.words(): list of str
- I{corpus}.sents(): list of (list of str)
- I{corpus}.paras(): list of (list of (list of str))
- I{corpus}.tagged_words(): list of (str,str) tuple
- I{corpus}.tagged_sents(): list of (list of (str,str))
- I{corpus}.tagged_paras(): list of (list of (list of (str,str)))
- I{corpus}.chunked_sents(): list of (Tree w/ (str,str) leaves)
- I{corpus}.parsed_sents(): list of (Tree with str leaves)
- I{corpus}.parsed_paras(): list of (list of (Tree with str leaves))
- I{corpus}.xml(): A single xml ElementTree
- I{corpus}.raw(): unprocessed corpus contents
For example, to read a list of the words in the Brown Corpus, use
C{nltk.corpus.brown.words()}:
>>> from nltk.corpus import brown
>>> print brown.words()
['The', 'Fulton', 'County', 'Grand', 'Jury', 'said', ...]
[Work in Progress:
Corpus Metadata
===============
Metadata about the NLTK corpora, and their individual documents, is
stored using U{Open Language Archives Community (OLAC)
} metadata records. These records
can be accessed using C{nltk.corpus.I{corpus}.olac()}.]
i( t *Nt CorpusReadert CategorizedCorpusReadert PlaintextCorpusReadert find_corpus_fileidst TaggedCorpusReadert CMUDictCorpusReadert ConllChunkCorpusReadert WordListCorpusReadert PPAttachmentCorpusReadert SensevalCorpusReadert IEERCorpusReadert ChunkedCorpusReadert SinicaTreebankCorpusReadert BracketParseCorpusReadert IndianCorpusReadert ToolboxCorpusReadert TimitCorpusReadert YCOECorpusReadert MacMorphoCorpusReadert SyntaxCorpusReadert AlpinoCorpusReadert RTECorpusReadert StringCategoryCorpusReadert EuroparlCorpusReadert CategorizedTaggedCorpusReadert CategorizedPlaintextCorpusReadert* PortugueseCategorizedPlaintextCorpusReadert! tagged_treebank_para_block_readert PropbankCorpusReadert VerbnetCorpusReadert BNCCorpusReadert ConllCorpusReadert XMLCorpusReadert NPSChatCorpusReadert SwadeshCorpusReadert WordNetCorpusReadert WordNetICCorpusReadert SwitchboardCorpusReadert DependencyCorpusReadert NombankCorpusReadert IPIPANCorpusReadert Pl196xCorpusReadert
TEICorpusView(! t __doc__t nltk.corpus.reader.plaintextt nltk.corpus.reader.utilt nltk.corpus.reader.apit nltk.corpus.reader.taggedt nltk.corpus.reader.cmudictt nltk.corpus.reader.conllt nltk.corpus.reader.chunkedt nltk.corpus.reader.wordlistt nltk.corpus.reader.xmldocst nltk.corpus.reader.ppattacht nltk.corpus.reader.sensevalt nltk.corpus.reader.ieert" nltk.corpus.reader.sinica_treebankt nltk.corpus.reader.bracket_parset nltk.corpus.reader.indiant nltk.corpus.reader.toolboxt nltk.corpus.reader.timitt nltk.corpus.reader.ycoet nltk.corpus.reader.rtet" nltk.corpus.reader.string_categoryt nltk.corpus.reader.propbankt nltk.corpus.reader.verbnett nltk.corpus.reader.bnct nltk.corpus.reader.nps_chatt nltk.corpus.reader.wordnett nltk.corpus.reader.switchboardt nltk.corpus.reader.dependencyt nltk.corpus.reader.nombankt nltk.corpus.reader.ipipant nltk.corpus.reader.pl196xt
bracket_parset __all__( ( ( s1 /p/zhu/06/nlp/nltk/nltk/corpus/reader/__init__.pys > sn