Protocol : Specification of the Hypertopic protocol
author: Hypertopic
created: 2011-12-30 09:24:58
annotation corpus digital-humanities fragments highlight protocol viewpoint


wp2txt : WP2TXT extracts plain text data from Wikipedia dump file (encoded in XML/compressed with Bzip2) stripping all the MediaWiki markups and other metadata.
author: yohasebe
created: 2012-06-06 02:56:02
corpus nlp ruby wikipedia wikipedia-dump


quanteda : An R package for the Quantitative Analysis of Textual Data
author: quanteda
created: 2012-08-15 10:15:43
corpus natural-language-processing quanteda r text-analytics


pymtranslate : Probabilistic Foreign Language Translator
author: accraze
created: 2013-11-08 07:05:00
corpus machine-translation nlp python


corpora : A collection of small corpuses of interesting data for the creation of bots and similar stuff.
author: dariusk
created: 2014-02-23 00:52:11
bots corpus language words javascript


proiel-treebank : Official releases of the PROIEL treebank of ancient Indo-European languages
author: proiel
created: 2014-04-17 13:37:04
ancient-greek ancient-languages armenian corpus gothic2 language latin linguistics new-testament old-church-slavonic treebank


aspen : 🔎 📖 ✨ Custom, private search engine for text documents built with NextJS/React/ES6/ES7
author: statico
created: 2014-08-11 15:57:02
corpus docker elasticsearch es6 es7 javascript nextjs plaintext plaintext-documents search search-engine


gum : Repository for the Georgetown University Multilayer Corpus (GUM)
author: amir-zeldes
created: 2015-01-14 21:58:24
annis annotations coreference corpus pos-tagging rhetorical-structure-theory treebank python


thai-language : computer tools for thai language
author: nevmenandr
created: 2015-03-20 08:03:38
corpus linguistic-corpora opennlp python thai-language


Naive-Bayes-classifier : Naive Bayes classifier is classification algorithm. It uses Naive based Bernoulli and Multinomial equation to classify documents(Text) as ham or spam.
author: wonderer007
created: 2015-04-16 19:21:33
algorithm bernoulli classification-algorithm classify-documents corpus corpus-folder eclipse ham java naive-bayes-classifier


everyfinnishword : Every Finnish word
author: hugovk
created: 2015-05-22 21:45:17
corpus finnish language words


croatiae-auctores-latini-textus : XML texts of Croatian Latin authors (published as CroALa digital collection)
author: nevenjovanovic
created: 2015-05-30 22:05:23
corpus croatia latin linguistics neo-latin


twitter-kanji-frequency : Collecting kanji usage frequency data from Twitter Streaming API
author: scriptin
created: 2015-05-31 12:20:20
corpus corpus-linguistics data data-mining frequency-lists japanese japanese-language kanji kanji-frequency streaming-api twitter twitter-api twitter-bot javascript


castarter : castarter - Content analysis starter toolkit for R
author: giocomai
created: 2015-06-01 14:43:08
content-analysis corpus r rstats


stock-newspaper-crawler : [UNMAINTAINED]Crawl 4 kinds of finance newspaper corpus (from CCSTOCK.CN).
author: ysh329
created: 2015-07-22 01:59:14
corpus crawled-data crawler database stock-newspaper-crawler python


proiel-cli : Command-line utilities for working with PROIEL treebanks
author: proiel
created: 2015-08-07 22:32:17
corpus greek language latin linguistics treebank ruby


proiel : A library for working with PROIEL treebanks
author: proiel
created: 2015-08-07 22:35:05
corpus greek language latin linguistics treebank ruby


iswoc-treebank : Official releases of the ISWOC treebank
author: iswoc
created: 2015-08-20 09:04:41
corpus european-languages linguistics old-french old-portuguese old-project old-spanish treebank


dimsum-data : Data for the DiMSUM shared task at SEMEVAL 2016
author: dimsum16
created: 2015-09-14 14:37:26
corpus lexical-semantics multiword-expressions reviews supersenses ted-talks twitter python


asp-source : Source stories from the African Storybook Project in Markdown format
author: global-asp
created: 2015-10-04 18:08:55
africa corpus creative-commons multilingual storybooks


negochat_corpus : Negochat Corpus - a dialogue corpus in the negotiation domain
author: vaskonov
created: 2015-10-12 16:00:57
chat chatbot corpus dataset dialogs dialogue-systems machine-learning natural-language-processing natural-language-understanding negotiation


bible-corpus : A multilingual parallel corpus created from translations of the Bible.
author: christos-c
created: 2015-10-15 18:23:23
bible bible-corpus corpus multilingual translation


wordfish-python : extract relationships from standardized terms from corpus of interest with deep learning :fish:
author: word-fish
created: 2015-10-28 16:41:02
corpus gensim lda nlp token word2vec css


more-stoplists : stoplists for African languages generated from the ASP corpus
author: dohliam
created: 2015-11-25 14:09:49
africa african-languages afrikaans corpus corpus-linguistics frequency-lists hausa lugbarati sesotho somali stoplist stoplists stopwords swahili yoruba zulu ruby


textbox : Text collections made available by the CLiGS group.
author: cligs
created: 2015-12-13 18:42:27
corpus digital-humanities french literary-studies portuguese spanish text-collection xml


korpus-plagiarisme-indonesia : Kumpulan dokumen korpus dalam bahasa Indonesia berisi kasus uji deteksi plagiarisme eksternal dengan standar PAN CLEF (http://www.uni-weimar.de/medien/webis/events/pan-11).
author: felikjunvianto
created: 2015-12-24 16:55:56
bahasa-indonesia corpus corpus-data indonesian-language korpus-plagiarisme-indonesia plagiarism-detection plagiarism-detector plagiarism-evaluation plagiarism-provider python


kanji-frequency : Kanji usage frequency data collected from various sources
author: scriptin
created: 2016-01-24 01:51:10
cjk cjk-characters corpus corpus-linguistics data data-visualization frequency-lists japanese japanese-language kanji kanji-frequency javascript


SerbMR : The Serbian Movie Review Dataset
author: vukbatanovic
created: 2016-02-18 21:31:56
corpora corpus dataset movie-review-datasets movie-reviews semantics sentiment-analysis sentiment-classification serbian serbian-language text-classification weka


habeas-corpus : Command-line corpus tools
author: jonsafari
created: 2016-02-23 12:53:17
command-line-tools corpora corpus corpus-linguistics text-corpus vocabulary shell


EdgarAllanPoetry : Computer-generated poetry
author: RyanMarcus
created: 2016-02-27 01:05:22
corpus poem-generator recurrent-neural-networks rnn css


Geste : Un corpus de chansons de geste
author: Jean-Baptiste-Camps
created: 2016-03-23 17:35:00
corpus corpus-data lemmatization old-french pos-tagging xml-tei html


pb-source : Pratham Books stories in Markdown format
author: global-asp
created: 2016-04-24 21:41:52
corpus creative-commons india multilingual storybooks


eKeyboard : Make typing Amharic [on mobile] great [again].
author: utopiaio
created: 2016-05-09 07:02:02
amharic corpus keyboard typing-amharic javascript


muc3 : Message Understanding Conference 3 Corpus
author: dstl
created: 2016-05-26 14:53:59
corpus html tipster


frequency-count-benchmark : Benchmarking various tools for counting word and phrase frequency in corpora [for windows]
author: monolithpl
created: 2016-06-20 22:34:47
corpora corpus corpus-linguistics frequency-analysis grep phrase-frequency batchfile


hawaiian-corpus : Data from a corpus of written Hawaiian
author: dohliam
created: 2016-06-27 16:53:06
bigrams corpora corpus corpus-data corpus-linguistics frequency frequency-list hawaii hawaiian hawaiian-electronic-library hawaiian-language n-grams ngram olelo-hawaii stoplist stopwords ulukau


corpus-tools : A collection of scripts for working with multilingual text corpora
author: dohliam
created: 2016-06-27 20:17:01
corpora corpus corpus-linguistics frequency language linguistics ngram ngrams ruby salience stoplist stopwords


russian_news_corpus : Russian mass media stemmed texts corpus / Корпус лемматизированных (морфологически нормализованных) текстов российских СМИ
author: maxoodf
created: 2016-07-25 13:28:10
articles corpus machine-learning ml nlp nlp-machine-learning russian text word2vec


japanese-words-to-vectors : Word2vec (word to vectors) approach for Japanese language using Gensim and Mecab.
author: philipperemy
created: 2016-09-04 00:41:37
corpus gensim japanese japanese-language wikipedia word2vec word2vec-algorithm python


phonologicalEditDistance : Offers a measure of phonological dissimilarity by calculating the phonological edit distance within and between sets of words.
author: dvdmrn
created: 2016-09-16 19:14:57
corpus linguistics phonological-features phonology python


porter2 : A PHP implementation of the English (Porter 2) Stemmer.
author: markfullmer
created: 2016-09-20 17:47:39
corpus php porter search-algorithm stemmer


akec : Arabic Keyphrase Extraction Corpus
author: ailab-uniud
created: 2016-09-27 08:43:42
arabic arabic-nlp corpus crowdsourcing dataset keyphrase-extraction shell


cts-croala : Convert Neo-Latin XML editions from CroALa to CTS / CITE Architecture
author: nevenjovanovic
created: 2016-09-30 19:33:51
corpus croatia cts language latin literature neo-latin xquery


UD_Portuguese-Bosque :
author: UniversalDependencies
created: 2016-10-05 12:10:45
corpus universal-dependencies


metacorps : Web app and tools for quantitative analysis of metaphor in corpora
author: mt-digital
created: 2016-10-14 22:32:45
corpus corpus-data webapp jupyter notebook


PoetryCorpus : Поэтический корпус русского языка
author: IlyaGusev
created: 2016-10-24 00:49:29
corpus django docker nlp python


lingcorpora.py : API for corpora
author: alexeykosh
created: 2016-11-01 15:39:51
api corpora corpus national-corpus package python


zoloto : розмічений руками морфо’, синт’, кореф’ корпус української мови
author: mova-institute
created: 2016-11-01 23:19:04
coreference corpus linguistics morphology nlp treebank ukrainian universal-dependencies


wixarikacorpora : Wixarika language corpora
author: pywirrarika
created: 2016-11-14 19:21:13
corpus language native javascript


riverrun : (NaNoGenMo 2016) Dense, incomprehensible Joycean tract that will keep the professors busy for centuries. http://charlesreid1.github.io/riverrun
author: charlesreid1
created: 2016-11-19 06:13:33
corpus html james-joyce joyce nanogenmo nltk parse queneau-generator python


newsfeed-corpus :
author: rcarmo
created: 2016-11-20 13:10:46
asyncio corpus docker nltk python redis riotjs sanic sentiment-analysis swarm javascript


fastmorph : Fast corpus search engine originally made for the Corpus of Written Tatar language
author: mansayk
created: 2016-11-20 17:46:45
corpus search-engine c


awesome-deeplearning-resources : Deep Learning and deep reinforcement learning research papers and some codes
author: endymecy
created: 2016-11-28 05:42:02
code corpus deep-learning modelzoo neural-network nlp paper reinforcement-learning video


PersianStemmingDataset : Persian Stemming data-set in order to evaluate new stemmers
author: htaghizadeh
created: 2016-11-29 17:56:30
corpus correctness-evaluation dataset evaluation linguistics persian persian-language persian-nlp persian-stemmer stemmer pascal


gerdracor : German Drama Corpus
author: dracor-org
created: 2016-12-01 17:34:38
corpus digital-humanities drama dramatic-texts tei xml css


Chinese-Names-Corpus : 中文人名语料库。中文姓名,姓氏,名字,称呼,日本人名,翻译人名,英文人名。成语词典。
author: wainshine
created: 2016-12-08 15:47:52
corpus dataset dict names ner


paraphrased-opinion-spam : Paraphrased OPinion Spam (POPS) Corpus v1.0
author: jacobis
created: 2016-12-23 04:44:11
amazon-mechanical-turk corpus dataset review-spam


Springboard_Capstone : Springboard Foundations of Data Science - Capstone Project Repository
author: EugeneWoo
created: 2016-12-23 16:44:21
corpus n-grams nlp-keywords-extraction r sentiment-analysis sentiment-lexicons shiny string-matching tokenizer yelp-dataset


navigation-corpus : Navigation data used for Chen and Mooney 2011 and Artzi and Zettlemoyer 2013 (including cleaned up oracle data)
author: clic-lab
created: 2016-12-25 20:09:58
corpus natural-language-processing python


neoveille2016 : Repository for production-ready Neoveille programs (back-end and front-end)
author: ecartierlipn
created: 2017-01-04 13:39:49
corpora corpus engine innovation language lexical mysql-database pos-tagger python search solr solr-server treetagger javascript


chatterbot-corpus : A multilingual dialog corpus
author: gunthercox
created: 2017-01-11 02:56:38
chatterbot corpus dialog language yaml python


lexicon-thai : คลังศัพท์ภาษาไทย
author: PyThaiNLP
created: 2017-01-14 03:41:47
corpus lexicon-thai thai-language python


lcb-source : Little Cree Books stories in Markdown format
author: global-asp
created: 2017-01-19 14:18:58
canada corpus cree indigenous-languages storybooks storytelling syllabics


wmt12-preproc : Preprocesses wmt12 en-fr parallel corpora, locates document boundaries using raw data and marks with
author: rkulhanek
created: 2017-01-20 01:52:34
corpora corpus europarl forth


BIG_DATA : This is where we are making chatbot using seq2seq model , and will be trying different structures to make it more efficient
author: karangoel16
created: 2017-01-21 00:04:54
chatbot corpus tensorflow twitter python


Chimera : Source to binary corpora creation based on multiple different compiler invocations
author: syreal17
created: 2017-01-22 21:51:30
binary-analysis binary-data corpora corpus data dataset-creation dataset-generation obfuscator source-corpora shell


brazilian-blog-dataset : Collection of Brazilian Personal Story Posts
author: heukirne
created: 2017-01-25 18:33:38
blogs corpus detection nlp portuguese story jupyter notebook


WikiDocsAligner : Align Wikipedia articles based on interlang links
author: motazsaad
created: 2017-01-30 04:44:10
alignment corpus nlp python


arwikiExtracts : Arabic Wikipedia Extracts
author: motazsaad
created: 2017-02-03 07:30:01
arabic arabic-wikipedia corpus corpus-extracts nlp wikipedia


arzWikiExtracts : Egyptian Wikipedia Extracts
author: motazsaad
created: 2017-02-03 07:31:07
arabic corpus nlp


corpusconversion-tiger : Tool to convert the German Tiger corpus and other corpora in Tiger format to GATE
author: GateNLP
created: 2017-02-03 14:59:06
conversion corpus gate gatenlp nlp groovy


CorefMT :
author: a-rios
created: 2017-02-09 10:03:37
coreference-resolution corpora corpus machine-translation javascript


egret-wenda-corpus : A Public Corpus for Machine Learning
author: Samurais
created: 2017-02-12 05:12:17
corpus corpus-data qa javascript


pdf-corpus : Python script to quickly create hand-crafted PDF files
author: gendx
created: 2017-02-12 10:57:57
corpus pdf test-suite python


ptb-reader-rust : Simple parsing of the merged Penn Treebank format.
author: sjmielke
created: 2017-03-04 20:46:32
corpus nlp parsing ptb treebank rust


paraphrase.sr : The Serbian Paraphrase Corpus
author: vukbatanovic
created: 2017-03-11 16:42:49
corpora corpus news paraphrase paraphrases semantic-similarity semantic-textual-similarity semantics sentence-pairs serbian serbian-language sts stss


Dialog_Corpus : 用于训练中英文对话系统的语料库 Datasets for Training Chatbot System
author: candlewill
created: 2017-03-14 13:01:29
chatbot corpus dataset dialog system python


technological-book-corpus-ja : 日本語で書かれた技術書を収集した生コーパス/ツール
author: textlint-ja
created: 2017-03-26 04:27:57
book corpus japanese natural-language textlint javascript


Praaline : Praaline is an open-source system to manage, annotate, visualise and analyse spoken language corpora
author: praaline
created: 2017-03-27 23:28:06
annotations corpus corpus-builder corpus-linguistics corpus-tools linguistics speech-analysis speech-processing spoken-language-processing visualisation c


code-docstring-corpus : Preprocessed Python functions and docstrings for automated code documentation (code2doc) and automated code generation (doc2code) tasks.
author: EdinburghNLP
created: 2017-04-07 16:15:37
code-generation corpus docstrings documentation-generator neural-machine-translation python


sumspeech :
author: slack0
created: 2017-04-11 15:06:07
corpus matrix-factorization sentence speech summarization tf-idf topic-distribution topic-extraction topic-modeling vocabulary html


weibo_terminater : Final Weibo Crawler Scrap Anything From Weibo, comments, weibo contents, followers, anything. The Terminator
author: jinfagang
created: 2017-04-13 01:56:20
chatbot chinese corpus scraper sina weibo python


GIAnT : Graphical Image Anotation Tool - Digital Humanities - electron client server application with neo4j database for a mxgraph frontend with graph (network) logic
author: DanielPollithy
created: 2017-04-13 09:37:39
corpus digital-humanities electron-app exif expressjs mxgraph neo4j nodejs qualitative-analysis quantitative-analysis javascript


keyword-extract : This is a simple library for extracting keywords from data with/without using a corpus.
author: ankushbhatia2
created: 2017-04-14 07:25:09
corpus extract-keywords keyword-extraction nlp nlp-keywords-extraction nlp-library nlp-machine-learning pypi python


tweets-collector : Collect tweets (tweets corpus) using Twitter API. Collection can be based on hashtags, keywords, geographical location
author: motazsaad
created: 2017-04-21 08:55:02
corpus language-resources nlp tweets twitter-api twitter-corpus python


tif : Text Interchange Formats
author: ropensci
created: 2017-04-22 15:45:55
corpus natural-language-processing r r-package rstats term-frequency text-processing tokenizer


puts_cc : Get TOC and link to original articles through dictionaries and topics.
author: bitsofcotton
created: 2017-04-25 13:40:09
abbreviations before-alpha c-plusplus cast conflicts corpus detail prejudice simple-crawler statistics tensor toc word c++


gaelic-resources : A list of computational resources for Gaelic
author: RichardLitt
created: 2017-04-25 18:09:46
corpora corpus gaelic irish language nlp resources scots scottish scottish-gaelic


physicsPoetry :
author: dundalkian
created: 2017-04-26 03:48:54
bot corpus phonemes poem rhymes sentence tweets twitter python


RussianSketches : The algorithm of syntactic sketches generation for Russian.
author: maobedkova
created: 2017-05-01 20:15:36
collocations corpus instrument sketch-generation sketches syntax python


tag_converter : Convert files tagged with corpus metadata to JSON, PHP, or XML.
author: writecrow
created: 2017-05-13 15:44:34
corpus php-library php


Trump_Campaign_Corpus : Corpus of campaign speeches, interviews, debates, statements and tweets by Donald Trump
author: unendin
created: 2017-05-18 19:28:50
corpus text-mining trump


Speech-Corpus-Collection : A Collection of Speech Corpus for ASR and TTS
author: candlewill
created: 2017-05-19 09:07:01
asr corpus dataset tts


sejong-corpus : Korean sejong corpus download and simple analysis
author: coolengineer
created: 2017-05-21 05:53:38
corpus korean linux mac morphological-analysis python sejong shell


kpv-lit : Collection of Public Domain data in Komi-Zyrian
author: langdoc
created: 2017-06-03 10:55:18
corpus language-documentation linguistics uralic-languages


biblija-hr : Zefania XML edition of Bible translated into Croatian (Kršćanska sadašnjost, 1988)
author: nevenjovanovic
created: 2017-06-03 20:51:56
bible corpus croatian language linguistics xslt


Gossiping-Chinese-Corpus : PTT 八卦版問答中文語料
author: zake7749
created: 2017-06-28 10:18:21
chatbot chinese-corpus corpus dataset dialog jupyter notebook


PTTChatBot_DL2017 : DL course (NCTU, 2017 spring) final project
author: thisray
created: 2017-07-23 07:57:03
chatbot corpus mion ptt python tensorflow


Chatbot-Training-Corpus : 总结了一些可以用作聊天机器人训练实作的文字语聊，包含中英文不同语言
author: EternalFeather
created: 2017-07-25 06:45:21
chatbot corpus dialogue python


mimic-tools : MIMIC data resources
author: jtourille
created: 2017-07-26 11:56:21
corpus mimic-iii nlp python


Cookies help us deliver our services. By using our services, you agree to our use of cookies Learn more