Wiktionary:Frequency lists

Definition from Wiktionary, a free dictionary

Jump to: navigation, search

Contents

[edit] Counting words and lemmas

The following frequency lists count distinct orthographic words, including inflected forms. For example, the verb "be" is represented by "is", "are", "were", "be", etc.

[edit] English

[edit] Most common words (TV and movie scripts)

Here are frequency lists comparable to the Gutenberg ones, but based on 29,213,800 words from TV and movie scripts and transcripts.

Here's a fuller explanation of how the list was generated and its limitations: Wiktionary:Frequency lists/TV/2006/explanation.

Here are the top 100 words (from tv scripts) in alphabetical order:

a · about · all · and · are · as · at · back · be · because · been · but · can · can't · come · could · did · didn't · do · don't · for · from · get · go · going · good · got · had · have · he · her · here · he's · hey · him · his · how · I · if · I'll · I'm · in · is · it · it's · just · know · like · look · me · mean · my · no · not · now · of · oh · OK · okay · on · one · or · out · really · right · say · see · she · so · some · something · tell · that · that's · the · then · there · they · think · this · time · to · up · want · was · we · well · were · what · when · who · why · will · with · would · yeah · yes · you · your · you're

Here they are in frequency order:

1-1000 · 1001-2000 · 2001-3000 · 3001-4000 · 4001-5000 · 5001-6000 · 6001-7000 · 7001-8000 · 8001-9000 · 9001-10000

From the 10000th to the 40000th :

10001-12000 · 12001-14000 · 14001-16000 · 16001-18000 · 18001-20000 · 20001-22000 · 22001-24000 · 24001-26000 · 26001-28000 · 28001-30000 · 30001-32000 · 32001-34000 · 34001-36000 · 36001-38000 · 38001-40000
40001-41284 (the dregs that were tied for 40,000th place)

That'll probably be it. It's a third of all the unique words. The rest were used 5 or fewer times each.

[edit] Most common words (Gutenberg)

These lists are the most frequent words, when performing a simple, straight (obvious) frequency count of all the books found on Project Gutenberg. The list of books was downloaded in July of 2005, and "rsync"'ed monthly thereafter. These are mostly English words, with some other languages finding representation to a lesser extent. Many Project Gutenberg books are scanned once their copyright expires, typically book editions published before 1923, so the language does not represent modern usage. For example, "hath" is listed as the 534th-most-common word. Also, with 24,000+ books, the text of the boilerplate warning for Project Gutenberg appears on each of them.

Here are the top 100 words (from Project Gutenberg texts) in alphabetical order:

a · about · after · all · and · any · an · are · as · at · been · before · be · but · by · can · could · did · down · do · first · for · from · good · great · had · has · have · her · he · him · his · if · into · in · is · its · it · I · know · like · little · made · man · may · men · me · more · Mr · much · must · my · not · now · no · of · on · one · only · or · other · our · out · over · said · see · she · should · some · so · such · than · that · the · their · them · then · there · these · they · this · time · to · two · upon · up · us · very · was · were · we · what · when · which · who · will · with · would · you · your
  • These wikified terms can be copied to other language wiktionaries, this is what they are intended for. If you do, please add an interwiki link onto the page here.
New list as of 4/16/2006:
New list as of 10/10/2005:
The same list divided by thousand words:
1-1000 1001-2000 2001-3000 3001-4000 4001-5000 5001-6000 6001-7000 7001-8000 8001-9000 9001-10000
more to come...
Older lists
Most common words, in order of rank:
Approximately 24,197 files, 1,712,082,956 words, 70,756.0 average words/file. from which were gleaned about 9,053,310 unique "words."
  • From the straight frequency count, the current copy of Wiktionary was then removed from that list. Even entries that only have a redirect were removed.
  1. Wiktionary:Frequency lists/Project Gutenberg undefined 1-1000
  • With somewhat different filtering/selection criteria:
  1. Wiktionary: Frequency Lists/Project Gutenberg undefined B 1-1000
  • The latest version can always be found at:
User:Connel MacKenzie/Gutenberg

[edit] Most common words in contemporary fiction

The 2,000 most common words in contemporary fiction can be found here:

The 2,000 most common words in contemporary fiction can be found here divided into 60 subject categories.

This lumps regular lemmas of the same word together, unlike most of these lists.

[edit] Most common words in contemporary poetry

The 2,000 most common words in contemporary poetry can be found here:

Another lemma-based list.

[edit] Top English words lists

[edit] British National Corpus: most frequent Word Families

See the list on Simple English Wiktionary.

[edit] Academic Word List by word family

See the list on Simple English Wiktionary.

[edit] Other languages

[edit] Czech words

/Czech

[edit] Dutch

[edit] The thirteen most popular Dutch words

From Max Havelaar (numbers between parentheses denote occurrences):

  1. de (4770)
  2. en (2709)
  3. het, 't (2469)
  4. van (2259)
  5. ik (1999)
  6. te (1935)
  7. dat (1875)
  8. die (1807)
  9. in (1639)
  10. een (1637)
  11. hij (1328)
  12. niet (1162)
  13. zijn (1049)

[edit] Frequency of diacritic characters in Dutch

From diacritic characters in the Dutch language:

Character Frequency
ë 1762
ï 599
é 468
è 248
ö 171
ê 71
ü 61
ó 35
ç 30
á 24
à 17
ä 16
û 8
î 7
í 5
ô 4
ú 4
ñ 4
â 3
Å 1

[edit] French words

Frequency lists from http://wortschatz.uni-leipzig.de/html/wliste.html with the authorization from the laboratory.

Note: these indicative lists still require some cleanup, because:

  1. they don't unify common words that are normally not capitalized in the dictionary, but can be capitalized at the begining of sentences or in titles;
  2. they do not break correctly words preceded by a separate word contracted with an apostrophe for very common articles (l’) or preposition (d’) or negation adverb (n’) or pronoun (c’, j’, l’, m’, s’, t’), or verbal liaison particles (-t-, -z-, which are not really words as they don't have any meaning but are written for phonetic reason), or pronoun subjects just after the verb (after a mandatory linking hyphen, that still does not make a compound word but denotes the inversion of the subject rather than the normal occurrence of an object): all these words should be counted separately;
  3. the source is certainly from Belgian French written papers only, with typical occurrences for that country and no equivalence for France, or other French speaking countries where these words are much rarely used (such as currency abbreviations, Belgian toponyms for regions and cities, and many missing terms for very common specialties in France);
  4. the list contains isolated letters that are not words, per se (except a few effective words: a, à, y);
  5. as well, there are acronyms and symbols occurring only in written documents but not as part of the spoken language;
  6. frequent proper names are included but are not very specific to any of the 4 studied languages.

This list does not unify inflected words (with plural or feminine mark on nouns or adjectives, or conjugated verbs), and does not recognize auxiliaries of verbs at compound tenses as part of the conjugated verb, but treat auxiliaries separately for each inflected form.

[edit] The most used Galician words

From the works of Ana Bugarín presented in the ILG Lexicographical Symposium 2006 (basical form):

  1. o (defined article)
  2. e (conjunction)
  3. de (preposition)
  4. do (contraction)
  5. que (relator)
  6. ser (verb)
  7. un (undefined article)
  8. no (contraction)
  9. se (reflexive pronoun/conditional conjunction)
  10. non (negation adverb)
  11. ó (contraction)
  12. a (preposition)
  13. en (preposition)
  14. ter (verb)
  15. para (preposition)
  16. por (preposition)

From the CORGA corpus (lexical items):

  1. de
  2. que
  3. a (article/preposition)
  4. e
  5. o
  6. do
  7. da
  8. non
  9. en
  10. os

The rest until the 1000th position is available at CORGA corpus.

[edit] German

[edit] Wikipedia words

See also the 100, 1000, or 10 000 most frequent words.

[edit] Words from subtitles

Top 2000 German words from subtitles:

[edit] Hungarian words

Top 100.000 words in Hungarian text: http://mokk.bme.hu/resources/webcorpus

Hungarian frequency list 1-10000

[edit] Icelandic

[edit] Verbs

The 100 most frequent Icelandic verbs according to the verb webpage.

Icelandic verb frequency list 1-100

[edit] Italian frequency list

Top 1000 Italian words from subtitles:

[edit] Top 200 Korean words

[edit] Slovene frequency lists

50 most frequent Slovene words, Primož Jakopin research:

je , in , se , v , da , na , so , ne , pa , ki , bi , za , z , ni , sem , ga , še , po , s , tako , ko , tudi , to , bil , ali , si , mu , od , bilo , kot , že , iz , kaj , bo , če , vse , bila , kakor , mi , pri , jo , kar , jih , sta , o , do , ti , kako , samo , me

[edit] Spanish frequency lists

Top 10000 Spanish words from subtitles:

[edit] Swedish frequency lists

[edit] Thai lists

If this is just "basic" words, not statistically the "most frequent" words, it shouldn't be here, it should be in the Appendix namespace only. --Connel MacKenzie 20:59, 26 December 2006 (UTC)

[edit] Turkish list

[edit] Russian frequency lists

[edit] Yiddish

[edit] In other Wiktionaries

[edit] External links

Retrieved from "http://en.wiktionary.org/wiki/Wiktionary:Frequency_lists"