Pavlovs parsed from the archived questions
Moderators: alietr, trainman, econgator, dhkendall
- mystcmage
- Loyal Jeopardista
- Posts: 222
- Joined: Sun Jun 15, 2014 12:33 pm
Pavlovs parsed from the archived questions
I've seen previous threads that listed the common word associations (aka pavlovs) and it got me wondering if I could do the same by using the archived questions.
I loaded them all into a database and parsed out anything between double-quotes, any consecutive capitalized words (referred to in the files as "names"), and any consecutive keywords.
Here are the results.
Pre-Formatting:
* I grouped responses that I could reasonably expect to be the same.
"Einstein" became "Albert Einstein" and "JFK" became "John F. Kennedy", for instance.
* I changed month abbrevations in the clue to the full name (Feb. to February).
Groups:
* Quotes - anything between ""
* Names - consecutive capitalized words, optionally connected by lowercase words
(Simon & Garfunkel, The House of the Seven Gables, San Diego, Germany)
* Keywords - any consecutive words (excluding some like "the", "and", and others)
The files only contain multi-word phrases. Partly because my computer is not powerful enough to run a query on single words, and partly because they would not be as useful as the multi-word phrases.
Formatting:
* Names that match quotes are changed to the full quote
* Keywords that match names or quotes are changed to the full name or quote
Files:
* The numbers represent the minimum number of appearances in the archive
* Any phrase that matched multiple responses is removed
Daniel Defoe is associated with both "Moll Flanders" and "Robinson Crusoe", but since it cannot be narrowed down to one, I left it off.
App:
I created an Android app to quickly run through these and other flashcards. https://play.google.com/store/apps/deta ... .flashcard
It's pretty barebones at the moment, but the best feature is that I turned all the phrases into links to Wikipedia.
Whenever I encounter something new, it's only a tap away to find out about it.
I've been tweaking these lists for weeks and it has done wonders for my Coryat score at home and at the local pub quiz.
Let me know if you find these useful and any suggestions of how I can improve them.
http://mystcmage.site50.net/flashcards
I loaded them all into a database and parsed out anything between double-quotes, any consecutive capitalized words (referred to in the files as "names"), and any consecutive keywords.
Here are the results.
Pre-Formatting:
* I grouped responses that I could reasonably expect to be the same.
"Einstein" became "Albert Einstein" and "JFK" became "John F. Kennedy", for instance.
* I changed month abbrevations in the clue to the full name (Feb. to February).
Groups:
* Quotes - anything between ""
* Names - consecutive capitalized words, optionally connected by lowercase words
(Simon & Garfunkel, The House of the Seven Gables, San Diego, Germany)
* Keywords - any consecutive words (excluding some like "the", "and", and others)
The files only contain multi-word phrases. Partly because my computer is not powerful enough to run a query on single words, and partly because they would not be as useful as the multi-word phrases.
Formatting:
* Names that match quotes are changed to the full quote
* Keywords that match names or quotes are changed to the full name or quote
Files:
* The numbers represent the minimum number of appearances in the archive
* Any phrase that matched multiple responses is removed
Daniel Defoe is associated with both "Moll Flanders" and "Robinson Crusoe", but since it cannot be narrowed down to one, I left it off.
App:
I created an Android app to quickly run through these and other flashcards. https://play.google.com/store/apps/deta ... .flashcard
It's pretty barebones at the moment, but the best feature is that I turned all the phrases into links to Wikipedia.
Whenever I encounter something new, it's only a tap away to find out about it.
I've been tweaking these lists for weeks and it has done wonders for my Coryat score at home and at the local pub quiz.
Let me know if you find these useful and any suggestions of how I can improve them.
http://mystcmage.site50.net/flashcards
- MarkBarrett
- Watches Jeopardy! Way Too Much
- Posts: 16471
- Joined: Fri Jul 01, 2011 10:37 am
- Location: San Francisco
Re: Pavlovs parsed from the archived questions
I had fun looking at the ones with double digit counts. If anyone has never heard of those then they have not been paying enough attention.
- sillymonkey
- Loyal Jeopardista
- Posts: 181
- Joined: Sat Jun 22, 2013 6:34 pm
Re: Pavlovs parsed from the archived questions
Thank you for sharing. Having many ways to link pieces of information together is useful, and this tool looks useful, fun, or both. I downloaded the flash cards and intend to play around with them. Good work!
- TheSunWillComeOut
- Two-Morrow
- Posts: 344
- Joined: Fri Jun 21, 2013 10:12 pm
Re: Pavlovs parsed from the archived questions
Apologies for bumping an old thread, but as your current Jeopardy! champion, I just wanted to give a plug to what I found to be one of the most useful resources for my own studies, especially since it has a ridiculous three (3!) posts. mystcmage is a genius for doing this. I spent years meticulously studying the J-Archive to hone my trivia chops, but when The Call came and the clock was finally ticking, it was last-minute cramming off that link provided at the bottom that saved my tuchus on quite a few questions, both by providing helpful Pavlovs and by refreshing my memory on what was ABSOLUTELY necessary to keep in mind before going on J!.
Save the lists at the link below, memorize them, check them against the clues in the J-Archive for other useful tidbits you might want to pick up about each subject. Doing that for "19th Amendment - Susan B. Anthony" a week or two before I taped was how I came to note several past J! references to 1872, and thanks to that, I now have an extra few thousand dollars to my name.
If you have any intention of appearing on the show, my advice to you is this: Don't ignore this post. Listen. Heed. Respect. Otherwise, you pass over a pot of gold.
Save the lists at the link below, memorize them, check them against the clues in the J-Archive for other useful tidbits you might want to pick up about each subject. Doing that for "19th Amendment - Susan B. Anthony" a week or two before I taped was how I came to note several past J! references to 1872, and thanks to that, I now have an extra few thousand dollars to my name.
If you have any intention of appearing on the show, my advice to you is this: Don't ignore this post. Listen. Heed. Respect. Otherwise, you pass over a pot of gold.
- mystcmage
- Loyal Jeopardista
- Posts: 222
- Joined: Sun Jun 15, 2014 12:33 pm
Re: Pavlovs parsed from the archived questions
I can't ask for a better review than someone who has actually used it to win on Jeopardy!
I didn't know anyone was using the flashcards outside of the app, so I have not updated them in a long while.
With my next update of the app, I'll be sure to update the text files too.
When I tried Anki, it had me repeat the first 12 cards over-and-over until I got them right.
I'm sure it's more customizable than I could figure out, but it's the customizability that led me to write my own app.
Some of my most used modes are removing cards I've already seen in the last week or 2, or removing those I've already answered with 70% accuracy.
I could not find a similar function in Anki.
With 500K questions currently in my database, the cards have greatly increased in size (and accuracy).
If anyone has other sources that would make good additions to the database, I'm always on the lookout.
This is a short list of sources I'm already including:
Trivia Shows (Millionaire, The Chase, 500 Questions, Ask Me Another, Good Job Brain!)
Billboard charts
Movies (plots, roles, wiki)
TV (plots, roles, wiki)
Bestselling books by year
People that already appear in the J! questions (Short biographies and wiki)
Trivia Apps (Trivia Crack, QuizUp)
In addition to this, I'm always looking for more thesauruses.
I have no idea how many Pavlovs are lurking in the questions just because they've asked the same thing in a different way, but I suspect it's a lot.
I didn't know anyone was using the flashcards outside of the app, so I have not updated them in a long while.
With my next update of the app, I'll be sure to update the text files too.
When I tried Anki, it had me repeat the first 12 cards over-and-over until I got them right.
I'm sure it's more customizable than I could figure out, but it's the customizability that led me to write my own app.
Some of my most used modes are removing cards I've already seen in the last week or 2, or removing those I've already answered with 70% accuracy.
I could not find a similar function in Anki.
With 500K questions currently in my database, the cards have greatly increased in size (and accuracy).
If anyone has other sources that would make good additions to the database, I'm always on the lookout.
This is a short list of sources I'm already including:
Trivia Shows (Millionaire, The Chase, 500 Questions, Ask Me Another, Good Job Brain!)
Billboard charts
Movies (plots, roles, wiki)
TV (plots, roles, wiki)
Bestselling books by year
People that already appear in the J! questions (Short biographies and wiki)
Trivia Apps (Trivia Crack, QuizUp)
In addition to this, I'm always looking for more thesauruses.
I have no idea how many Pavlovs are lurking in the questions just because they've asked the same thing in a different way, but I suspect it's a lot.
-
- Just Starting Out on JBoard
- Posts: 2
- Joined: Tue Apr 05, 2016 12:01 pm
Re: Pavlovs parsed from the archived questions
Hi,
I know this hasn't been updated in a while but I wanted to know if you've ever thought about making a similar app for the iTunes store?
No one in my family has an android phone so I can't access the flashcards that way.
I will look on your website but I was hoping that maybe you've ported your app over to Apple.
I know this hasn't been updated in a while but I wanted to know if you've ever thought about making a similar app for the iTunes store?
No one in my family has an android phone so I can't access the flashcards that way.
I will look on your website but I was hoping that maybe you've ported your app over to Apple.
- MrMushnik
- Wheel of Jeopardy!
- Posts: 26
- Joined: Tue Jun 03, 2014 11:10 pm
Re: Pavlovs parsed from the archived questions
^ Same question. Or a web version? I'm starting to "train" for J! as my knowledge is there, but not quite there enough to pass the test. Thanks in advance!
- mystcmage
- Loyal Jeopardista
- Posts: 222
- Joined: Sun Jun 15, 2014 12:33 pm
Re: Pavlovs parsed from the archived questions
I don't have any experience building iOS apps, so I have no plans to do so.
I see Anki has an iOS app, so there's probably a way to download the flashcards from my site and put them in whatever format Anki accepts.
I updated all the flashcards on the site just now, so you'll see that they're significantly larger.
I estimate that I can find matches in my flashcards to about 1/3 of the questions any given night.
For tests, that number is probably about 1/2, so this should get you over the hump.
When I started the project, I would get barely 35/50, now I average about 45.
I see Anki has an iOS app, so there's probably a way to download the flashcards from my site and put them in whatever format Anki accepts.
I updated all the flashcards on the site just now, so you'll see that they're significantly larger.
I estimate that I can find matches in my flashcards to about 1/3 of the questions any given night.
For tests, that number is probably about 1/2, so this should get you over the hump.
When I started the project, I would get barely 35/50, now I average about 45.
- TheSunWillComeOut
- Two-Morrow
- Posts: 344
- Joined: Fri Jun 21, 2013 10:12 pm
Re: Pavlovs parsed from the archived questions
From those of us who understand the value of what you're doing here, I cannot thank you enough for the incredible resource you are providing to the trivia community.mystcmage wrote:I don't have any experience building iOS apps, so I have no plans to do so.
I see Anki has an iOS app, so there's probably a way to download the flashcards from my site and put them in whatever format Anki accepts.
I updated all the flashcards on the site just now, so you'll see that they're significantly larger.
I estimate that I can find matches in my flashcards to about 1/3 of the questions any given night.
For tests, that number is probably about 1/2, so this should get you over the hump.
When I started the project, I would get barely 35/50, now I average about 45.
- cf1140
- Not Jeopardy! Material
- Posts: 500
- Joined: Mon Apr 14, 2014 10:04 pm
Re: Pavlovs parsed from the archived questions
I've been using this APP in my jeopardy studies and it has helped immensely. Thanks.
- MrMushnik
- Wheel of Jeopardy!
- Posts: 26
- Joined: Tue Jun 03, 2014 11:10 pm
Re: Pavlovs parsed from the archived questions
Yes, this is amazing. Thank you!! I almost asked if you had an excel spreadsheet so I could import these into quizlet, but apparently you don't need one. I downloaded the zip file. Please let me know if this is not okay to be public. I'm not trying to compete with your app or anything, I just don't have access to an android device. (This isn't even close to all of it, you can only have 2000 terms per "study set." Just playing around at this point. You can mark terms you want to save for studying on this site).
https://quizlet.com/135409469/formatted ... ash-cards/
Also, I may be data illiterate, but is "formatted pavlov" the same content as everything in combined pavlov, combined all pavlov, formatted name pavlov, combined formatted name pavlov, combined all name pavlov, etc... Just trying to figure out which would be most valuable to make web-based flashed cards out of. I should be asleep but also awake now for work And am I missing something with jus 3, 4, 5, 7, and 10 listed? Thank you again!!
https://quizlet.com/135409469/formatted ... ash-cards/
Also, I may be data illiterate, but is "formatted pavlov" the same content as everything in combined pavlov, combined all pavlov, formatted name pavlov, combined formatted name pavlov, combined all name pavlov, etc... Just trying to figure out which would be most valuable to make web-based flashed cards out of. I should be asleep but also awake now for work And am I missing something with jus 3, 4, 5, 7, and 10 listed? Thank you again!!
- Archimedean
- Just Starting Out on JBoard
- Posts: 1
- Joined: Fri Feb 12, 2016 10:38 pm
Re: Pavlovs parsed from the archived questions
The Android app has been super helpful, thank you! The link to the zip file on mystcmage.site50.net has gone down, though. Any chance of restoring access to the file? Thanks very much again!
Paul
Paul
- Peachbox
- Sports Jeopardy! Contestant
- Posts: 684
- Joined: Fri Jun 20, 2014 5:25 am
Re: Pavlovs parsed from the archived questions
Does anyone have access to the original zip file for these Pavlovs? I'd be curious to learn more about the frequency of various terms. Thanks!
- AndyTheQuizzer
- Lots and Lots of Interviews
- Posts: 2594
- Joined: Fri Jul 01, 2011 11:01 am
- Location: St. John's, Newfoundland and Labrador, Canada
- Contact:
Re: Pavlovs parsed from the archived questions
I think OP's signature has a working URL? Is that what you're looking for?
- MinnesotaMyron
- JBOARDIE OF THE MONTH!
- Posts: 3428
- Joined: Fri Jul 01, 2011 12:53 pm
Re: Pavlovs parsed from the archived questions
!!!OntarioQuizzer wrote: ↑Sun Jul 15, 2018 10:56 pmI think OP's signature has a working URL? Is that what you're looking for?
I was hoping someone would post them. Thanks for the update.
- Peachbox
- Sports Jeopardy! Contestant
- Posts: 684
- Joined: Fri Jun 20, 2014 5:25 am
Re: Pavlovs parsed from the archived questions
Whoops! It sure does, the "Web flashcards" link. I had tried only the site50.net one. Thank you!OntarioQuizzer wrote: ↑Sun Jul 15, 2018 10:56 pmI think OP's signature has a working URL? Is that what you're looking for?
-
- Watches Jeopardy! Way Too Much
- Posts: 486
- Joined: Wed Jan 15, 2014 11:32 am
Re: Pavlovs parsed from the archived questions
Ok, tech question with a simple answer, but I rarely use any apps. I downloaded the zip file and the trivia flashcards app, but can't figure out how to import the files into the app. I extracted them all. Now what? They're just sitting in my phone's files. If someone who can help needs more info (phone type, etc.), message me. Thanks!
- MinnesotaMyron
- JBOARDIE OF THE MONTH!
- Posts: 3428
- Joined: Fri Jul 01, 2011 12:53 pm
Re: Pavlovs parsed from the archived questions
On the version of the app I have, the flashcards are already loaded. The 2 lines above the buttons on the home screen with the flag/tabs at the end of them are drop-down menus.ouachiouat wrote: ↑Mon Jul 16, 2018 10:07 am Ok, tech question with a simple answer, but I rarely use any apps. I downloaded the zip file and the trivia flashcards app, but can't figure out how to import the files into the app. I extracted them all. Now what? They're just sitting in my phone's files. If someone who can help needs more info (phone type, etc.), message me. Thanks!
- MinnesotaMyron
- JBOARDIE OF THE MONTH!
- Posts: 3428
- Joined: Fri Jul 01, 2011 12:53 pm
Re: Pavlovs parsed from the archived questions
Archive.org has the lot, save for the zip file, which since the links all work, you don't need:
https://web.archive.org/web/20170330223 ... lashcards/
https://web.archive.org/web/20170330223 ... lashcards/