Why new Season 38 games will not appear in the J! Archive for awhile

This is where all of the games are discussed.

Moderators: alietr, trainman, econgator, dhkendall

User avatar
Robert K S
Jeopardy! Champion
Posts: 5239
Joined: Thu Jun 30, 2011 1:26 pm
Location: Cleveland, Ohio
Contact:

Why new Season 38 games will not appear in the J! Archive for awhile

Post by Robert K S »

Hey gang, in an attempt to realize computational speed improvements to the J! Archive, I have been rewriting the J! Archive backend core over the summer break to accommodate changes to the structure of the J! Archive database. The work represents the most significant changes to the code that runs the Archive since I first wrote it in 2004. The work was intended, as one simple example, to cut down the number of SQL queries needed to access a game's data from about 77 queries down to about 5 queries, and to promote efficiencies that could be had by indexing tables. I had hoped to have all of the rewriting finished by today, or at least enough that new game entry would be possible. Unfortunately, the work is not yet complete, and worse, preliminary results show that the expected speed gains are not being realized, and that the new database regime appears to actually be slower. I need some more time to investigate to determine whether it is worthwhile to continue to pursue this rewrite, of if it should be scrapped. During this time, the Archive will continue to remain accessible for older games.

tl;dr, today's game will not be in the Archive in a timely manner. Sorry, and please bear with me as I try to get this sorted out.
User avatar
LucarioSnooperVixey
Carrying Letters and Lemons
Posts: 3505
Joined: Sun Jan 15, 2017 8:41 pm
Location: New Jersey

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by LucarioSnooperVixey »

Well, let's just hope there aren't any pre-emptions any time soon.
Douglas Squasoni
Ironhorse
Second Banana
Posts: 2044
Joined: Sat Apr 29, 2017 7:21 pm

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by Ironhorse »

Thanks for the heads up!
User avatar
opusthepenguin
The Best Darn Penguin on the Whole JBoard
Posts: 10319
Joined: Thu Aug 11, 2011 2:33 pm
Location: Shawnee, KS
Contact:

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by opusthepenguin »

Thanks for all the hard work, Robert.
mahatma
Watches Jeopardy! Way Too Much
Posts: 969
Joined: Tue Feb 04, 2014 6:52 pm

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by mahatma »

opusthepenguin wrote: Mon Sep 13, 2021 11:21 am Thanks for all the hard work, Robert.
Ditto. Sounds like a huge task, and I hope you don't have to scrap all that hard work.
User avatar
Robert K S
Jeopardy! Champion
Posts: 5239
Joined: Thu Jun 30, 2011 1:26 pm
Location: Cleveland, Ohio
Contact:

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by Robert K S »

At least I figured out where the time increase was coming from and got that sorted. So all the work is justified. Figuring it out cost me a day, but at least now I'm back on track.
Bamaman
Also Receiving Votes
Posts: 12883
Joined: Sat Jul 02, 2011 1:39 pm

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by Bamaman »

I blame Mike Richards.
User avatar
squarekara
J! Reactionary
Posts: 1547
Joined: Wed Feb 08, 2017 12:49 am
Location: USDA Zone 5

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by squarekara »

Bamaman wrote: Mon Sep 13, 2021 5:07 pm I blame Mike Richards.
Always.
User avatar
CailinGaoilge
Watches Jeopardy! Way Too Much
Posts: 595
Joined: Wed Oct 07, 2015 8:36 pm
Location: Ontario, Canada; formerly resident in UK and Ireland

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by CailinGaoilge »

squarekara wrote: Mon Sep 13, 2021 5:19 pm
Bamaman wrote: Mon Sep 13, 2021 5:07 pm I blame Mike Richards.
Always.
👍👍👍
User avatar
skrambler
Sam Kavanaugh's Mustache
Posts: 41
Joined: Sat Apr 09, 2016 11:42 am
Contact:

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by skrambler »

I'd like to echo the thanks and admiration, Robert. the J-archive was the most valuable resource I had while preparing for my appearances, and continues to be an oft-visited site now that I'm "just" a fan. Cheers to you!
Audacious! Loquacious! Voracious!
User avatar
Robert K S
Jeopardy! Champion
Posts: 5239
Joined: Thu Jun 30, 2011 1:26 pm
Location: Cleveland, Ohio
Contact:

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by Robert K S »

skrambler wrote: Tue Sep 14, 2021 4:36 pm the J-archive was the most valuable resource I had while preparing for my appearances, and continues to be an oft-visited site now that I'm "just" a fan.
Can we add your quote to the list of player testimonials that revolve on the splash screen?
JoshuaSianturi
Contributor
Posts: 25
Joined: Mon Nov 14, 2011 10:52 am

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by JoshuaSianturi »

Until when will the j-archive be fixed?
User avatar
Robert K S
Jeopardy! Champion
Posts: 5239
Joined: Thu Jun 30, 2011 1:26 pm
Location: Cleveland, Ohio
Contact:

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by Robert K S »

You'll probably be able to see new Season 38 games as soon as Monday or sooner. Some aspects of the Archive will take longer to bring back online or to optimize for the enhanced speed. We've made a lot of progress but there is still much to do.

The hindrance to providing a good estimate is you never know how long it will take to overcome the next snag.
User avatar
opusthepenguin
The Best Darn Penguin on the Whole JBoard
Posts: 10319
Joined: Thu Aug 11, 2011 2:33 pm
Location: Shawnee, KS
Contact:

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by opusthepenguin »

Robert K S wrote: Fri Sep 17, 2021 1:06 am The hindrance to providing a good estimate is you never know how long it will take to overcome the next snag.
Can you at least tell us how many more snags there are going to be?
User avatar
Robert K S
Jeopardy! Champion
Posts: 5239
Joined: Thu Jun 30, 2011 1:26 pm
Location: Cleveland, Ohio
Contact:

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by Robert K S »

opusthepenguin wrote: Fri Sep 17, 2021 8:33 am Can you at least tell us how many more snags there are going to be?
The snag rate is very predictable. It's between one and two per day, because they generally take a half-day or day to solve.

Yesterday I had to rebuild the correction suggestions table and that took all afternoon and evening as the MySQL server crunched away.
Bamaman
Also Receiving Votes
Posts: 12883
Joined: Sat Jul 02, 2011 1:39 pm

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by Bamaman »

Will I get a refund on my j-archive subscription due to the delay in getting this week’s games in?
User avatar
Robert K S
Jeopardy! Champion
Posts: 5239
Joined: Thu Jun 30, 2011 1:26 pm
Location: Cleveland, Ohio
Contact:

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by Robert K S »

Bamaman wrote: Fri Sep 17, 2021 10:54 am Will I get a refund on my j-archive subscription due to the delay in getting this week’s games in?
Bad news for you. Our records indicate your dues are not paid up and your membership is not in good standing.

Although maybe that's just because that particular table of the database got wiped.
User avatar
LucarioSnooperVixey
Carrying Letters and Lemons
Posts: 3505
Joined: Sun Jan 15, 2017 8:41 pm
Location: New Jersey

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by LucarioSnooperVixey »

Bamaman wrote: Fri Sep 17, 2021 10:54 am Will I get a refund on my j-archive subscription due to the delay in getting this week’s games in?
Wait. There is J!Archive subscription?
Douglas Squasoni
User avatar
Robert K S
Jeopardy! Champion
Posts: 5239
Joined: Thu Jun 30, 2011 1:26 pm
Location: Cleveland, Ohio
Contact:

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by Robert K S »

LucarioSnooperVixey wrote: Fri Sep 17, 2021 11:42 am Wait. There is J!Archive subscription?
All the perks and benefits you've been missing out on, all this time! Bamaman, tell 'em what they'd have been getting!
User avatar
squarekara
J! Reactionary
Posts: 1547
Joined: Wed Feb 08, 2017 12:49 am
Location: USDA Zone 5

Re: Why new Season 38 games will not appear in the J! Archive for awhile

Post by squarekara »

I got the deluxe subscription package that comes with the Football Phone.
Post Reply