An Interactive Graphical History of Highscoring

[ska]

K, fixed up your score and alphabetized the list of scorers while I was at it.

Great! Thanks. Although it seems you have "Jp27ace.php" by mistake; this also seems to break his graph.

[Hendor]

K, fixed up your score and alphabetized the list of scorers while I was at it.

Great! Thanks. Although it seems you have "Jp27ace.php" by mistake; this also seems to break his graph.

Haha, thanks. Got php on the mind.

I've fixed up the same thing for the Top-20 player selection as well. Added a bunch more players as well.

[ska]

Just out of interest, does anyone know how to do demo analysis of old runs that are no longer on the board. I guess that it just looks it up in real time, since even when I change the default .hs file, it still finds the current one... Is this how it works; is it possible to look at demo data from a bygone era?

[EddyMataGallos]

Just out of interest, does anyone know how to do demo analysis of old runs that are no longer on the board. I guess that it just looks it up in real time, since even when I change the default .hs file, it still finds the current one... Is this how it works; is it possible to look at demo data from a bygone era?

Yeah it just checks the current runs on board. NHigh doesn't download demos, only scores, unfortunately. Well, not unfortunately, files woud be much bigger if they contained the demos too, and it would take much longer. I'm guessing an extra option to include demos would be cool, though.

[zapkt]

Just out of interest, does anyone know how to do demo analysis of old runs that are no longer on the board. I guess that it just looks it up in real time, since even when I change the default .hs file, it still finds the current one... Is this how it works; is it possible to look at demo data from a bygone era?

Yeah it just checks the current runs on board. NHigh doesn't download demos, only scores, unfortunately. Well, not unfortunately, files woud be much bigger if they contained the demos too, and it would take much longer. I'm guessing an extra option to include demos would be cool, though.

I was thinking about keeping *all* demos on my website.
I haven't looked in details at how to download demos yet, I just know that the URL is http://www.harveycartel.org/metanet/n/d ... v_demo.php

[ska]

Right... I figured that there must be a way, because I remember the late spect managed to extract his 11-4 run of the year (see below in userlevels demo format), which had already fallen off the boards by time he posted it; although he probably extracted it while it was still a run highscore, or possibly from his sol file.

$superliminal#Metanet#In-Game#90000000000000000000006000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000340000000000340700000;1111114311111111100000:152111111111152110000000000002500000000600000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000070000000000000;1114311110000000000000:111111111000000000000000002500060000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000080000000000000000000007|5^732,540!0^228,180!0^216,180!0^216,192!0^228,192!0^228,276!0^216,276!0^216,288!0^228,288!0^228,372!0^216,372!0^216,384!0^228,384!0^228,468!0^216,468!0^216,480!0^228,480!0^36,180!0^48,180!0^48,192!0^36,192!0^36,276!0^48,276!0^48,288!0^36,288!0^36,372!0^48,372!0^48,384!0^36,384!0^36,468!0^48,468!0^48,480!0^36,480!0^120,564!0^120,552!0^132,552!0^132,564!0^144,564!0^144,552!0^120,540!0^132,540!0^144,540!11^348,564,528,324!2^660,576,0,-1!2^396,576,0,-1!10^132,480!6^300,372,2,0,0,0!6^492,372,2,0,0,1!6^492,540,2,0,0,2!6^300,540,2,0,0,3#641:17895697|17895697|17895697|17895697|17895697|17895697|17895697|17895697|17895697|17895697|17895697|17895697|35782673|35791394|35791394|89478594|89478485|89478485|89478485|17895697|17895697|219222289|219222293|89478485|89478485|89478485|18175317|89478609|89478485|89478485|89478485|89478485|89478485|17895701|35651857|35791394|35791394|35791394|35791394|35791394|35791394|35791394|35791394|4368|17895680|273|0|35791392|35791394|35791394|17895696|17895697|33554433|35792494|35791394|546|17895696|17895697|17895697|17895697|17895697|17895697|97587473|89510165|89478485|89478485|89478485|18175317|89478493|89478485|89478485|89478485|115474773|107374182|107374182|35791462|35791394|35791394|35791394|35791394|8738|17895696|273|17895424|17895697|1|17895697|17895697|17|273|0|0

[EddyMataGallos]

Right... I figured that there must be a way, because I remember the late spect managed to extract his 11-4 run of the year (see below in userlevels demo format), which had already fallen off the boards by time he posted it; although he probably extracted it while it was still a run, or possibly from his sol file.

Downloading demos based on old NHigh files (your original suggestion) is definitely impossible. What should be possible, on the other hand, is downloading demos that aren't on the boards. All runs from all players are, I suppose (based on the fact that scores are), kept in the database, so being bumped off the boards shouldn't be a problem.

I don't know how to access them though :P The classic HarveyKeitel page only includes scores: http://www.harveycartel.org/metanet/n/d ... layer_name

I was thinking about keeping *all* demos on my website.
I haven't looked in details at how to download demos yet, I just know that the URL is http://www.harveycartel.org/metanet/n/d ... v_demo.php

Oh that's cool :D Its all already implemented in nhighlib. To use it, one just needs to call downloadReplay(episode, level, rank), which returns the tuple (player, score, demo).

It's worth noting that each time you call that, it will download that episode's scores and find the corresponding entry's replay key. So we don't want to do just that, or it would download each episode once per score per level (so 100 times) :P

[Hendor]

Another update worthy of posting here.

http://www.jamesinman.ca/n/

- Added Top-5 and Top-10 scores
- Added a little Total Level/Episode score graph
- Reorganized the lists of players alphabetically and added several people to each list
- Added three presets for Top-5 and Top-10 scores
- So colorful

To Do

- Add a graph to show the selected player's 0th, Top-5, Top-10 and Top-20 on the same graph.
- Individual level graphs (still thinking how to do them)
- Color code the lists of players based on the number of 0ths/Top-5/Top-20 they peaked at (maybe?)

[EddyMataGallos]

Another update worthy of posting here.

http://www.jamesinman.ca/n/

- Added Top-5 scores
- Added a little Total Level/Episode score graph
- Reorganized the lists of players alphabetically and added several people to each list
- Added two presets for Top-5 scores
- So colorful

To Do

- Individual level graphs (still thinking how to do them)
- Color code the lists of players based on the number of 0ths/Top-5/Top-20 they peaked at (maybe?)

Awesome update man! Thanks for this, man the site is looking cleeean. I'm missing some Top10 rankings there, its like the middle step between Top20's and Top5's.

[Hendor]

Awesome update man! Thanks for this, man the site is looking cleeean. I'm missing some Top10 rankings there, its like the middle step between Top20's and Top5's.

Thanks! I'm running the function for that right now, will be up live in a few hours.

I just had a cool idea for an individual player's graph, where it shows their 0ths, Top-5s, Top-10s and Top-20s on one graph. Would be a neat way to visualize someone's distribution of scores over time. I could even make it an area graph, color the space between the lines... I will probably add Top-3 as well, so your's and macro's graph make sense heh.

[xaelar]

Awesome update man! Thanks for this, man the site is looking cleeean. I'm missing some Top10 rankings there, its like the middle step between Top20's and Top5's.

Thanks! I'm running the function for that right now, will be up live in a few hours.

I just had a cool idea for an individual player's graph, where it shows their 0ths, Top-5s, Top-10s and Top-20s on one graph. Would be a neat way to visualize someone's distribution of scores over time. I could even make it an area graph, color the space between the lines... I will probably add Top-3 as well, so your's and macro's graph make sense heh.

Awesome idea! When I looked at your update that was the only thing i missed!

[aids]

Awesome update man! Thanks for this, man the site is looking cleeean. I'm missing some Top10 rankings there, its like the middle step between Top20's and Top5's.

Thanks! I'm running the function for that right now, will be up live in a few hours.

I just had a cool idea for an individual player's graph, where it shows their 0ths, Top-5s, Top-10s and Top-20s on one graph. Would be a neat way to visualize someone's distribution of scores over time. I could even make it an area graph, color the space between the lines... I will probably add Top-3 as well, so your's and macro's graph make sense heh.

How about x-axis 0-19, y-axis 00-0 - 99-9, and you can see a player's position on all the top-20s at once?

[EddyMataGallos]

I just had a cool idea for an individual player's graph, where it shows their 0ths, Top-5s, Top-10s and Top-20s on one graph. Would be a neat way to visualize someone's distribution of scores over time. I could even make it an area graph, color the space between the lines... I will probably add Top-3 as well, so your's and macro's graph make sense heh.

Sounds great :D

Also, +1 for Aids suggestion, although I'd put the ranks in the y-axis and levels in the x-axis.

[ska]

Awesome update man! Thanks for this, man the site is looking cleeean. I'm missing some Top10 rankings there, its like the middle step between Top20's and Top5's.

Thanks! I'm running the function for that right now, will be up live in a few hours.

I just had a cool idea for an individual player's graph, where it shows their 0ths, Top-5s, Top-10s and Top-20s on one graph. Would be a neat way to visualize someone's distribution of scores over time. I could even make it an area graph, color the space between the lines... I will probably add Top-3 as well, so your's and macro's graph make sense heh.

How about x-axis 0-19, y-axis 00-0 - 99-9, and you can see a player's position on all the top-20s at once?

I've thought about this idea, too. I would use a column graph, myself.

[zapkt]

Some updates from me:
- found a way to hugely speed up some queries, it helps a lot
- automat(iz)ed download, now the graphs are always up to date! There is one update per day.
- Added a Player page, displaying some stats on a player (first top 20, first 0th, time difference between those two things)
- Added some stats on the Level page (number of players who ever got a top 20 score and a 0th)
- Added a Stats page (for the moment, only displaying the number of different 0th on each level)

Also, yeah, I know, it's deeply ugly. Feel free to send me a cool CSS file if you have the soul of an artist.

If you have ideas of cool stats I could add (mainly things that are not easy to calculate with NHigh as it does not know the whole highscore history), please tell them. I will see if they can be done.

Futur work: a "News" page displaying new scores in quasi-realtime (within a one-hour window)

[EddyMataGallos]

Some updates from me:
- found a way to hugely speed up some queries, it helps a lot
- automat(iz)ed download, now the graphs are always up to date! There is one update per day.
- Added a Player page, displaying some stats on a player (first top 20, first 0th, time difference between those two things)
- Added some stats on the Level page (number of players who ever got a top 20 score and a 0th)
- Added a Stats page (for the moment, only displaying the number of different 0th on each level)

Also, yeah, I know, it's deeply ugly. Feel free to send me a cool CSS file if you have the soul of an artist.

If you have ideas of cool stats I could add (mainly things that are not easy to calculate with NHigh as it does not know the whole highscore history), please tell them. I will see if they can be done.

Futur work: a "News" page displaying new scores in quasi-realtime (within a one-hour window)

Thanks for the update man, I like the player's and general stats. Looking forward to seeing more :D

There's a problem with automating download though, you aren't cleaning the new .hs files from hackers, so new files are polluted. I'm not sure if its using an ignore list at all, but if it is, I can give you mine. It contains all present hackers/cheaters, and the vast majority (if not all) hackers from the past, at least the ones after the 2006 cleansin.

Its not completely clean though, I just saw an old 2006 hacker in 5-2 I didn't have in my list (it was cleaned by M&R long ago). And since the score is not ridiculous, NHigh didn't automatically ignore it. I'll try to check all files with some kind of function that compares the average score to the 0th score, if the deviation is huge, it might be a hacked score, even if the score is "normal" as in 5-2

[zapkt]

There's a problem with automating download though, you aren't cleaning the new .hs files from hackers, so new files are polluted. I'm not sure if its using an ignore list at all, but if it is, I can give you mine. It contains all present hackers/cheaters, and the vast majority (if not all) hackers from the past, at least the ones after the 2006 cleansin.

Hmm yeah, I know, and removing already uploaded hacked scores will be tricky as I have to change the position of all scores in the level :( I have to automate this…

Its not completely clean though, I just saw an old 2006 hacker in 5-2 I didn't have in my list (it was cleaned by M&R long ago). And since the score is not ridiculous, NHigh didn't automatically ignore it. I'll try to check all files with some kind of function that compares the average score to the 0th score, if the deviation is huge, it might be a hacked score, even if the score is "normal" as in 5-2

Hmm yea, I could probably calculate which scores have been deleted to detect such bad scores.

[EddyMataGallos]

There's a problem with automating download though, you aren't cleaning the new .hs files from hackers, so new files are polluted. I'm not sure if its using an ignore list at all, but if it is, I can give you mine. It contains all present hackers/cheaters, and the vast majority (if not all) hackers from the past, at least the ones after the 2006 cleansin.

Hmm yeah, I know, and removing already uploaded hacked scores will be tricky as I have to change the position of all scores in the level :( I have to automate this…

Its not completely clean though, I just saw an old 2006 hacker in 5-2 I didn't have in my list (it was cleaned by M&R long ago). And since the score is not ridiculous, NHigh didn't automatically ignore it. I'll try to check all files with some kind of function that compares the average score to the 0th score, if the deviation is huge, it might be a hacked score, even if the score is "normal" as in 5-2

Hmm yea, I could probably calculate which scores have been deleted to detect such bad scores.

Yeah that's all true, although I'm guessing that doing those things on the fly would be very time-consuming. On the first regard, I don't think removing already uploaded hacked scores is the best idea, since its much easier to clean the NHigh files first, and then reupload all files at once. Unless that would cause more trouble (i.e. you've already preset some things), I don't know.

On the second regard, since those deleted scores are, well, not here anymore, it would be inefficient to check for them always. Its better to program and run that function only once, find which scores have been deleted, and clean them from the .hs files so that they don't hinder anymore and don't slow down processing time.

I think cleaning the files is the best idea, but that's just my opinion. I can do this and clean any deleted score from the NHigh files, then if you/Hendor find if more comfortable to just reupload the old files, you can use that.

[Izzy]

Really cool stuff, guys. Y'all's crazy for this.

[ska]

Request: Episode 0th rankings over time. Eddy currently has 77; how close have people come to this number? Does anyone think Eddy could take all 100? Discuss.

[TheRealOne]

Request: Episode 0th rankings over time. Eddy currently has 77; how close have people come to this number? Does anyone think Eddy could take all 100? Discuss.

Of course he can take all 100. He even said so him self in a round-about kind of way. None are marked as "impossible." =P

[zapkt]

Some quick update from me: I modified the way database connections are handled, and hopefully my web app won't be down all the time anymore \o/ (Still here)

I hope I will have more time to work on it (I saw some requests in different threads) next week.

[ska]

Request: Episode 0th rankings over time. Eddy currently has 77; how close have people come to this number? Does anyone think Eddy could take all 100? Discuss.

Of course he can take all 100. He even said so him self in a round-about kind of way. None are marked as "impossible." =P

I was aware of that table, of course; however, I'm not sure why, but I feel he might have some fierce competition when he gets into the high-nineties...

[aids]

Is there a graph where you enter in name and you can see the number of 0ths, 1sts, 2nds, they have? That would be pretty.

[EddyMataGallos]

Ah yeah that'd be awesome. It's already been suggested a couple times, so its probably in the to-do list.