An Interactive Graphical History of Highscoring

Are you a rad N player or want to put some rad N players to the test? Talk about your skills and challenge each other at N in this forum.

Moderators: EddyMataGallos, TheRealOne

User avatar
If you ain't first, you're last!
Posts: 2297
Joined: 2009.02.07 (16:07)
NUMA Profile: http://nmaps.net/user/EddyMataGallos
Location: Spain

Postby EddyMataGallos » 2014.11.14 (15:28)

Hendor wrote:EDIT - I figured out some of them. I think. No. No I didn't. Wait, yes I did. They're your files Eddy. Check out the ones in your folder named "10-05-31" through "10-06-20". There are several others at later dates as well. They've got all the cheaters still in them. I'm gonna try and exterminate the bad files.
Oh, damn you are right, but that's not my fault, the cheaters don't appear in NHigh since they are in the ignore list. For some reason, there are some files that were saved badly, and even though cheaters were ignored, they were still exported to the .hs file when I saved them. Take the penultimate file of my collection, named "14-09-08.hs". That was really recent, I know I made no difference when saving it. Yet, you can clearly see by its file size that it does include the cheaters, and it differs greatly from the typical 279KB file size that recent files have. I have no clue why this happens xD

However I found fixing them is quite easy, all you need to do is opening and resaving them. Now the file size is reduced to 279KB (in this case), and players from the ignore list aren't exported this time. So exterminating them is not necessary (and we lose information). Could you provide me the list of files that you had to exterminate, so I can fix them? If you don't happen to keep it, which I suppose (:P), I can just code a function in NHigh to open and resave all files, hopefully fixing everything.

I've opened some other files at random (from zapkt too) and they do include hackers/cheaters too, which I imagine weren't visible in NHigh either when he saved them. Not sure what causes this inconsistent NHigh saving, but I'll try to resave them all now and see if it gets fixed.
Hendor wrote:One more issue is that some of the NHigh saves are messed up and I can't figure out why or which they are. They are all named differently, and many of the file names don't agree with the Date File Modified. I think the bad files must all come from the same person/source as they are often kinda clumped up. See this screenshot
Be careful here, because filenames have at least 3 different date formats, so that's why it might seem as though they don't correspond to their date. The real date, always, is the one that NHigh shows, (the one my functions output, too), since that is taken from the timestamp that was saved when the file was created, and they're all in the same format.
Hendor wrote:One thing to change though is that Javascript uses 0 for January and 1 for February, and etc, which means that all dates are off by exactly one month (which made troubleshooting the below problem confusing). I looked into the Python file and found the relevant if(graph) and datetime bits, but don't know enough (any) Python to change it. Could you please just add a -1 in there at some point for the Graph Lists? Thanks!
Sure man, I'll do a quick modification with this, and the previous issues, and I'll post it.
ImageImage
Impressive flag by ska -|- N2High - My software for N2.0 -|- Awesome sig by Hendor
About me & Stats (Spoiler)

Hi, im Eddy, a Spanish highscorer and current Grandmaster of N. I've been playing N since 2006, I beat it on the 8th September 2008, and NReality later too. Started intermittently highscoring Metanet in 2010, although serious highscoring started in late 2011.

Current Stats
• Completed N on 8th Sept. 2008
• Completed NReality on 24th Dec. 2010
0th Place on Metanet 0th Rankings with 443 0ths.
0th Place on Metanet Top20 Rankings with 599 Scores.
0th Place on Metanet Top10 Rankings with 599 Scores.
1st Place on Metanet Top5 Rankings with 595 Scores.
0th Place on Metanet Level 0th Rankings with 361 0ths.
0th Place on Metanet Episode 0th Rankings with 82 0ths.
0th Place on Metanet Total Level Score: 72142.900 (20:02:22.900)
0th Place on Metanet Total Episode Score: 35669.900 (09:54:29.900)
0th Place on Metanet Total Point Rankings with 11669 Points.
0th Place in NReality 0th Rankings with 235 0ths.
0th Place for a grand total of 676 Total 0ths.
• Winner of some contests (BUST, 100, 9000, Bounty Hunters, SOAST) and of some rounds of some contests (ROPP, NErratic, Red Ball, NReality Team Arena)

{Info as of 01/Feb/2015} The info may be outdated.

Achievements
• 6th highscorer to reach 100 Metanet 0ths
• 4th highscorer to reach 200 Metanet 0ths
• 1st and only highscorer to reach 300 Metanet 0ths
• 1st and only highscorer to reach 400 Metanet 0ths
• 8th ever Grandmaster
• 2nd* highscorer to reach 599 top-20 Scores
• 1st highscorer to reach 599 top-10 Scores
• 10th highscorer to reach 70k Level Score
• 5th highscorer to reach 71k Level Score
• 2nd highscorer to reach 71.5k Level Score
• 1st highscorer to reach 72k Level Score

Relevant Dates
• First 0th: 31-3 on 04/Oct/10
• Reached 100 Metanet 0ths on 25/Feb/12
• Reached 200 Metanet 0ths on 30/Sep/12
• Reached 300 Metanet 0ths on 16/Mar/13
• Reached 400 Metanet 0ths on 04/Sept/14
• Reached highest amount of 0ths on Jan/2013
• Became the Grandmaster on 12/Apr/2012
• Reached 70k Level Score on 25/Dec/11
• Reached 71k Level Score on 13/Jan/11
• Reached 71.5k Level Score on 01/Aug/12
• Reached 72k Level Score on 04/Jul/14
• Completed N 1.4 on 08/Sept/08
• Completed NReality on 24/Dec/10
• Reached 100 NReality 0ths on Oct/2011
• Reached 200 NReality 0ths on Nov/2011
• Reached 100 Top-20 Scores on Aug/10
• Reached 200 Top-20 Scores on Nov/11
• Reached 300 Top-20 Scores on Nov/11
• Reached 400 Top-20 Scores on Dec/11
• Reached 500 Top-20 Scores on Jan/12
• Reached 599 Top-20 Scores on 04/Apr/12
• Reached 599 Top-10 Scores on 18/Nov/12

Deds & Images (Spoiler)

Thanks to ska for dedicating this map to me
Thanks to BluePretzel for dedicating this map to me
Thanks to da_guru for dedicating this map to me
Thanks to zoasBE for dedicating this full episode to me!: 00-0 00-100-2 00-3 00-4
Thanks to zoasBE for dedicating this mappack to me
Thanks to zoasBE for partially dedicating this map to me
Thanks to VODKALOVER for dedicating this map to me
Thanks to runningninja for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to zoasBE for partially dedicating this map to me
Thanks to trance for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to llabesab for dedicating this map to me
Thanks to the23 for dedicating this map to me
Thanks to Traveleravi for dedicating this map to me
Thanks to 123leonidas321 for dedicating this map to me
Thanks to the23 for dedicating this map to me
Thanks to Uniden for dedicating this map to me
Thanks to Uniden for dedicating this map to me
Thanks to Ors_II for dedicating this map to me
Thanks to Sunset for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Leonhard for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Daggafork for dedicating this map to me
Thanks to VODKALOVER for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to RandomDigits/SpartaX18 for dedicating this map to me
Sorry if Im missing any ded.

Image
ImageThanks to leo.
Image


User avatar
If you ain't first, you're last!
Posts: 2297
Joined: 2009.02.07 (16:07)
NUMA Profile: http://nmaps.net/user/EddyMataGallos
Location: Spain

Postby EddyMataGallos » 2014.11.14 (16:29)

Alright, fixed the issues (I think):

* Regarding corrupt highscore files, I just did a quick NHigh function to resave all files from "scores" into a new folder. I did it with all 807 files and I believe everything has been fixed now. The biggest filesize has gone from 310KB to 283KB, only 4KB more than the current, clean files. So based on that I'd say everything is perfect now. The overall size has been reducen 12MB, 12MB worth of hacked scores!

Here you have the updated folder: https://mega.co.nz/#!dJZAUJ4Y!rbJEksX1V ... a-UtB90X5s
Remember to rename it first. Backup your old folder if you made modifications, just in case.
Updated: Read below

I've also added this function to the menu, just in case you want to use it in the future (you'd need a perfect ignore list, though). It will create a new "newscores" folder and put all resaved files there.

* Fixed the date issue.

I'll do quick check inside zapkt files, since they are very old and might include hackers that I never added to my ignore list (and hence they wouldn't have been deleted in this process).

EDIT: I've found some other old hackers in zapkt files already, so you might want to wait a bit meanwhile I go through his files and add all those hackers to the list. There shouldn't be many. Also, I've found that several hackers can't be added to the ignore list because of their nickname, so I'll try to make NHigh to ignore all players with scores superior to a certain limit to fix that.

EDIT2: Fixed that once again. Went through some files updating my ignore list, but just in case I missed any, I added a little thing to the postProcess of the scores when you download/load the scores. Basically not only will it disregard entries that are in the ignore list, but also any entry over the score of 650 seconds, which is clearly impossible to reach in any level/episode. I was going to choose 600 as the max score originally, but some eps get too close to that (like Ep12, which is almost at 586) so I don't want to risk fucking it up in the future xD You can change this, its a constant defined at the top of the library.

Download the new version here:
NHighUpdt.rar
(28.29 KiB) Downloaded 228 times
Again, you have to update the same 2 files.
And this is the proper NHigh file collection, after applying the cleansing and resaving process:
https://mega.co.nz/#!gQYVEa7A!foSzlkD1W ... WvjwE3Zl_8
Remember to rename the folder. It should work properly now.

Try it out and tell me how it works ;)
ImageImage
Impressive flag by ska -|- N2High - My software for N2.0 -|- Awesome sig by Hendor
About me & Stats (Spoiler)

Hi, im Eddy, a Spanish highscorer and current Grandmaster of N. I've been playing N since 2006, I beat it on the 8th September 2008, and NReality later too. Started intermittently highscoring Metanet in 2010, although serious highscoring started in late 2011.

Current Stats
• Completed N on 8th Sept. 2008
• Completed NReality on 24th Dec. 2010
0th Place on Metanet 0th Rankings with 443 0ths.
0th Place on Metanet Top20 Rankings with 599 Scores.
0th Place on Metanet Top10 Rankings with 599 Scores.
1st Place on Metanet Top5 Rankings with 595 Scores.
0th Place on Metanet Level 0th Rankings with 361 0ths.
0th Place on Metanet Episode 0th Rankings with 82 0ths.
0th Place on Metanet Total Level Score: 72142.900 (20:02:22.900)
0th Place on Metanet Total Episode Score: 35669.900 (09:54:29.900)
0th Place on Metanet Total Point Rankings with 11669 Points.
0th Place in NReality 0th Rankings with 235 0ths.
0th Place for a grand total of 676 Total 0ths.
• Winner of some contests (BUST, 100, 9000, Bounty Hunters, SOAST) and of some rounds of some contests (ROPP, NErratic, Red Ball, NReality Team Arena)

{Info as of 01/Feb/2015} The info may be outdated.

Achievements
• 6th highscorer to reach 100 Metanet 0ths
• 4th highscorer to reach 200 Metanet 0ths
• 1st and only highscorer to reach 300 Metanet 0ths
• 1st and only highscorer to reach 400 Metanet 0ths
• 8th ever Grandmaster
• 2nd* highscorer to reach 599 top-20 Scores
• 1st highscorer to reach 599 top-10 Scores
• 10th highscorer to reach 70k Level Score
• 5th highscorer to reach 71k Level Score
• 2nd highscorer to reach 71.5k Level Score
• 1st highscorer to reach 72k Level Score

Relevant Dates
• First 0th: 31-3 on 04/Oct/10
• Reached 100 Metanet 0ths on 25/Feb/12
• Reached 200 Metanet 0ths on 30/Sep/12
• Reached 300 Metanet 0ths on 16/Mar/13
• Reached 400 Metanet 0ths on 04/Sept/14
• Reached highest amount of 0ths on Jan/2013
• Became the Grandmaster on 12/Apr/2012
• Reached 70k Level Score on 25/Dec/11
• Reached 71k Level Score on 13/Jan/11
• Reached 71.5k Level Score on 01/Aug/12
• Reached 72k Level Score on 04/Jul/14
• Completed N 1.4 on 08/Sept/08
• Completed NReality on 24/Dec/10
• Reached 100 NReality 0ths on Oct/2011
• Reached 200 NReality 0ths on Nov/2011
• Reached 100 Top-20 Scores on Aug/10
• Reached 200 Top-20 Scores on Nov/11
• Reached 300 Top-20 Scores on Nov/11
• Reached 400 Top-20 Scores on Dec/11
• Reached 500 Top-20 Scores on Jan/12
• Reached 599 Top-20 Scores on 04/Apr/12
• Reached 599 Top-10 Scores on 18/Nov/12

Deds & Images (Spoiler)

Thanks to ska for dedicating this map to me
Thanks to BluePretzel for dedicating this map to me
Thanks to da_guru for dedicating this map to me
Thanks to zoasBE for dedicating this full episode to me!: 00-0 00-100-2 00-3 00-4
Thanks to zoasBE for dedicating this mappack to me
Thanks to zoasBE for partially dedicating this map to me
Thanks to VODKALOVER for dedicating this map to me
Thanks to runningninja for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to zoasBE for partially dedicating this map to me
Thanks to trance for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to llabesab for dedicating this map to me
Thanks to the23 for dedicating this map to me
Thanks to Traveleravi for dedicating this map to me
Thanks to 123leonidas321 for dedicating this map to me
Thanks to the23 for dedicating this map to me
Thanks to Uniden for dedicating this map to me
Thanks to Uniden for dedicating this map to me
Thanks to Ors_II for dedicating this map to me
Thanks to Sunset for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Leonhard for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Daggafork for dedicating this map to me
Thanks to VODKALOVER for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to RandomDigits/SpartaX18 for dedicating this map to me
Sorry if Im missing any ded.

Image
ImageThanks to leo.
Image


Legacy Elite
Legacy Elite
Posts: 132
Joined: 2008.09.26 (19:23)
NUMA Profile: http://nmaps.net/Hendor
MBTI Type: INTJ
Location: Canada

Postby Hendor » 2014.11.14 (20:38)

Hey Eddy, thanks again! Am testing everything right now. EDIT - Lines look much smoother, think you got all the bad files.

I have ~20 files from this September to the present. I'm pretty confident that they are all clean so I've added them to my scores folder. You can check them first if you want before adding them to yours. Grab them here. Pretty cool how 20 files are compressed to less than the size of one of the files. I guess the files are pretty much identical, but still... cool :D

You can check out what I'm working on here: http://www.jamesinman.ca/n/

Styling is minimal at the time I'm posting this, but I'll be adding more people and more styling throughout the day.
Highscorer prone to fleeting comebacks
598 Metanet top-20s in September 2007 (ranked 0th)

Legacy Elite
Legacy Elite
Posts: 132
Joined: 2008.09.26 (19:23)
NUMA Profile: http://nmaps.net/Hendor
MBTI Type: INTJ
Location: Canada

Postby Hendor » 2014.11.15 (04:26)

Okay, a pretty big update I guess:

http://www.jamesinman.ca/n/

Changes
- Added web interface for selecting the player(s) you want on the graph.
- Using Eddy's awesome NHigh functions, I added 0th and Top-20 histories for everyone that I could think of. Please suggest people I missed.
- Using Seifer's collection of Highscore Ranking pre-2006, I manually extended the NHigh histories back to September 2004 for about 20 players.

To Do (soon)
- Add Top-20 rankings, which should go quicker I hope, as I will not do them pre-2006
- Add a couple ways to sort the lists of players on the selection page (max number of 0ths/Top-20s, alphabetically, date active, etc)
- Add some "preset" graphs, I'm thinking a Grandmaster graph, 50+ 0th club, 590/500+ Top-20 Club, Early Days, Modern Masters, etc. Feel free to suggest some.

To Do (soon-ish)
-Add graphs for Total Level Score, Top-10, Top-5, etc.
-Individual Level Graphs.
Highscorer prone to fleeting comebacks
598 Metanet top-20s in September 2007 (ranked 0th)

User avatar
If you ain't first, you're last!
Posts: 2297
Joined: 2009.02.07 (16:07)
NUMA Profile: http://nmaps.net/user/EddyMataGallos
Location: Spain

Postby EddyMataGallos » 2014.11.15 (16:39)

That is really impressive! Awesome work Hendor, the result is so neat.

I downloaded your files, they couldn't have come in a better moment, I hadn't downloaded a single file in the past 2 months :D I noticed the first 4 ones do include some hackers though (you can see it by the file size difference too, 2 284KB files and 2 280KB ones, the rest are clean 279KB files). I just cleaned them, here:

https://mega.co.nz/#!MEpAiRiT!xXq-v4dUk ... oEDPvYJUqI

Its interesting how, even though they only lost 10KB in total, the resulting compression is now double! Half of the previous filesize. Probably because deleting the hackers in those individual files has notably increased the resemblance among all files.

I'm really liking those preset graphs and interface ideas too. Regarding the new functions, yesterday I developed a Community Total Level/Ep Score evolution, however, I didn't post it since the absence of any legit score in several levels in a bunch of files (caused by leaderboards full of hackers) lead to anomalies (like TLS getting as low as 71k by late 2011). I'll make NHigh do a manual correction to those files (adding the 0th scores manually, if they are missing). Also, a graph display the evolution of the difference between both would rock too, to see how episodes got cleaner. For this, I've thought on a separate graph where we add 36000 seconds to the TES, and then plot both at the same time, so we can actually see how the TES approaches the TLS. I'll work on the biggest 0th-1st/19th differences and cleanest episodes too, during my study breaks.

Fortunately, these Community reports are much less laborious for you to add, since its a single graph per report, not one per player! :P

Individual level graphs rock, I'll work on that. We want NHigh to return all 600 lists at the same time of course. For this, which output do you want? I've thought on 2 ways of doing these graphs, one plotting a single line (representing the 0th evolution) for each level graph, and another one showing all scores on board for each level graph, which kinda shows how they've been getting all closer and more refined with time. They should require the same time to both code and add them, except gathering the info would take longer in the second case, of course.
ImageImage
Impressive flag by ska -|- N2High - My software for N2.0 -|- Awesome sig by Hendor
About me & Stats (Spoiler)

Hi, im Eddy, a Spanish highscorer and current Grandmaster of N. I've been playing N since 2006, I beat it on the 8th September 2008, and NReality later too. Started intermittently highscoring Metanet in 2010, although serious highscoring started in late 2011.

Current Stats
• Completed N on 8th Sept. 2008
• Completed NReality on 24th Dec. 2010
0th Place on Metanet 0th Rankings with 443 0ths.
0th Place on Metanet Top20 Rankings with 599 Scores.
0th Place on Metanet Top10 Rankings with 599 Scores.
1st Place on Metanet Top5 Rankings with 595 Scores.
0th Place on Metanet Level 0th Rankings with 361 0ths.
0th Place on Metanet Episode 0th Rankings with 82 0ths.
0th Place on Metanet Total Level Score: 72142.900 (20:02:22.900)
0th Place on Metanet Total Episode Score: 35669.900 (09:54:29.900)
0th Place on Metanet Total Point Rankings with 11669 Points.
0th Place in NReality 0th Rankings with 235 0ths.
0th Place for a grand total of 676 Total 0ths.
• Winner of some contests (BUST, 100, 9000, Bounty Hunters, SOAST) and of some rounds of some contests (ROPP, NErratic, Red Ball, NReality Team Arena)

{Info as of 01/Feb/2015} The info may be outdated.

Achievements
• 6th highscorer to reach 100 Metanet 0ths
• 4th highscorer to reach 200 Metanet 0ths
• 1st and only highscorer to reach 300 Metanet 0ths
• 1st and only highscorer to reach 400 Metanet 0ths
• 8th ever Grandmaster
• 2nd* highscorer to reach 599 top-20 Scores
• 1st highscorer to reach 599 top-10 Scores
• 10th highscorer to reach 70k Level Score
• 5th highscorer to reach 71k Level Score
• 2nd highscorer to reach 71.5k Level Score
• 1st highscorer to reach 72k Level Score

Relevant Dates
• First 0th: 31-3 on 04/Oct/10
• Reached 100 Metanet 0ths on 25/Feb/12
• Reached 200 Metanet 0ths on 30/Sep/12
• Reached 300 Metanet 0ths on 16/Mar/13
• Reached 400 Metanet 0ths on 04/Sept/14
• Reached highest amount of 0ths on Jan/2013
• Became the Grandmaster on 12/Apr/2012
• Reached 70k Level Score on 25/Dec/11
• Reached 71k Level Score on 13/Jan/11
• Reached 71.5k Level Score on 01/Aug/12
• Reached 72k Level Score on 04/Jul/14
• Completed N 1.4 on 08/Sept/08
• Completed NReality on 24/Dec/10
• Reached 100 NReality 0ths on Oct/2011
• Reached 200 NReality 0ths on Nov/2011
• Reached 100 Top-20 Scores on Aug/10
• Reached 200 Top-20 Scores on Nov/11
• Reached 300 Top-20 Scores on Nov/11
• Reached 400 Top-20 Scores on Dec/11
• Reached 500 Top-20 Scores on Jan/12
• Reached 599 Top-20 Scores on 04/Apr/12
• Reached 599 Top-10 Scores on 18/Nov/12

Deds & Images (Spoiler)

Thanks to ska for dedicating this map to me
Thanks to BluePretzel for dedicating this map to me
Thanks to da_guru for dedicating this map to me
Thanks to zoasBE for dedicating this full episode to me!: 00-0 00-100-2 00-3 00-4
Thanks to zoasBE for dedicating this mappack to me
Thanks to zoasBE for partially dedicating this map to me
Thanks to VODKALOVER for dedicating this map to me
Thanks to runningninja for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to zoasBE for partially dedicating this map to me
Thanks to trance for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to llabesab for dedicating this map to me
Thanks to the23 for dedicating this map to me
Thanks to Traveleravi for dedicating this map to me
Thanks to 123leonidas321 for dedicating this map to me
Thanks to the23 for dedicating this map to me
Thanks to Uniden for dedicating this map to me
Thanks to Uniden for dedicating this map to me
Thanks to Ors_II for dedicating this map to me
Thanks to Sunset for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Leonhard for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Daggafork for dedicating this map to me
Thanks to VODKALOVER for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to RandomDigits/SpartaX18 for dedicating this map to me
Sorry if Im missing any ded.

Image
ImageThanks to leo.
Image


Semimember
Posts: 18
Joined: 2010.05.10 (16:15)

Postby Wolfos » 2014.11.15 (17:33)

Hendor wrote:Okay, a pretty big update I guess
Stellar work! Couldn't remember my peak tally exactly - seems it was 49, which is slightly annoying.

User avatar
Lifer
Posts: 1071
Joined: 2008.09.27 (02:08)
NUMA Profile: http://nmaps.net/user/golfkid
Location: the 19th hole

Postby golf » 2014.11.15 (17:59)

Eddy wrote:I'm really liking those preset graphs and interface ideas too. Regarding the new functions, yesterday I developed a Community Total Level/Ep Score evolution ... Also, a graph display the evolution of the difference between both would rock too, to see how episodes got cleaner. For this, I've thought on a separate graph where we add 36000 seconds to the TES, and then plot both at the same time, so we can actually see how the TES approaches the TLS. I'll work on the biggest 0th-1st/19th differences and cleanest episodes too
I'm really excited about these features xD I think that would be really cool to see how those types of things have changed over time, especially at how the gap between 0th and 19th has changed over time for levels. I know looking at the Wayback Machine, back to when it was still 1.3, some of the spreads on levels were pretty crazy.
[16:24] <@golfkid> I'm pretty sure I will literally scream if I die on the last column of 78-4 at this point
[16:25] <trance> Oh, yeah. That level.
[16:29] <@golfkid> lol
[16:30] <@golfkid> It looks so simple
[16:30] <@golfkid> But it says "NO! I will rape your sanity!"
spoiler

Image
My Accomplishments:
Completed N; Completed Nreality on 4/11/08
598 top 20 scores in N 1.4 as of 6/28/14 (498 level scores, 100 episode scores, 2nd position in top 20 rankings); reached 100 on 12/14/2008; 300 (half of all possible :D) on 11/9/2009; 400 on 12/2/2011; max of 598 on 2/3/2013; tied for 0th in top 20 rankings on 2/26-27/13

4 current v1.4 0ths (9th position in 0th rankings); First v1.4 0th: 63-3 at 1:20 pm, 3/24/2008

current level score: 71079.200 (6th position all time); 60k seconds on v1.4 6/17/08; 12th to 70k at 11:30pm EST, 12/24/2011; 6th to 71k at 5:50 pm EST, 9/29/2012

current episode score: 34276.650 (4th position all time); 100k seconds total level score (Metanet and NReality) on 2/4/08

participation and contest winner images

Image
Image
Image
Image
Image

[quote="ska on my 129-1 innovation"]I thought about that but couldn't chimeny fast enough when trying. Congrats[/quote]

User avatar
Moderator
Moderator
Posts: 1402
Joined: 2008.10.01 (01:36)
NUMA Profile: http://nmaps.net/user/therealone

Postby TheRealOne » 2014.11.15 (18:42)

Wolfos wrote:
Hendor wrote:Okay, a pretty big update I guess
Stellar work! Couldn't remember my peak tally exactly - seems it was 49, which is slightly annoying.
Hear hear! This is so much fun to play around with. It is also quire well programmed for everything to ease of use to style so something that was only conceived like a week ago. Thank you so much Hendor.
<@Izzy> Holy balls, sweet run.
<@gloomp> Holy sweet, balls run.
<@Izzy> Sweet, balls run holy.
<@gloomp> Run sweet, balls holy.
<@Izzy> Sweet run, ballsy hole.
<@gloomp> All's sweet, holeb run.
<@Izzy> Ballsy nun, sweet mole.
Image

<@Kool> bro no joke, I saw the sexiest swedish chick giving herself anal on one of those pop-up alarm-clocks at my uncle's house

User avatar
If you ain't first, you're last!
Posts: 2297
Joined: 2009.02.07 (16:07)
NUMA Profile: http://nmaps.net/user/EddyMataGallos
Location: Spain

Postby EddyMataGallos » 2014.11.15 (21:28)

golf wrote:
Eddy wrote:I'm really liking those preset graphs and interface ideas too. Regarding the new functions, yesterday I developed a Community Total Level/Ep Score evolution ... Also, a graph display the evolution of the difference between both would rock too, to see how episodes got cleaner. For this, I've thought on a separate graph where we add 36000 seconds to the TES, and then plot both at the same time, so we can actually see how the TES approaches the TLS. I'll work on the biggest 0th-1st/19th differences and cleanest episodes too
I'm really excited about these features xD I think that would be really cool to see how those types of things have changed over time, especially at how the gap between 0th and 19th has changed over time for levels. I know looking at the Wayback Machine, back to when it was still 1.3, some of the spreads on levels were pretty crazy.
Yeah, me too! I love stats xD I won't be able to work on that until Monday, I have some studying to do.

Hendor, golfkid has recently shared his NHigh file collection with me. It includes a lot of files from the weakest years, 2008 and 2009! Man, I'm super glad about this. I can't believe that 5 days ago, we barely had any file from 06 to 09 (21 in total), there were some really big gaps in there; and now we have a consistent source of information, almost no gaps, after zapkt filled 2006 and 2007, and golf filled 2008 and 2009.

I've cleaned, arranged and classified all files into a master collection. Check it out here, it will be perfect for the graphs. Specially now that it has the 2008/2009 addition. Man, everything is getting very complete. Make to sure pick the secondary download, since your version of NHigh still doesn't support the scan of subfolders when searching for NHigh files. I've already added it for the next time I update NHigh, probably tomorrow or on Monday.

By the way, I'm not sure if you did each player individually, but you don't have to, just tell me how does the code for several players at the same time has to look like, and I'll make NHigh output that. I think the current "global evolution" functions are outputting correctly though, aren't they? If you want, I can also make it scan a text file with player names, and make the output for those particular players, so you can update your graphs in one go once you have the player list ;)
ImageImage
Impressive flag by ska -|- N2High - My software for N2.0 -|- Awesome sig by Hendor
About me & Stats (Spoiler)

Hi, im Eddy, a Spanish highscorer and current Grandmaster of N. I've been playing N since 2006, I beat it on the 8th September 2008, and NReality later too. Started intermittently highscoring Metanet in 2010, although serious highscoring started in late 2011.

Current Stats
• Completed N on 8th Sept. 2008
• Completed NReality on 24th Dec. 2010
0th Place on Metanet 0th Rankings with 443 0ths.
0th Place on Metanet Top20 Rankings with 599 Scores.
0th Place on Metanet Top10 Rankings with 599 Scores.
1st Place on Metanet Top5 Rankings with 595 Scores.
0th Place on Metanet Level 0th Rankings with 361 0ths.
0th Place on Metanet Episode 0th Rankings with 82 0ths.
0th Place on Metanet Total Level Score: 72142.900 (20:02:22.900)
0th Place on Metanet Total Episode Score: 35669.900 (09:54:29.900)
0th Place on Metanet Total Point Rankings with 11669 Points.
0th Place in NReality 0th Rankings with 235 0ths.
0th Place for a grand total of 676 Total 0ths.
• Winner of some contests (BUST, 100, 9000, Bounty Hunters, SOAST) and of some rounds of some contests (ROPP, NErratic, Red Ball, NReality Team Arena)

{Info as of 01/Feb/2015} The info may be outdated.

Achievements
• 6th highscorer to reach 100 Metanet 0ths
• 4th highscorer to reach 200 Metanet 0ths
• 1st and only highscorer to reach 300 Metanet 0ths
• 1st and only highscorer to reach 400 Metanet 0ths
• 8th ever Grandmaster
• 2nd* highscorer to reach 599 top-20 Scores
• 1st highscorer to reach 599 top-10 Scores
• 10th highscorer to reach 70k Level Score
• 5th highscorer to reach 71k Level Score
• 2nd highscorer to reach 71.5k Level Score
• 1st highscorer to reach 72k Level Score

Relevant Dates
• First 0th: 31-3 on 04/Oct/10
• Reached 100 Metanet 0ths on 25/Feb/12
• Reached 200 Metanet 0ths on 30/Sep/12
• Reached 300 Metanet 0ths on 16/Mar/13
• Reached 400 Metanet 0ths on 04/Sept/14
• Reached highest amount of 0ths on Jan/2013
• Became the Grandmaster on 12/Apr/2012
• Reached 70k Level Score on 25/Dec/11
• Reached 71k Level Score on 13/Jan/11
• Reached 71.5k Level Score on 01/Aug/12
• Reached 72k Level Score on 04/Jul/14
• Completed N 1.4 on 08/Sept/08
• Completed NReality on 24/Dec/10
• Reached 100 NReality 0ths on Oct/2011
• Reached 200 NReality 0ths on Nov/2011
• Reached 100 Top-20 Scores on Aug/10
• Reached 200 Top-20 Scores on Nov/11
• Reached 300 Top-20 Scores on Nov/11
• Reached 400 Top-20 Scores on Dec/11
• Reached 500 Top-20 Scores on Jan/12
• Reached 599 Top-20 Scores on 04/Apr/12
• Reached 599 Top-10 Scores on 18/Nov/12

Deds & Images (Spoiler)

Thanks to ska for dedicating this map to me
Thanks to BluePretzel for dedicating this map to me
Thanks to da_guru for dedicating this map to me
Thanks to zoasBE for dedicating this full episode to me!: 00-0 00-100-2 00-3 00-4
Thanks to zoasBE for dedicating this mappack to me
Thanks to zoasBE for partially dedicating this map to me
Thanks to VODKALOVER for dedicating this map to me
Thanks to runningninja for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to zoasBE for partially dedicating this map to me
Thanks to trance for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to llabesab for dedicating this map to me
Thanks to the23 for dedicating this map to me
Thanks to Traveleravi for dedicating this map to me
Thanks to 123leonidas321 for dedicating this map to me
Thanks to the23 for dedicating this map to me
Thanks to Uniden for dedicating this map to me
Thanks to Uniden for dedicating this map to me
Thanks to Ors_II for dedicating this map to me
Thanks to Sunset for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Leonhard for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Daggafork for dedicating this map to me
Thanks to VODKALOVER for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to RandomDigits/SpartaX18 for dedicating this map to me
Sorry if Im missing any ded.

Image
ImageThanks to leo.
Image


Doublemember
Posts: 68
Joined: 2008.12.22 (12:31)

Postby zapkt » 2014.11.15 (22:12)

OK, some (good and bad) news from me:
- I have a first draw of a database, that I filled with my 2 years of HS files
- It turns out 10 years of highscoring creates much more data than I expected, and it gets really slow to process through it. With only 2 years of scores, some queries need to manipulate an amount of data way too big, and it takes forever to calculate some basic stuff such as the number of scores of each player over years. And I plan to run this on a raspberry pi :/ I will work on pre-calculating some stuff to make it usuable.
- However, some queries are fast and allow for very precise questionings (e.g. "When did this player first appear on the scoreboard?", "how many players ever got a score on that board?" etc.). Plenty of cool features to come.
- Before you read further, an overview of some of the cool stuff I will add tomorrow: http://ploudseeker.com:5000/level?level=13-0 Change the level directly in the URL. Please not that it's not hacker-free and only covers 2 years for the moment.
- I thought it would be easy to handle hackers and cheaters by inserting them in the database and flagging them as cheaters/hackers, but as I need to find ways to limit calculation, it's easier to have a database free of those nuisances. Thanks EddyMataGallos for doing that work! It will be very convenient.
- All the code is on github, so other people can install it locally or contribute : https://github.com/Perdu/n_scores . It's in python an you need Flask to run it. I also added the auto downloader if you want to automatize downloading.

User avatar
If you ain't first, you're last!
Posts: 2297
Joined: 2009.02.07 (16:07)
NUMA Profile: http://nmaps.net/user/EddyMataGallos
Location: Spain

Postby EddyMataGallos » 2014.11.15 (22:59)

Awesome project man :D Really looking forward to those features. Quick idea: What about another graph showing the scores of a particular level, not for each player like now, but for each rank. That way I think the evolution of the scores could be appreciated from a different, cool point of view (lines would never intersect and the graph would be less convoluted with only 20 lines).

I too have many ideas, I'll keep suggesting them as time passes :P
ImageImage
Impressive flag by ska -|- N2High - My software for N2.0 -|- Awesome sig by Hendor
About me & Stats (Spoiler)

Hi, im Eddy, a Spanish highscorer and current Grandmaster of N. I've been playing N since 2006, I beat it on the 8th September 2008, and NReality later too. Started intermittently highscoring Metanet in 2010, although serious highscoring started in late 2011.

Current Stats
• Completed N on 8th Sept. 2008
• Completed NReality on 24th Dec. 2010
0th Place on Metanet 0th Rankings with 443 0ths.
0th Place on Metanet Top20 Rankings with 599 Scores.
0th Place on Metanet Top10 Rankings with 599 Scores.
1st Place on Metanet Top5 Rankings with 595 Scores.
0th Place on Metanet Level 0th Rankings with 361 0ths.
0th Place on Metanet Episode 0th Rankings with 82 0ths.
0th Place on Metanet Total Level Score: 72142.900 (20:02:22.900)
0th Place on Metanet Total Episode Score: 35669.900 (09:54:29.900)
0th Place on Metanet Total Point Rankings with 11669 Points.
0th Place in NReality 0th Rankings with 235 0ths.
0th Place for a grand total of 676 Total 0ths.
• Winner of some contests (BUST, 100, 9000, Bounty Hunters, SOAST) and of some rounds of some contests (ROPP, NErratic, Red Ball, NReality Team Arena)

{Info as of 01/Feb/2015} The info may be outdated.

Achievements
• 6th highscorer to reach 100 Metanet 0ths
• 4th highscorer to reach 200 Metanet 0ths
• 1st and only highscorer to reach 300 Metanet 0ths
• 1st and only highscorer to reach 400 Metanet 0ths
• 8th ever Grandmaster
• 2nd* highscorer to reach 599 top-20 Scores
• 1st highscorer to reach 599 top-10 Scores
• 10th highscorer to reach 70k Level Score
• 5th highscorer to reach 71k Level Score
• 2nd highscorer to reach 71.5k Level Score
• 1st highscorer to reach 72k Level Score

Relevant Dates
• First 0th: 31-3 on 04/Oct/10
• Reached 100 Metanet 0ths on 25/Feb/12
• Reached 200 Metanet 0ths on 30/Sep/12
• Reached 300 Metanet 0ths on 16/Mar/13
• Reached 400 Metanet 0ths on 04/Sept/14
• Reached highest amount of 0ths on Jan/2013
• Became the Grandmaster on 12/Apr/2012
• Reached 70k Level Score on 25/Dec/11
• Reached 71k Level Score on 13/Jan/11
• Reached 71.5k Level Score on 01/Aug/12
• Reached 72k Level Score on 04/Jul/14
• Completed N 1.4 on 08/Sept/08
• Completed NReality on 24/Dec/10
• Reached 100 NReality 0ths on Oct/2011
• Reached 200 NReality 0ths on Nov/2011
• Reached 100 Top-20 Scores on Aug/10
• Reached 200 Top-20 Scores on Nov/11
• Reached 300 Top-20 Scores on Nov/11
• Reached 400 Top-20 Scores on Dec/11
• Reached 500 Top-20 Scores on Jan/12
• Reached 599 Top-20 Scores on 04/Apr/12
• Reached 599 Top-10 Scores on 18/Nov/12

Deds & Images (Spoiler)

Thanks to ska for dedicating this map to me
Thanks to BluePretzel for dedicating this map to me
Thanks to da_guru for dedicating this map to me
Thanks to zoasBE for dedicating this full episode to me!: 00-0 00-100-2 00-3 00-4
Thanks to zoasBE for dedicating this mappack to me
Thanks to zoasBE for partially dedicating this map to me
Thanks to VODKALOVER for dedicating this map to me
Thanks to runningninja for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to zoasBE for partially dedicating this map to me
Thanks to trance for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to llabesab for dedicating this map to me
Thanks to the23 for dedicating this map to me
Thanks to Traveleravi for dedicating this map to me
Thanks to 123leonidas321 for dedicating this map to me
Thanks to the23 for dedicating this map to me
Thanks to Uniden for dedicating this map to me
Thanks to Uniden for dedicating this map to me
Thanks to Ors_II for dedicating this map to me
Thanks to Sunset for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Leonhard for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Daggafork for dedicating this map to me
Thanks to VODKALOVER for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to RandomDigits/SpartaX18 for dedicating this map to me
Sorry if Im missing any ded.

Image
ImageThanks to leo.
Image


Legacy Elite
Legacy Elite
Posts: 132
Joined: 2008.09.26 (19:23)
NUMA Profile: http://nmaps.net/Hendor
MBTI Type: INTJ
Location: Canada

Postby Hendor » 2014.11.16 (02:05)

I've added a few presets, and will be adding a few more tonight, as well as playing with the formatting of the page a bit. I rounded up your 49 0ths Wolfos (didn't actually round up, just put you on the list); you're an honorary Master :D

http://www.jamesinman.ca/n/

That looks really cool zapkt, I'm looking forward to see what you make.

Great to hear about golfkid's files! I thought to myself several times while making my graphs that it would be great if we had more files in that range. This is perfect now, this should complete sections of my graph that are a bit empty.

Eddy, I used the global evolution functions for the Top-20 graph, and it worked great. The only thing that would help is if it could do it for a specific list of players, as opposed to the currently loaded rankings. I suppose I could just create a fake NHigh file to load with the players I need, but thought it might be simple for you to code that. It would also be great if NHigh could output files with each player as opposed to just displaying a list. No rush though, make sure you study well :P I sent you a PM detailing some formatting, no need to clog this thread.
Highscorer prone to fleeting comebacks
598 Metanet top-20s in September 2007 (ranked 0th)

User avatar
Lifer
Posts: 1094
Joined: 2009.01.31 (22:13)
NUMA Profile: http://nmaps.net/user/vankusss
Contact:

Postby vankusss » 2014.11.16 (09:12)

zapkt wrote:- It turns out 10 years of highscoring creates much more data than I expected, and it gets really slow to process through it. With only 2 years of scores, some queries need to manipulate an amount of data way too big, and it takes forever to calculate some basic stuff such as the number of scores of each player over years. And I plan to run this on a raspberry pi :/ I will work on pre-calculating some stuff to make it usuable.
I don't know what database you're using, but is there an index on the foreign key in the 'score' table? You might need to create it manually.
iNsane http://www.youtube.com/watch?v=HwrkTEaTXk4 (watch in 480p)( yellow wins )

User avatar
If you ain't first, you're last!
Posts: 2297
Joined: 2009.02.07 (16:07)
NUMA Profile: http://nmaps.net/user/EddyMataGallos
Location: Spain

Postby EddyMataGallos » 2014.11.16 (17:09)

Hendor wrote:Eddy, I used the global evolution functions for the Top-20 graph, and it worked great. The only thing that would help is if it could do it for a specific list of players, as opposed to the currently loaded rankings. I suppose I could just create a fake NHigh file to load with the players I need, but thought it might be simple for you to code that. It would also be great if NHigh could output files with each player as opposed to just displaying a list. No rush though, make sure you study well :P I sent you a PM detailing some formatting, no need to clog this thread.
Perfect, I'll work on that ;) I really like the preset ideas by the way :D

Hey zapkt, now that you're downloading those NHigh files, I thought it might be a good idea to clean them as you save them, so they are ready to be graphed. Since I do the rankings I currently have a proper ignore list, so I can give it to you if you want to implement it. As an extra security measure, you can just disregard any entry which score exceeds 600-650 seconds. That will cover most new hackers that appear ;)

Remember this is done within the _postProcessLevelScores method.
ImageImage
Impressive flag by ska -|- N2High - My software for N2.0 -|- Awesome sig by Hendor
About me & Stats (Spoiler)

Hi, im Eddy, a Spanish highscorer and current Grandmaster of N. I've been playing N since 2006, I beat it on the 8th September 2008, and NReality later too. Started intermittently highscoring Metanet in 2010, although serious highscoring started in late 2011.

Current Stats
• Completed N on 8th Sept. 2008
• Completed NReality on 24th Dec. 2010
0th Place on Metanet 0th Rankings with 443 0ths.
0th Place on Metanet Top20 Rankings with 599 Scores.
0th Place on Metanet Top10 Rankings with 599 Scores.
1st Place on Metanet Top5 Rankings with 595 Scores.
0th Place on Metanet Level 0th Rankings with 361 0ths.
0th Place on Metanet Episode 0th Rankings with 82 0ths.
0th Place on Metanet Total Level Score: 72142.900 (20:02:22.900)
0th Place on Metanet Total Episode Score: 35669.900 (09:54:29.900)
0th Place on Metanet Total Point Rankings with 11669 Points.
0th Place in NReality 0th Rankings with 235 0ths.
0th Place for a grand total of 676 Total 0ths.
• Winner of some contests (BUST, 100, 9000, Bounty Hunters, SOAST) and of some rounds of some contests (ROPP, NErratic, Red Ball, NReality Team Arena)

{Info as of 01/Feb/2015} The info may be outdated.

Achievements
• 6th highscorer to reach 100 Metanet 0ths
• 4th highscorer to reach 200 Metanet 0ths
• 1st and only highscorer to reach 300 Metanet 0ths
• 1st and only highscorer to reach 400 Metanet 0ths
• 8th ever Grandmaster
• 2nd* highscorer to reach 599 top-20 Scores
• 1st highscorer to reach 599 top-10 Scores
• 10th highscorer to reach 70k Level Score
• 5th highscorer to reach 71k Level Score
• 2nd highscorer to reach 71.5k Level Score
• 1st highscorer to reach 72k Level Score

Relevant Dates
• First 0th: 31-3 on 04/Oct/10
• Reached 100 Metanet 0ths on 25/Feb/12
• Reached 200 Metanet 0ths on 30/Sep/12
• Reached 300 Metanet 0ths on 16/Mar/13
• Reached 400 Metanet 0ths on 04/Sept/14
• Reached highest amount of 0ths on Jan/2013
• Became the Grandmaster on 12/Apr/2012
• Reached 70k Level Score on 25/Dec/11
• Reached 71k Level Score on 13/Jan/11
• Reached 71.5k Level Score on 01/Aug/12
• Reached 72k Level Score on 04/Jul/14
• Completed N 1.4 on 08/Sept/08
• Completed NReality on 24/Dec/10
• Reached 100 NReality 0ths on Oct/2011
• Reached 200 NReality 0ths on Nov/2011
• Reached 100 Top-20 Scores on Aug/10
• Reached 200 Top-20 Scores on Nov/11
• Reached 300 Top-20 Scores on Nov/11
• Reached 400 Top-20 Scores on Dec/11
• Reached 500 Top-20 Scores on Jan/12
• Reached 599 Top-20 Scores on 04/Apr/12
• Reached 599 Top-10 Scores on 18/Nov/12

Deds & Images (Spoiler)

Thanks to ska for dedicating this map to me
Thanks to BluePretzel for dedicating this map to me
Thanks to da_guru for dedicating this map to me
Thanks to zoasBE for dedicating this full episode to me!: 00-0 00-100-2 00-3 00-4
Thanks to zoasBE for dedicating this mappack to me
Thanks to zoasBE for partially dedicating this map to me
Thanks to VODKALOVER for dedicating this map to me
Thanks to runningninja for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to zoasBE for partially dedicating this map to me
Thanks to trance for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to llabesab for dedicating this map to me
Thanks to the23 for dedicating this map to me
Thanks to Traveleravi for dedicating this map to me
Thanks to 123leonidas321 for dedicating this map to me
Thanks to the23 for dedicating this map to me
Thanks to Uniden for dedicating this map to me
Thanks to Uniden for dedicating this map to me
Thanks to Ors_II for dedicating this map to me
Thanks to Sunset for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Leonhard for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Daggafork for dedicating this map to me
Thanks to VODKALOVER for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to RandomDigits/SpartaX18 for dedicating this map to me
Sorry if Im missing any ded.

Image
ImageThanks to leo.
Image


Doublemember
Posts: 68
Joined: 2008.12.22 (12:31)

Postby zapkt » 2014.11.16 (17:25)

vankusss wrote:I don't know what database you're using, but is there an index on the foreign key in the 'score' table? You might need to create it manually.
The problem is not really joins, even though it does slow down the queries. To fix that, I put everything in a single flat table, which should speed up things in exchange of an increased storage cost.
EddyMataGallos wrote:Hey zapkt, now that you're downloading those NHigh files, I thought it might be a good idea to clean them as you save them, so they are ready to be graphed. Since I do the rankings I currently have a proper ignore list, so I can give it to you if you want to implement it. As an extra security measure, you can just disregard any entry which score exceeds 600-650 seconds. That will cover most new hackers that appear ;)

Remember this is done within the _postProcessLevelScores method.
Yea sure, please share your code if you already have this implemented. Or even better, add it to my code if you're familiar with open source development: https://github.com/Perdu/n_scores :)

Doublemember
Posts: 68
Joined: 2008.12.22 (12:31)

Postby zapkt » 2014.11.16 (22:24)

OK, some update:
- I uploaded the whole history in my database's app! You can now see valuable information
- I changed the database structure so that it's (hopefully) faster
- I added several functions: graphs by place (Eddy's idea), average time and a filter to display only top n scores (enter 1 to show only 0th)
http://ploudseeker.com:5000/level?level ... vg=1&top=5

It's still running on a raspberry pi, which makes it damn slow :( If you have a more powerfull server to host it, that would be cool.

I may change the chart lib in the future, as I find this one quite inconvenient to use.

Edit: new feature : 19th to 0th difference, or the evolution of how hard was it to get a score along time : http://ploudseeker.com:5000/level?level=88-4&diff=1
(which takes hackers into account)

User avatar
If you ain't first, you're last!
Posts: 2297
Joined: 2009.02.07 (16:07)
NUMA Profile: http://nmaps.net/user/EddyMataGallos
Location: Spain

Postby EddyMataGallos » 2014.11.17 (22:17)

Awesome! Thanks for the update man, I like the new graphs by place functions. However, trying to submit it by checking its checkbox yields an Internal Error for me, it only works when I add "&by_place=1" manually.

In other news, here's a new version of NHigh. All functions in graph code mode now output in a separate .php file for each player. I think the output format is proper. Also, the global ones take the list of players from "input.txt", which is a CSV file (standard, no spaces or anything (using new lines rather than comas works perfectly, too), I included a test one). The non-graph mode global functions are still the same, taking players from the Top20 list. I'll probably include an option to ask for a CSV file too, as its fairly convenient.

On another note, I added a Community Total Level Score and Total Episode Score evolution, kinda cool. I had to do a manual correction function, because as you know in the past some levels/eps used to be filled with hackers, hence showing as 0 in NHigh. The manual correction checks for 0th scores being 0, and adjusts them to the proper 0th score of that time (estimated, introduced by hand in the code, I can't really think on another way of doing this correction, but this should be very accurate, some 0ths like Ep00 didn't even change during the period they were off the boards).

Another change includes that it now scans for NHigh files in subfolders, so you can just paste the 1001 score file collection into the "scores" folder, and it will scan all subfolders ;) I've also included the functions to resave and rename all scores (the cleaning process I was doing), so you can also clean your collection of NHigh files whenever you want. This should take into account files with the same name/date, too.

Download (ony changed files, as usual):
NHighUpdate.rar
(29.92 KiB) Downloaded 209 times
[/s] This has an error, check download 2 posts below.
Last edited by EddyMataGallos on 2014.11.18 (16:39), edited 2 times in total.
ImageImage
Impressive flag by ska -|- N2High - My software for N2.0 -|- Awesome sig by Hendor
About me & Stats (Spoiler)

Hi, im Eddy, a Spanish highscorer and current Grandmaster of N. I've been playing N since 2006, I beat it on the 8th September 2008, and NReality later too. Started intermittently highscoring Metanet in 2010, although serious highscoring started in late 2011.

Current Stats
• Completed N on 8th Sept. 2008
• Completed NReality on 24th Dec. 2010
0th Place on Metanet 0th Rankings with 443 0ths.
0th Place on Metanet Top20 Rankings with 599 Scores.
0th Place on Metanet Top10 Rankings with 599 Scores.
1st Place on Metanet Top5 Rankings with 595 Scores.
0th Place on Metanet Level 0th Rankings with 361 0ths.
0th Place on Metanet Episode 0th Rankings with 82 0ths.
0th Place on Metanet Total Level Score: 72142.900 (20:02:22.900)
0th Place on Metanet Total Episode Score: 35669.900 (09:54:29.900)
0th Place on Metanet Total Point Rankings with 11669 Points.
0th Place in NReality 0th Rankings with 235 0ths.
0th Place for a grand total of 676 Total 0ths.
• Winner of some contests (BUST, 100, 9000, Bounty Hunters, SOAST) and of some rounds of some contests (ROPP, NErratic, Red Ball, NReality Team Arena)

{Info as of 01/Feb/2015} The info may be outdated.

Achievements
• 6th highscorer to reach 100 Metanet 0ths
• 4th highscorer to reach 200 Metanet 0ths
• 1st and only highscorer to reach 300 Metanet 0ths
• 1st and only highscorer to reach 400 Metanet 0ths
• 8th ever Grandmaster
• 2nd* highscorer to reach 599 top-20 Scores
• 1st highscorer to reach 599 top-10 Scores
• 10th highscorer to reach 70k Level Score
• 5th highscorer to reach 71k Level Score
• 2nd highscorer to reach 71.5k Level Score
• 1st highscorer to reach 72k Level Score

Relevant Dates
• First 0th: 31-3 on 04/Oct/10
• Reached 100 Metanet 0ths on 25/Feb/12
• Reached 200 Metanet 0ths on 30/Sep/12
• Reached 300 Metanet 0ths on 16/Mar/13
• Reached 400 Metanet 0ths on 04/Sept/14
• Reached highest amount of 0ths on Jan/2013
• Became the Grandmaster on 12/Apr/2012
• Reached 70k Level Score on 25/Dec/11
• Reached 71k Level Score on 13/Jan/11
• Reached 71.5k Level Score on 01/Aug/12
• Reached 72k Level Score on 04/Jul/14
• Completed N 1.4 on 08/Sept/08
• Completed NReality on 24/Dec/10
• Reached 100 NReality 0ths on Oct/2011
• Reached 200 NReality 0ths on Nov/2011
• Reached 100 Top-20 Scores on Aug/10
• Reached 200 Top-20 Scores on Nov/11
• Reached 300 Top-20 Scores on Nov/11
• Reached 400 Top-20 Scores on Dec/11
• Reached 500 Top-20 Scores on Jan/12
• Reached 599 Top-20 Scores on 04/Apr/12
• Reached 599 Top-10 Scores on 18/Nov/12

Deds & Images (Spoiler)

Thanks to ska for dedicating this map to me
Thanks to BluePretzel for dedicating this map to me
Thanks to da_guru for dedicating this map to me
Thanks to zoasBE for dedicating this full episode to me!: 00-0 00-100-2 00-3 00-4
Thanks to zoasBE for dedicating this mappack to me
Thanks to zoasBE for partially dedicating this map to me
Thanks to VODKALOVER for dedicating this map to me
Thanks to runningninja for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to zoasBE for partially dedicating this map to me
Thanks to trance for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to llabesab for dedicating this map to me
Thanks to the23 for dedicating this map to me
Thanks to Traveleravi for dedicating this map to me
Thanks to 123leonidas321 for dedicating this map to me
Thanks to the23 for dedicating this map to me
Thanks to Uniden for dedicating this map to me
Thanks to Uniden for dedicating this map to me
Thanks to Ors_II for dedicating this map to me
Thanks to Sunset for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Leonhard for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Daggafork for dedicating this map to me
Thanks to VODKALOVER for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to RandomDigits/SpartaX18 for dedicating this map to me
Sorry if Im missing any ded.

Image
ImageThanks to leo.
Image


Doublemember
Posts: 68
Joined: 2008.12.22 (12:31)

Postby zapkt » 2014.11.17 (22:55)

EddyMataGallos wrote:Awesome! Thanks for the update man, I like the new graphs by place functions. However, trying to submit it by checking its checkbox yields an Internal Error for me, it only works when I add "&by_place=1" manually.
Oh, yea, I noticed there was a bug earlier. Fixed.

User avatar
If you ain't first, you're last!
Posts: 2297
Joined: 2009.02.07 (16:07)
NUMA Profile: http://nmaps.net/user/EddyMataGallos
Location: Spain

Postby EddyMataGallos » 2014.11.18 (16:35)

zapkt wrote:
EddyMataGallos wrote:Awesome! Thanks for the update man, I like the new graphs by place functions. However, trying to submit it by checking its checkbox yields an Internal Error for me, it only works when I add "&by_place=1" manually.
Oh, yea, I noticed there was a bug earlier. Fixed.
Cool, thanks for that :D

Also, Hendor warned me about an error in that NHigh I posted above. It was a really stupid mistake I made xD Here's the corrected version:
NHighUpdate.rar
(30.02 KiB) Downloaded 176 times
ImageImage
Impressive flag by ska -|- N2High - My software for N2.0 -|- Awesome sig by Hendor
About me & Stats (Spoiler)

Hi, im Eddy, a Spanish highscorer and current Grandmaster of N. I've been playing N since 2006, I beat it on the 8th September 2008, and NReality later too. Started intermittently highscoring Metanet in 2010, although serious highscoring started in late 2011.

Current Stats
• Completed N on 8th Sept. 2008
• Completed NReality on 24th Dec. 2010
0th Place on Metanet 0th Rankings with 443 0ths.
0th Place on Metanet Top20 Rankings with 599 Scores.
0th Place on Metanet Top10 Rankings with 599 Scores.
1st Place on Metanet Top5 Rankings with 595 Scores.
0th Place on Metanet Level 0th Rankings with 361 0ths.
0th Place on Metanet Episode 0th Rankings with 82 0ths.
0th Place on Metanet Total Level Score: 72142.900 (20:02:22.900)
0th Place on Metanet Total Episode Score: 35669.900 (09:54:29.900)
0th Place on Metanet Total Point Rankings with 11669 Points.
0th Place in NReality 0th Rankings with 235 0ths.
0th Place for a grand total of 676 Total 0ths.
• Winner of some contests (BUST, 100, 9000, Bounty Hunters, SOAST) and of some rounds of some contests (ROPP, NErratic, Red Ball, NReality Team Arena)

{Info as of 01/Feb/2015} The info may be outdated.

Achievements
• 6th highscorer to reach 100 Metanet 0ths
• 4th highscorer to reach 200 Metanet 0ths
• 1st and only highscorer to reach 300 Metanet 0ths
• 1st and only highscorer to reach 400 Metanet 0ths
• 8th ever Grandmaster
• 2nd* highscorer to reach 599 top-20 Scores
• 1st highscorer to reach 599 top-10 Scores
• 10th highscorer to reach 70k Level Score
• 5th highscorer to reach 71k Level Score
• 2nd highscorer to reach 71.5k Level Score
• 1st highscorer to reach 72k Level Score

Relevant Dates
• First 0th: 31-3 on 04/Oct/10
• Reached 100 Metanet 0ths on 25/Feb/12
• Reached 200 Metanet 0ths on 30/Sep/12
• Reached 300 Metanet 0ths on 16/Mar/13
• Reached 400 Metanet 0ths on 04/Sept/14
• Reached highest amount of 0ths on Jan/2013
• Became the Grandmaster on 12/Apr/2012
• Reached 70k Level Score on 25/Dec/11
• Reached 71k Level Score on 13/Jan/11
• Reached 71.5k Level Score on 01/Aug/12
• Reached 72k Level Score on 04/Jul/14
• Completed N 1.4 on 08/Sept/08
• Completed NReality on 24/Dec/10
• Reached 100 NReality 0ths on Oct/2011
• Reached 200 NReality 0ths on Nov/2011
• Reached 100 Top-20 Scores on Aug/10
• Reached 200 Top-20 Scores on Nov/11
• Reached 300 Top-20 Scores on Nov/11
• Reached 400 Top-20 Scores on Dec/11
• Reached 500 Top-20 Scores on Jan/12
• Reached 599 Top-20 Scores on 04/Apr/12
• Reached 599 Top-10 Scores on 18/Nov/12

Deds & Images (Spoiler)

Thanks to ska for dedicating this map to me
Thanks to BluePretzel for dedicating this map to me
Thanks to da_guru for dedicating this map to me
Thanks to zoasBE for dedicating this full episode to me!: 00-0 00-100-2 00-3 00-4
Thanks to zoasBE for dedicating this mappack to me
Thanks to zoasBE for partially dedicating this map to me
Thanks to VODKALOVER for dedicating this map to me
Thanks to runningninja for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to zoasBE for partially dedicating this map to me
Thanks to trance for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to zoasBE for dedicating this map to me
Thanks to llabesab for dedicating this map to me
Thanks to the23 for dedicating this map to me
Thanks to Traveleravi for dedicating this map to me
Thanks to 123leonidas321 for dedicating this map to me
Thanks to the23 for dedicating this map to me
Thanks to Uniden for dedicating this map to me
Thanks to Uniden for dedicating this map to me
Thanks to Ors_II for dedicating this map to me
Thanks to Sunset for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Leonhard for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Daggafork for dedicating this map to me
Thanks to VODKALOVER for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to blue_rocks for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to Armaghan_Ali for dedicating this map to me
Thanks to RandomDigits/SpartaX18 for dedicating this map to me
Sorry if Im missing any ded.

Image
ImageThanks to leo.
Image


User avatar
Smoothest Taint in the West
Posts: 3242
Joined: 2008.09.29 (14:22)
NUMA Profile: http://nmaps.net/user/ska
Steam: www.steamcommunity.com/id/
Location: Australia

Postby ska » 2014.11.21 (10:15)

http://www.jamesinman.ca/n/0th/index.php page for me is borked; it is only showing 0 the whole way across. (I think it's now pointing to my 'ska' alias, because for top-20s, it does show one top-20, which I know I have accidentally submitted once or twice under that account.

Legacy Elite
Legacy Elite
Posts: 132
Joined: 2008.09.26 (19:23)
NUMA Profile: http://nmaps.net/Hendor
MBTI Type: INTJ
Location: Canada

Postby Hendor » 2014.11.21 (10:25)

How did you get to that page? You should only be able to land there after checking off some names from the list. Just use the link from the first post or my signature to get to my main page.
Highscorer prone to fleeting comebacks
598 Metanet top-20s in September 2007 (ranked 0th)

User avatar
Smoothest Taint in the West
Posts: 3242
Joined: 2008.09.29 (14:22)
NUMA Profile: http://nmaps.net/user/ska
Steam: www.steamcommunity.com/id/
Location: Australia

Postby ska » 2014.11.21 (11:51)

Hendor wrote:How did you get to that page? You should only be able to land there after checking off some names from the list. Just use the link from the first post or my signature to get to my main page.
oh, sorry... I just copied the url that was on my page. That being said, my point still stands; my scores are not loading correctly, and I suspect it has something to do with looking for "ska" results, rather than "Ben_Schultz_11" results...

Legacy Elite
Legacy Elite
Posts: 132
Joined: 2008.09.26 (19:23)
NUMA Profile: http://nmaps.net/Hendor
MBTI Type: INTJ
Location: Canada

Postby Hendor » 2014.11.21 (11:56)

Oh, shit, yeah, sorry. I manually changed your's to "ska" in a previous set of scores, but now that things are more automated, it got screwed up. Would you rather be listed as ska or Ben_Schultz_11?
Highscorer prone to fleeting comebacks
598 Metanet top-20s in September 2007 (ranked 0th)

User avatar
Smoothest Taint in the West
Posts: 3242
Joined: 2008.09.29 (14:22)
NUMA Profile: http://nmaps.net/user/ska
Steam: www.steamcommunity.com/id/
Location: Australia

Postby ska » 2014.11.21 (11:58)

Hendor wrote:Oh, shit, yeah, sorry. I manually changed your's to "ska" in a previous set of scores, but now that things are more automated, it got screwed up. Would you rather be listed as ska or Ben_Schultz_11?
I don't really mind, but I think for the sake of consistency, you're better of just labelling it how it is on the boards.

Legacy Elite
Legacy Elite
Posts: 132
Joined: 2008.09.26 (19:23)
NUMA Profile: http://nmaps.net/Hendor
MBTI Type: INTJ
Location: Canada

Postby Hendor » 2014.11.21 (12:41)

K, fixed up your score and alphabetized the list of scorers while I was at it.
Highscorer prone to fleeting comebacks
598 Metanet top-20s in September 2007 (ranked 0th)


Who is online

Users browsing this forum: No registered users and 9 guests