Page Index Toggle Pages: [1] 2 3 4 Send TopicPrint
Very Hot Topic (More than 75 Replies) Where does playeraudit.com get its data from? (Read 10331 times)
yes
Korthos Resident
*
Offline


I Love Drama!

Posts: 3
Joined: Nov 15th, 2020
Where does playeraudit.com get its data from?
Nov 21st, 2020 at 5:06am
Print Post  
Does ddo have some kind of http api?

Where does the guy get its data from?
  
Back to top
 
IP Logged
 
crunch
Stormreaver Piker
*
Offline



Posts: 745
Location: Europe
Joined: Mar 20th, 2012
Gender: Male
Re: Where does playeraudit.com get its data from?
Reply #1 - Nov 21st, 2020 at 7:17am
Print Post  
I have no first-hand information but I assume they have a character logged to each server and some way of processing LFM and WHO data.
  
Back to top
 
IP Logged
 
Snu Snu
Shroud Slacker
***
Offline


Drama is boring

Posts: 1054
Joined: Sep 10th, 2012
Re: Where does playeraudit.com get its data from?
Reply #2 - Nov 21st, 2020 at 9:00am
Print Post  
In the starting phase he stated that he got several accounts logged in on servers. Now he is thanking the VoK guys.
Ask him or her.
  

Bored Byond Belief
Back to top
 
IP Logged
 
5 Foot Step
Completionist (i.t.p.)
******
Offline


I Hate Idiots!

Posts: 11119
Location: USA
Joined: Mar 8th, 2014
Gender: Male
Re: Where does playeraudit.com get its data from?
Reply #3 - Nov 21st, 2020 at 12:40pm
Print Post  
The API died a long time ago.
  

Build links
Endgame Gear Guide
Cannith Crafting Planner link

Warning: May contain outdated cultural depictions.
Back to top
 
IP Logged
 
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #4 - Nov 21st, 2020 at 2:58pm
Print Post  
the playeraudit guy has said several times that he has "friends with too much free time" who screenshot the LFMs and whatnot for him. But I also have some trouble believing that. Especially the players-online part, since how do you get a count like that without doing it manually?
  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
Snu Snu
Shroud Slacker
***
Offline


Drama is boring

Posts: 1054
Joined: Sep 10th, 2012
Re: Where does playeraudit.com get its data from?
Reply #5 - Nov 22nd, 2020 at 4:45am
Print Post  
Well, automating something you did manually is one of the purposes of programming, is it not?
  

Bored Byond Belief
Back to top
 
IP Logged
 
Toke
Stormreaver Piker
*
Offline


... or maybe I was just
smoking something.

Posts: 744
Joined: Jan 7th, 2014
Re: Where does playeraudit.com get its data from?
Reply #6 - Nov 22nd, 2020 at 9:50am
Print Post  
It feels like they have a screen scraper account logged into each server by the update frequency.
  

If you can roll it you can smoke it.  If you can carve it you can smoke with it.
Back to top
 
IP Logged
 
Flav
Vault Frog
*
Offline


One Frog to Rule them
All!

Posts: 10011
Location: Land of the Frogs
Joined: Aug 29th, 2010
Gender: Male
Re: Where does playeraudit.com get its data from?
Reply #7 - Nov 22nd, 2020 at 9:52am
Print Post  
If they scan the who list, they miss all the people that are logged anonymously.
The API ( long dead now ) didn't miss them though.

so in the end there's at least 20% more people than what they report, since the Anonymous won't show up.
  

Yes my avatar is an Hermine eating a Greenland Lemming for brunch.
Back to top
 
IP Logged
 
Shunned
Stormreaver Piker
*
Offline


Hi! You have multiple
personality disorder.

Posts: 536
Location: Behind the edit button
Joined: Nov 21st, 2020
Re: Where does playeraudit.com get its data from?
Reply #8 - Nov 22nd, 2020 at 10:04am
Print Post  
Flav wrote on Nov 22nd, 2020 at 9:52am:
If they scan the who list, they miss all the people that are logged anonymously.
The API ( long dead now ) didn't miss them though.

so in the end there's at least 20% more people than what they report, since the Anonymous won't show up.


Theres a post buried on his site somewhere that says "we can now see anons too"

My guess is he figured out someway to revive functionality of the api???
  
Back to top
 
IP Logged
 
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #9 - Nov 22nd, 2020 at 2:23pm
Print Post  
Snu Snu wrote on Nov 22nd, 2020 at 4:45am:
Well, automating something you did manually is one of the purposes of programming, is it not?



  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #10 - Nov 22nd, 2020 at 2:25pm
Print Post  
Flav wrote on Nov 22nd, 2020 at 9:52am:
so in the end there's at least 20% more people than what they report, since the Anonymous won't show up.


If he's low by 20% that's not really a bad thing. Sure its data inaccuracy but in this sort of application having a lower than actual number isn't the end of the world.
  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #11 - Nov 22nd, 2020 at 2:27pm
Print Post  
Shunned wrote on Nov 22nd, 2020 at 10:04am:
My guess is he figured out someway to revive functionality of the api???


Another theory is the API no longer recieves updates or ongoing development, is broken for 90% of tasks, but still functions juuuuuuuussssssstttt well enough to pull server population data. The LFMs are clearly a screen grab but it would not be difficult to automate that process(note: 'Automating' comes from the roots 'auto-' meaning 'self-', and 'mating', meaning 'screwing'.)
  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
Notanarc
Titan Demolisher
****
Offline


I Love Drama!

Posts: 315
Joined: May 17th, 2020
Re: Where does playeraudit.com get its data from?
Reply #12 - Nov 22nd, 2020 at 2:27pm
Print Post  
How do you log on as anonymous?
  
Back to top
 
IP Logged
 
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #13 - Nov 22nd, 2020 at 2:46pm
Print Post  
Notanarc wrote on Nov 22nd, 2020 at 2:27pm:
How do you log on as anonymous?


You don't log in. In text chat "/anonymous on" sets you to anonymous. Source:

https://ddowiki.com/page/Chat
  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
kum-gulp
VoD Slasher
*****
Offline


I Love Tired Vault Memes!

Posts: 1812
Joined: Jul 16th, 2010
Re: Where does playeraudit.com get its data from?
Reply #14 - Nov 22nd, 2020 at 2:46pm
Print Post  
G̶e̶t̶ ̶o̶n̶e̶ ̶o̶f̶ ̶t̶h̶o̶s̶e̶ ̶f̶u̶n̶k̶y̶ ̶m̶a̶s̶k̶s̶  it's at the bottom of the LFM panel
  
Back to top
 
IP Logged
 
Flav
Vault Frog
*
Offline


One Frog to Rule them
All!

Posts: 10011
Location: Land of the Frogs
Joined: Aug 29th, 2010
Gender: Male
Re: Where does playeraudit.com get its data from?
Reply #15 - Nov 22nd, 2020 at 4:22pm
Print Post  
Shunned wrote on Nov 22nd, 2020 at 10:04am:
My guess is he figured out someway to revive functionality of the api??? 


it's wild assed to think that.

noamineo wrote on Nov 22nd, 2020 at 2:25pm:
If he's low by 20% that's not really a bad thing


I agree, actually if it's as high as 20% being that much lower is a good thing... it means that the game population is higher than many think.


noamineo wrote on Nov 22nd, 2020 at 2:27pm:
Another theory is the API no longer recieves updates or ongoing development, is broken for 90% of tasks, but still functions juuuuuuuussssssstttt well enough to pull server population data. 


As far as I know the API server ( that was left rotting in a corner after they killed MyDDO ) died during a power outage long before they moved to the Current Virtualized Datacenter environment. Since at that time it was not possible to have a coder token anymore only those that used the API before they killed MyDDO were still able to use the API server before it's death.

I don't think they revived it when they went virtual. ( they would have made some noise about it, like when they gave us back the art assets so that we could reskin the game )

Now, and it's going to devolve rapidly back into geek stuff between noamineo and me, they might have found a way to tickle the login server to provide informations. ( and in that case they might be able to track the anonymous, since they appears as login, but not in the who list )


  

Yes my avatar is an Hermine eating a Greenland Lemming for brunch.
Back to top
 
IP Logged
 
Jerky
Korthos Resident
*
Offline


I don't even play this
game

Posts: 16
Location: NYC
Joined: Nov 22nd, 2020
Re: Where does playeraudit.com get its data from?
Reply #16 - Nov 22nd, 2020 at 4:39pm
Print Post  
On a similar note, anyone know how DDOracle is getting their data? And are these two sites getting data from the same place?
  
Back to top
 
IP Logged
 
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #17 - Nov 22nd, 2020 at 4:45pm
Print Post  
Flav wrote on Nov 22nd, 2020 at 4:22pm:
Now, and it's going to devolve rapidly back into geek stuff between noamineo and me, they might have found a way to tickle the login server to provide informations. ( and in that case they might be able to track the anonymous, since they appears as login, but not in the who list )


It was inevitable, really.

So "API" is one of those tech buzz-words that can mean all kinds of different things depending on who's making it. The game's intentional public API that you speak of is probably very long dead, but we shouldn't omit the notion that the login server or game servers themselves had independent APIs  someone might have tripped into accessing.

Another notion to consider - there may be some not terribly difficult way to pull this information out of the client. We already know its possible to manually trigger a request(open the social panel and go to the "who" page) - its possible this process presents some kind of request to the server. Something like:

Client "How many people are online?"
Server "528 people with 147 anonymous"
Client: "Display non-anonymous players" (client busily makes a table with 381 rows to hold the data)

It wouldn't take much to figure out where this information is being returned and pull it out of there. At the very least a packet trace could do it the same way they reverse-engineer MMO servers.

Knowing how incredibly hostile the SSG devs are towards any players who do anything remotely like that, its fairly easy to see why the guy doing it might say "Oh I just have a bunch of friends manually counting for me!" while quietly weeping to himself about how no one will ever know his true cleverness.
  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
SirValentine
Korthos Resident
*
Offline


Never.

Posts: 89
Joined: Jan 11th, 2014
Re: Where does playeraudit.com get its data from?
Reply #18 - Nov 22nd, 2020 at 5:39pm
Print Post  
Jerky wrote on Nov 22nd, 2020 at 3:01pm:
The about page says that they track anons and that it's about 3% of the population.

For the LFMs maybe using OCR? It's not just an image of the in-game panel  cause you can change font size, sort, mouse hover, etc.


Their About page also says, "Data for the Live LFM panel is gathered from the game client every 15 seconds."

I mean, maybe they are lying, but why?  Unless there's some specific reason to think otherwise, I'm going to assume it works how they say it works, over conspiracy theories about bored friends and screenshots and OCR.
  
Back to top
 
IP Logged
 
Snu Snu
Shroud Slacker
***
Offline


Drama is boring

Posts: 1054
Joined: Sep 10th, 2012
Re: Where does playeraudit.com get its data from?
Reply #19 - Nov 22nd, 2020 at 6:42pm
Print Post  
Jerky wrote on Nov 22nd, 2020 at 4:39pm:
On a similar note, anyone know how DDOracle is getting their data? And are these two sites getting data from the same place?



DDOracle doesn't react to any questions whatsoever. It doesn't really look like there is much maintenance going on either.

Does the data match?
  

Bored Byond Belief
Back to top
 
IP Logged
 
5 Foot Step
Completionist (i.t.p.)
******
Offline


I Hate Idiots!

Posts: 11119
Location: USA
Joined: Mar 8th, 2014
Gender: Male
Re: Where does playeraudit.com get its data from?
Reply #20 - Nov 22nd, 2020 at 7:20pm
Print Post  
Snu Snu wrote on Nov 22nd, 2020 at 6:42pm:
DDOracle doesn't react to any questions whatsoever. It doesn't really look like there is much maintenance going on either.


He was a talkative guy when I ran into him in game. He wouldn't say a word about where the data come from, but this was years ago.

He loved talking about whether his publishing the declining number was a self-fulfilling prophecy. And how the default server thing was mostly a double counting artifact that he couldn't fully figure out. That turned into its own self-fulfilling prophecy though.
  

Build links
Endgame Gear Guide
Cannith Crafting Planner link

Warning: May contain outdated cultural depictions.
Back to top
 
IP Logged
 
Rose-tinted Goggles
Waterworks Kobold
**
Offline


I Love Nostalgia!

Posts: 191
Joined: Jun 3rd, 2018
Re: Where does playeraudit.com get its data from?
Reply #21 - Nov 22nd, 2020 at 8:26pm
Print Post  
5 Foot Step wrote on Nov 21st, 2020 at 12:40pm:
The API died a long time ago.



Remember when you could look up other players gear/stats on YourDDO? Logging with shit gear to troll other players.
  

Update 1-13: The golden age of DDO

rest wrote on Oct 26th, 2012 at 12:53pm:
DDO is still the old fat wife I have at home who I can't fucking stand, but we've been together so long I can't see myself leaving.
Back to top
 
IP Logged
 
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #22 - Nov 22nd, 2020 at 8:36pm
Print Post  
Rose-tinted Goggles wrote on Nov 22nd, 2020 at 8:26pm:
Remember when you could look up other players gear/stats on YourDDO? Logging with shit gear to troll other players.


SHA-LA-LA-LA-LA-LA-LA-LA-TEE-DAH!!!!(la-tee-dah)


Sorry, couldn't resist Tongue
  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
Flav
Vault Frog
*
Offline


One Frog to Rule them
All!

Posts: 10011
Location: Land of the Frogs
Joined: Aug 29th, 2010
Gender: Male
Re: Where does playeraudit.com get its data from?
Reply #23 - Nov 23rd, 2020 at 1:09pm
Print Post  
Rose-tinted Goggles wrote on Nov 22nd, 2020 at 8:26pm:
Logging with shit gear to troll other players.   


Lots of people was doing that... which lead to the "Link your DR Breaker" tells when trying to join a PUG.
  

Yes my avatar is an Hermine eating a Greenland Lemming for brunch.
Back to top
 
IP Logged
 
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #24 - Nov 23rd, 2020 at 1:39pm
Print Post  
Flav wrote on Nov 23rd, 2020 at 1:09pm:
Lots of people was doing that... which lead to the "Link your DR Breaker" tells when trying to join a PUG.


...That explains a lot. I remember that being a thing way back in the day of lvlcap 20 shrouds, Thing is though my DR-breaker was not my normal every-day weapon, so not sure how yourddo would have shown it Tongue
  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
Page Index Toggle Pages: [1] 2 3 4
Send TopicPrint