Page Index Toggle Pages: 1 2 [3] 4  Send TopicPrint
Very Hot Topic (More than 75 Replies) Where does playeraudit.com get its data from? (Read 10352 times)
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #50 - Nov 26th, 2020 at 12:36pm
Print Post  
Oracler wrote on Nov 26th, 2020 at 4:36am:
For each server they have a virtual machine running windows client with a written injector that reads process memory. Such data is then exposed to www server and processed there.

Those guys made a huge progress mapping ddo client memory. Firstly they started exposing live LFM/WHO data. But now they made a myddo equivalent that reads your ddo client's memory (implemented in new version of VoK launcher) that can read your whole character info and send it to their service. They even made menu that injects into ddo client that allows you choose which character data you want to share.

DDO client receives also info about anonymous characters but just don't displays it - but VoK team include those anonymous characters into statistics.

As long as they (VoK) are generally paladins SSG doesn't block them (they obviously breaking ToS) - but with their knowledge and progress they could write a fully functional ddo bot [imagine including today's AI algorithms], wallhacks, disable anti-dupe client's mechanisms, scrap much more data (eg every inventory items of every logged in character), tamper with client<->server communication in many ways.




Well that's pretty cool.

These are gonna be the guys that make the server emulator when the time comes.
  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
Flav
Vault Frog
*
Offline


One Frog to Rule them
All!

Posts: 10011
Location: Land of the Frogs
Joined: Aug 29th, 2010
Gender: Male
Re: Where does playeraudit.com get its data from?
Reply #51 - Nov 26th, 2020 at 1:28pm
Print Post  
noamineo wrote on Nov 26th, 2020 at 12:26pm:
Why should it be encrypted? We're talking about a video game, here. The only thing super extra secret is the password; for everything else why take the extra overhead to encrypt?


The exe files and DLLs are encrypted when they get downloaded during a patch.

The DAT files ( well the forward itterations that gets added to the DAT files ) are not. But since they are present on your computer only long enough to be added to the relevant DAT file there's no point in encrypting them.

noamineo wrote on Nov 26th, 2020 at 12:36pm:
These are gonna be the guys that make the server emulator when the time comes.


Maybe they managed to pull that because AC emulators were made by the AC community when they learned that the plug was going to be pulled on their game. ( since we all know that AC, DDO and LoTRO uses the same tech for lots of things )
.
  

Yes my avatar is an Hermine eating a Greenland Lemming for brunch.
Back to top
 
IP Logged
 
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #52 - Nov 26th, 2020 at 4:45pm
Print Post  
Flav wrote on Nov 26th, 2020 at 1:28pm:
The exe files and DLLs are encrypted when they get downloaded during a patch.


I believe(am not certain) that as far as the DLLs are concerned the "encryption" has less to do with security and more to do with making sure the highly-ordered data files can be accessed quickly and efficiently by the game engine.

I was however more specifically talking about the client/server communication, and musing about why they would bother to encrypt that. Just extra time/system resources on both ends when the only thing remotely sensitive is passwords and payment information. Who really cares what casting fireball at lvl 11 looks like on a packet capture?




Flav wrote on Nov 26th, 2020 at 1:28pm:
Maybe they managed to pull that because AC emulators were made by the AC community when they learned that the plug was going to be pulled on their game. ( since we all know that AC, DDO and LoTRO uses the same tech for lots of things )
.


I wouldn't be the slightest bit surprised if the VoK guys weren't somehow involved with the AC emulator. At the very least its open-source so nothing stopping them from downloading it and using it for clues.

Its really good to know there's a group like that out there. Some day SSG will pull the plug(very literally) on DDO, hopefully they will give us enough warning to get the emulator built.

One thing that would be really cool is if the VoK guys could actually mine the data with their client and actually let you import your character over.
  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
Jerky
Korthos Resident
*
Offline


I don't even play this
game

Posts: 16
Location: NYC
Joined: Nov 22nd, 2020
Re: Where does playeraudit.com get its data from?
Reply #53 - Nov 26th, 2020 at 6:38pm
Print Post  
I messaged them about it. Doesn't look like they're willing to share.

Quote:
All of the information I'm willing to share is on the About page. It probably won't answer your question specifically, but that's as far as I'm willing to go.

And no, I'm not VoK; those are two separate things. The VoK team was a huge help regarding the research required for player demographics (and by extension, the Live LFM viewer), but I'm doing that data collection on my own. My website and all the scripts and databases behind it are my own.
  
Back to top
 
IP Logged
 
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #54 - Nov 26th, 2020 at 7:43pm
Print Post  
Yeah, that's about what I had assumed. Obviously if he says too much SSG will jump right up his ass.

Interesting that he's not working with VoK. Seems like there'd be a lot of overlap there. Ah well, Kudos to all of them.
  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
Flav
Vault Frog
*
Offline


One Frog to Rule them
All!

Posts: 10011
Location: Land of the Frogs
Joined: Aug 29th, 2010
Gender: Male
Re: Where does playeraudit.com get its data from?
Reply #55 - Nov 27th, 2020 at 12:23pm
Print Post  
noamineo wrote on Nov 26th, 2020 at 4:45pm:
I was however more specifically talking about the client/server communication, and musing about why they would bother to encrypt that.


Not encrypted... there's a combat logger somewhere.... ah, here : https://github.com/n0la/dclog

  

Yes my avatar is an Hermine eating a Greenland Lemming for brunch.
Back to top
 
IP Logged
 
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #56 - Nov 27th, 2020 at 1:59pm
Print Post  
Flav wrote on Nov 27th, 2020 at 12:23pm:
Not encrypted... there's a combat logger somewhere.... ah, here : https://github.com/n0la/dclog



That explains a lot. I keep being told to check the combat logs, like fucking how? I know they show up in game but you can't copy them and trying to parse is not really possible.
  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
Morrikan
Korthos Resident
*
Offline


I Love Drama!

Posts: 25
Joined: Dec 2nd, 2020
Re: Where does playeraudit.com get its data from?
Reply #57 - Dec 2nd, 2020 at 6:24pm
Print Post  
Registered just to say I'm here.  Best way to reach me is discord, but I will try to check in periodically.
  
Back to top
 
IP Logged
 
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #58 - Dec 2nd, 2020 at 7:53pm
Print Post  
Morrikan wrote on Dec 2nd, 2020 at 6:24pm:
Registered just to say I'm here.  Best way to reach me is discord, but I will try to check in periodically.


And you are...?
  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
Oracler
Titan Demolisher
****
Offline


Sploits! omnomnom..

Posts: 389
Joined: Mar 17th, 2014
Re: Where does playeraudit.com get its data from?
Reply #59 - Dec 3rd, 2020 at 4:33am
Print Post  
noamineo wrote on Dec 2nd, 2020 at 7:53pm:
And you are...?


He's the VoK guy (VoK launcher, VoK loot hoarder tool, new MyDDO).

Clemmeit is the playeraudit.com guy.

Morrikan was helping Clemmeit with some stuff for playeraudit.com.

Dunno which one of those guys was starting first with scrapping data from game client memory Smiley

  

Here's a drama, There's a drama, and another little drama
Fuzzy drama, Funny drama, drama drama duck

drama drama, cheesecake drama, tablet, brick, potato, drama
drama drama mushroom drama, drama drama duck
Back to top
 
IP Logged
 
Morrikan
Korthos Resident
*
Offline


I Love Drama!

Posts: 25
Joined: Dec 2nd, 2020
Re: Where does playeraudit.com get its data from?
Reply #60 - Dec 3rd, 2020 at 9:54am
Print Post  
Oracler wrote on Dec 3rd, 2020 at 4:33am:
He's the VoK guy (VoK launcher, VoK loot hoarder tool, new MyDDO).

Yep  Cool
  
Back to top
 
IP Logged
 
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #61 - Dec 3rd, 2020 at 1:37pm
Print Post  
Morrikan wrote on Dec 3rd, 2020 at 9:54am:
Yep  Cool


WELCOME!!!!

I'm actually really glad you're here. Huge fan. Not, you know, a big enough fan to know your forum handles or anything... but man thank you so much for VoK. SO much more useful than the wiki or the blatant lies on the motherboards.
  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
Flav
Vault Frog
*
Offline


One Frog to Rule them
All!

Posts: 10011
Location: Land of the Frogs
Joined: Aug 29th, 2010
Gender: Male
Re: Where does playeraudit.com get its data from?
Reply #62 - Dec 3rd, 2020 at 2:25pm
Print Post  
noamineo wrote on Dec 3rd, 2020 at 1:37pm:
SO much more useful than the wiki


Which wiki ?

The Compendium or the ShoeWiki ?

  

Yes my avatar is an Hermine eating a Greenland Lemming for brunch.
Back to top
 
IP Logged
 
Technomage
Epic Poster
*****
Offline


And so it begins...

Posts: 4444
Location: Tucson, AZ
Joined: Aug 27th, 2015
Gender: Male
Re: Where does playeraudit.com get its data from?
Reply #63 - Dec 3rd, 2020 at 2:33pm
Print Post  
Flav wrote on Dec 3rd, 2020 at 2:25pm:
Which wiki ?

The Compendium or the ShoeWiki ?


NOBODY gives a shit about the Compendium anymore.

When someone says "wiki," just assume they're talking about the DDOwiki.
  

Do not try the patience of wizards, for they are subtle and quick to anger.

We are dreamers, shapers, singers, and makers. We study the mysteries of laser and circuit, crystal and scanner, holographic demons and invocation of equations. These are the tools we employ, and we know many things.

The absence of evidence is not evidence of absence.
Back to top
 
IP Logged
 
Morrikan
Korthos Resident
*
Offline


I Love Drama!

Posts: 25
Joined: Dec 2nd, 2020
Re: Where does playeraudit.com get its data from?
Reply #64 - Dec 3rd, 2020 at 2:59pm
Print Post  
noamineo wrote on Dec 3rd, 2020 at 1:37pm:
WELCOME!!!!

I'm actually really glad you're here. Huge fan. Not, you know, a big enough fan to know your forum handles or anything... but man thank you so much for VoK. SO much more useful than the wiki or the blatant lies on the motherboards.

I'm LordMorrikan on the main forums - registered a few months ago.  I don't really play DDO, I'm just a dev with a passion for reverse engineering.

We aim to make a useful tool.  Our item website has some bugs, it's not perfect.  Our biggest constraint is time.  We know how to do tons more cool stuff, we just don't have the man hours to do it all.  Real life has been kicking our butts pretty hard the past 4-6 months.
  
Back to top
 
IP Logged
 
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #65 - Dec 3rd, 2020 at 3:19pm
Print Post  
Morrikan wrote on Dec 3rd, 2020 at 2:59pm:
I'm LordMorrikan on the main forums - registered a few months ago.  I don't really play DDO, I'm just a dev with a passion for reverse engineering.

We aim to make a useful tool.  Our item website has some bugs, it's not perfect.  Our biggest constraint is time.  We know how to do tons more cool stuff, we just don't have the man hours to do it all.  Real life has been kicking our butts pretty hard the past 4-6 months.


Really? I've had substantially more free time than usual myself Tongue

But yeah no its totally cool, its a volunteer project, I get it.

Just out of curiosity, have you given any thoughts to reverse-engineering the server itself, build a DDO server emulator? Its not absolutely demanded now but at some distant future date DDO is going to be shut down, and it'd be kind of awesome to have a working client/server emulator.
  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
Morrikan
Korthos Resident
*
Offline


I Love Drama!

Posts: 25
Joined: Dec 2nd, 2020
Re: Where does playeraudit.com get its data from?
Reply #66 - Dec 3rd, 2020 at 3:55pm
Print Post  
noamineo wrote on Dec 3rd, 2020 at 3:19pm:
Just out of curiosity, have you given any thoughts to reverse-engineering the server itself, build a DDO server emulator? Its not absolutely demanded now but at some distant future date DDO is going to be shut down, and it'd be kind of awesome to have a working client/server emulator.

As a third party, we have to play a delicate balancing game between doing stuff that is useful for players and pissing off SSG. An emulator is definitely in the latter category and we have no interest in making one (or in assisting in any such efforts either). If DDO ever gets shut down, that story might change, but it's our stance for now.
  
Back to top
 
IP Logged
 
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #67 - Dec 3rd, 2020 at 4:03pm
Print Post  
That's probably a good stance to take publicly.
  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
Snu Snu
Shroud Slacker
***
Offline


Drama is boring

Posts: 1054
Joined: Sep 10th, 2012
Re: Where does playeraudit.com get its data from?
Reply #68 - Dec 3rd, 2020 at 4:14pm
Print Post  
noamineo wrote on Dec 3rd, 2020 at 3:19pm:
Really? I've had substantially more free time than usual myself Tongue



We noticed.

noamineo wrote on Dec 3rd, 2020 at 3:19pm:
Just out of curiosity, have you given any thoughts to reverse-engineering the server itself, build a DDO server emulator? Its not absolutely demanded now but at some distant future date DDO is going to be shut down, and it'd be kind of awesome to have a working client/server emulator.


There was someone who boasted to set up a private server, wasn't there?! What did become of that project? Does anyone know?
  

Bored Byond Belief
Back to top
 
IP Logged
 
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #69 - Dec 3rd, 2020 at 4:19pm
Print Post  
Snu Snu wrote on Dec 3rd, 2020 at 4:14pm:
There was someone who boasted to set up a private server, wasn't there?! What did become of that project? Does anyone know?


DupeHero said he was working on a private server, no one bragged or boasted about having set one up.
  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
Snu Snu
Shroud Slacker
***
Offline


Drama is boring

Posts: 1054
Joined: Sep 10th, 2012
Re: Where does playeraudit.com get its data from?
Reply #70 - Dec 3rd, 2020 at 4:21pm
Print Post  
Morrikan wrote on Dec 3rd, 2020 at 2:59pm:
I'm LordMorrikan on the main forums - registered a few months ago.  I don't really play DDO, I'm just a dev with a passion for reverse engineering.

We aim to make a useful tool.  Our item website has some bugs, it's not perfect.  Our biggest constraint is time.  We know how to do tons more cool stuff, we just don't have the man hours to do it all.  Real life has been kicking our butts pretty hard the past 4-6 months.


Can we order stuff? Like a dps meter or a character planner, combat log logger. Correct description of hidden mechanics .... but that would cross THE line, I guess.
  

Bored Byond Belief
Back to top
 
IP Logged
 
Technomage
Epic Poster
*****
Offline


And so it begins...

Posts: 4444
Location: Tucson, AZ
Joined: Aug 27th, 2015
Gender: Male
Re: Where does playeraudit.com get its data from?
Reply #71 - Dec 3rd, 2020 at 4:27pm
Print Post  
I'd like to see the loot tables for each quest and raid (with all appropriate chances to drop each item) in the game published.

Rodrak did that for just a few selected quests but he's long since disappeared.
  

Do not try the patience of wizards, for they are subtle and quick to anger.

We are dreamers, shapers, singers, and makers. We study the mysteries of laser and circuit, crystal and scanner, holographic demons and invocation of equations. These are the tools we employ, and we know many things.

The absence of evidence is not evidence of absence.
Back to top
 
IP Logged
 
Morrikan
Korthos Resident
*
Offline


I Love Drama!

Posts: 25
Joined: Dec 2nd, 2020
Re: Where does playeraudit.com get its data from?
Reply #72 - Dec 3rd, 2020 at 4:45pm
Print Post  
Technomage wrote on Dec 3rd, 2020 at 4:27pm:
I'd like to see the loot tables for each quest and raid (with all appropriate chances to drop each item) in the game published.

Have you been to our website? It's far from comprehensive, but we publish drop rates for a fair bit of stuff.
  
Back to top
 
IP Logged
 
Morrikan
Korthos Resident
*
Offline


I Love Drama!

Posts: 25
Joined: Dec 2nd, 2020
Re: Where does playeraudit.com get its data from?
Reply #73 - Dec 3rd, 2020 at 5:15pm
Print Post  
Realized I can't edit, so I'll post again...

Our basic problem is that drop rate data is a very manual and labor intensive process.  We could publish more, it just takes developer hours to do it.
  
Back to top
 
IP Logged
 
noamineo
Completionist (i.t.p.)
******
Offline


All men fear time, but
time fears the pyramids

Posts: 9183
Location: Titan
Joined: Jul 2nd, 2014
Re: Where does playeraudit.com get its data from?
Reply #74 - Dec 3rd, 2020 at 5:18pm
Print Post  
Morrikan wrote on Dec 3rd, 2020 at 5:15pm:
Realized I can't edit, so I'll post again...


Yeah that's a problem with the Vault right now. I don't suppose you know anything about YaBB? There's probably a knighthood in it for you if you can fix it.


Morrikan wrote on Dec 3rd, 2020 at 5:15pm:
Our basic problem is that drop rate data is a very manual and labor intensive process.  We could publish more, it just takes developer hours to do it.


Is there any grunt-work you can farm out to the community? Probably plenty of us willing to run packet caps and carry out specific actions.
  

I'll never understand the propensity of people to brag about being good at a video game. Its a toy you play with for fun. The only person who should be proud of you is your mother. If you're 3.
Back to top
 
IP Logged
 
Page Index Toggle Pages: 1 2 [3] 4 
Send TopicPrint