New Log Analyzer Project...

[imported_Silowyi]

bool detailedServerLogsEnabled = true

You will probably have to add it unless you are still working your original install.

[pogowolf]

I believe I have that setting already set, but I'll double check. Though, I'm not sure there's a difference in the log files themselves...

[pogowolf]

New Updates to this project for those following the thread

[Kralle]

Just to inform you that I am following your Thread.

I am looking forward for your Logfileanalyzer

[pogowolf]

Hey all,
Here's a short update.

Currently the system IS parseing in all data from the logs.. but after doing some speeds tests I was seeing that it was taking about 10 mins. to parse a 6 meg log file.

Grated.. it's 6 meg.. but still.. whew.

I have updated the code to only pull in the needed data, and NOT to handle
the other information at the moment. Orginally the system would parse out
your chats into seperate files, andremove all unneeded 'comment's from the log. Comments like 'You are too far away', or 'Resource has been depleted'

the thought was to removed everything from the log, so that if there was anything
left.. that would mean the AE has made a log change, and that I'll need to update the code. I'll most likly add this code back (since it DOES work).. but at a later date.


currently, I'm working on the reporting system.

[pogowolf]

Posted updates.

[pogowolf]

Getting closer....

[pogowolf]

a Yahoo Group has beenCreated for those that wish to
get into the guts of the system, to make it better
for everyone: http://groups.yahoo.com/group/Ralph-HZ/

[pogowolf]

Almost current list of updates:

1/11/05
* Added Support for Tracking your spell misses.
* Added Support for tracking MOB Self-Heals
* Added Support for tracking Your Self-Heals.
* Database updates to YourSpells, and MobSpells tables to support the changes above.

1/10/05
* Modified Spell casting checks to check the MobList also.
* Added Support for You Casting Spells on another Player.
* Added Support for You Casting Spells on a MOB.
* Added Support for You PreCasting Spells on a MOB.
* Added Parse support for MOB precasting.
* added Parse support for pulling YOUR precasting, Casting, and Spell Fade for BUFFS.
* 2 new DB tables, YourSpells and MobSpells
* Fixed a NASTY string bug for single quotes in special name (spell) saving.
* Fixed Error in YourAttackDamage sub.
* Fixed Error in MOB misses Query
* Moved Fade check from Combat to Spell control
* Added Support for Abilitys and Ability fades

1/05/05
* System now Dumps unparsed logs entries to a text file in the app. root folder.
* Removed the SPLASH Screen, and recreated the version info.
* added Version info to the main menu.
* added code to turn off all controls before select a menu option
* added Configuration to menu
* Added tabbing system to the Config area.
* added RALPH and HZ config tabs
* Added Move or Delete parsed log options.
* Added LOAD/SAVE of log options to the config.XML file.

12/01/04
* readded Config controls
* OverHauled the Source Code

11/16/04
* fixed error where as the log folder wasn't selected.

11/12/04
* added folderText, browse, progress lable,progress bar, and go button
* added Analys group
* added 'Analyse' and 'Config' to the Main group.
* Created 'Main' Group
* Added Slide Menu
* Created Main Form
* added Code to show the Version notes on the splash page.
* added Splash Form
* Added Forms Class to handle forms switching
* Rewriting Code from Scratch.

11/11/04
* Rewriting Code to take advantage of the new speed.
* rewrote parser... again... Speed is everything!
* fixed Bug in log dump (the <!-- --> issue)
* Added Support for the progress Bar.
* NOTE: Logs will have the pipe (|) removed.
* More Code function streamlining
* last Build number is now saved to the Config.
* Updated the system feeback when parseing.
* Streamlined the getting of the log code process.
* Updated Blacklist to allow for a given pattern match deletion.
* added the following line types to the blackList.
Range Errors:
* [10/23/04 00:31:02] Target is 72m out of range
* [10/23/04 02:13:08] Vault Keeper out of range.

Groups/Channels:
* [10/23/04 00:05:42] You have joined the *channel* chat channel.
* [10/23/04 00:10:57] You have joined the group.
* [10/23/04 03:28:58] You have left the group.
* [10/23/04 03:29:05] *friend* has been promoted to a group leader.
* [10/23/04 00:05:52] You have been promoted to administrator of *channel*.
* [10/23/04 00:05:52] *Toon* has achieved level *level* in the *school* school

Friends:
* [10/23/04 00:08:33] *friend* has logged out.
* [10/23/04 00:11:16] *friend* has logged in.

Other Misc:
* [10/23/04 00:05:10] Message of the day: *Message*


11/10/04
* Added the 'blacklist' functionality
* Moved all functions for the handling the logs into their own class
* Streamlined the Parse Code

11/09/04
* Added Code to get the Start and End times of the logs.
* Added code to use the GDI+ to help 'flash' out the graphics
(then commented out.. not time to play with this yet)


11/08/04
* Started Basic support for the Progress Bar.
* ALL Chat Channel logs are parsed, and written to log files.
(and currently, nothing else is done with them.
* Switched normal pattern for the Date/Time stamp to hold the whole date/time
* Created Public temp strings to hold the log files


11/05/04
* Dings are now Parsed from the logs and Inserted into the database
*Date/Time parser now returns Date and Time in 'normal' formats
* Fixed Shard assocation to Toon name.

11/04/04
* now Dumping ToonName into the database. (Only Once ;)
* database Connection, and Functions have been created.
* Toon Name, ShardName, and Build numbers are beign returned from the log
* Specific data is now being returned by the parse routie.
if there's more then one parameter in the search pattern
all results are returned seperated by a pipe ("|")

11/03/04
* Pulling Toon Name from Debug Log File
* Started Parse Class
* Fixed XML Config Parse Bug.

11/02/04
* Created Configuration File (XML format)
* Filled Class table with ALL known playable Class names
* Updated Database with Toon, Shard, and class tables.
* Created Database
* Created way to select Log Folder
* Started on Tab interface
* Started Outlook like Menu
* Created Main Window
* Started the Install Script
* Version Notes show up in version Window
* Created VersionNotes
* Created Splash Page

[pogowolf]

Even more updates... =)


1/24/05
* and more bugfixes.. ;)
* added code to dump unused list into the 'Unused' folder, under app. root.
* Converted GetToonID into an ArrayList like everything else.
* Updated some older code not to hit the DB everytime the ToonID is needed.
* Converted the NPC handler to an Arraylist.
* Converted the Quest Handler to an arraylist.
* Updated Chatlog printer to place logs under the Toon names folder.
* Updated 'You have gained XP' pattern to correct an error.
* Updated 'You have created' pattern to correct an error.
* updated list tables to not allow Dup records.
* more Bug fixes.

1/20/05
* more Bug fixes.

1/19/05
* more Bug fixes.
* Finshed Combining the patterns.

1/17/05
* more fixes to logic.
* Complete re-write of Pattern and DB saving.
* and more changes in code to try to speed things up.

1/14/05
* Bug Fixes.
* Moved Combat parse back to the primary prase area
* Finished updateing ALL data handling features.

1/13/05
* Changed the way SpecialIDs are found based on the Special Name to cut down DB hits.
* Changed the way MobID are found based on the Mob Name to cut down DB hits.
* Changed the way ClassID are found based on the Class Name to cut down DB hits.
* Massive Code changes to FIX change of Data Structer... =/ (Working...)
* Massive updates to the data structer in the database.
* Updated Code to store the ToonID in code, and not read from the DB everytime it's needed.

1/12/05
* Changed the way the system gets the ToonID.. System has been spead up.
* Updated Time length to Show the total time (can be parsed for time for EACH log file)
* Added runtime length to each Log being Parsed (for testing).
* Created Function to return the difference in two dateTime stamps.
* made it more apparent which log file holds unused inforamtion, in the unused.txt
* Bug Fixes
* Added Support for Quests.
* Created Quest Table
* Added Support to Track gained Abilitys
* Added Support to track Scribed forms
* Added KB Table to track new Abilitys and Froms scribed.
* Added Support for Death by MOB
* Added Support for death by Drowning
* Added the death table.
* Added Support for YOUR items bought from a conny by someone else.
* Added Get NPCID function
* Added Support for Received goods
* Added Support for Salvaged resources
* Added Support for Created resources.
* Added Support for Bonus Gathered resources.
* Added Support for Gathered resources.
* Created Sales Table
* Created Crafting Table
* Created NPC table
* Added Support to track group bonus XP
* Added Support to track level gains.
* Added Support for Quest XP

[pogowolf]

2/04/05
+ BlackListed: [01/22/05 23:56:15] Foxfire -> Platinum Boulder Golem
+ Added Support for Toon/Mob Melee Misses (Simple)
+ FINISHED Fixing the simple melee hits pattern.. =)


2/03/05
+ Fixed error in Simple Melee Hits Pattern.
+ Fixed a possible error in the dataLists if they tried to populate with no data from the database.
+ Updated Simple mode again.. perhaps for the last time?

2/02/05
+ Moved Combat control information to another mod.
+ moved Black list to the END of the run (speedup)
- Not Dumping into database correctly.
+ Support for: [01/22/05 20:45:33] Foxfire -> Platinum Golem [ 174 ]

1/28/05
* Fixed some minor bugs in the Reporting system.. some players will work, some won't.
* Fixed bug that was allowing the same toonName in the toonTable.
* Removeing all data from the database will now auto-compact it also.
* Updated how your ToonName and ShardName are received and inserted into the DB. (Speed fix)
* Fixed Error that was causing an Endless loop.
* Fixed Error that was causing Special names to go into the mob table.
* Added 'are you sure?' to the delete all records
* Added Code to allow for the deletion of all data from the DB
* Added new menu item 'Delete all Data from DB'
* Added new Group in Menu for 'Database utils'
* commented out other parseing areas.. Ralph is Combat only at the moment.

1/26/05
* added a couple more 'do events' to help keep the system 'running'
* Found another bug (and fixed it) that was causeing a badly formated date/time stamp if there was NO 'shutting down...' AND NO log.. (just the opening Log)
* Converted databased to Access 2002-2003 format.
* If no data has been returned from the parse engine, just move on.
* Code Clean up. (removed old commented functions no longer used)
* Updated Parse Function to use complied regular expression Patterns.
* Updated code to use the funcion below.
* Created Function to TRIM, and Remove Carrage Returns, and Line feeds from the Datalists. (Thanks FoxFire)

1/24/05
* ! Right now the system is taking about 1 minunte per meg of log(s) to run.
that's still a little too slow in my book...
* Fixed error in 'GetLastLine' that could have caused a program failure by returning a mis-formatted time stamp.
* Added Support for Group + Multi combat XP - Entries like:
[01/18/05 20:55:00] Gained Dragon experience: 608 ( 169 from group bonus ) ( 17 from multiple enemy bonus )
* Blacklisted Log entries:
Jasper Golem misses Corelleon.
bossam misses Enduring Fyakki with Prime Bolt III.
You cannot receive experience for deconstructiong Granite Clay Scoop while in your current school because it does not teach the skill(s) to do so.
Please wait a few seconds before crafting again
Target is dead
[01/21/05 23:24:07] Too few parameters. Usage: tell <player name> <message>
[01/21/05 22:14:50] Target invalid for Healing.
* Fixed 'Target is dead' BlackList Pattern.
* Fixed Bug in XP data sender.
* Added code to dump unused list into the 'Unused' folder, under app. root.
* Converted GetToonID into an ArrayList like everything else.
* Updated some older code not to hit the DB everytime the ToonID is needed.
* Converted the NPC handler to an Arraylist.
* Converted the Quest Handler to an arraylist.
* Updated Chatlog printer to place logs under the Toon names folder.
* Updated 'You have gained XP' pattern to correct an error.
* Updated 'You have created' pattern to correct an error.
* updated list tables to not allow Dup records.
* more Bug fixes.

[Guaran]

Pogo what about differences when someone has simple combat feedback enabled versus the normal feedback? That is assuming that you use the chat log (only one I've ever poked into that much)

Guaran

[pogowolf]

Pogo what about differences when someone has simple combat feedback enabled versus the normal feedback? That is assuming that you use the chat log (only one I've ever poked into that much)

Guaran

Well the Easyst example would be combat.
under the 'normal' logs combat information looks like this:

[10/28/04 17:34:48] You begin casting Improved Spirit Bolt IV at Flame Wolf.
[10/28/04 17:34:48] Flame Wolf misses you.
[10/28/04 17:34:49] You hit Flame Wolf with Ethereal Leech IV for 41 damage.
[10/28/04 17:34:50] You begin casting Improved Spirit Bolt IV at Flame Wolf.
[10/28/04 17:34:51] Flame Wolf hits you for 116 damage.
[10/28/04 17:34:53] You hit Flame Wolf with Improved Spirit Bolt IV for 131 damage.
[10/28/04 17:34:54] Your Improved Spirit Bolt IV at Flame Wolf has missed.
[10/28/04 17:34:54] Flame Wolf misses you.

For SIMPLE mode, combat looks like this:
[01/22/05 20:45:33] Foxfire -> Platinum Golem [ 172 ]
[01/22/05 20:45:33] Foxfire -> Platinum Golem [ 174 ]
01/22/05 20:45:34] Foxfire -> Platinum Golem : Flame Spear IV [ 214 ]
[01/22/05 20:45:34] Foxfire -> Platinum Golem : Flame Spear IV [ 222 ]
[01/22/05 20:45:34] Foxfire -> Platinum Golem : Flame Spear IV [ 218 ]
[01/22/05 20:45:34] Platinum Golem -> Foxfire : Avalanche of Ore II [ 118 ]
[01/22/05 20:45:34] Platinum Golem -> Foxfire : Avalanche of Ore II [ 117 ]
[01/22/05 20:45:34] Platinum Golem -> Foxfire : Avalanche of Ore II [ 120 ]
[01/22/05 20:45:36] Foxfire -> Platinum Golem : Binding Crystals IV [ 132 ]

Normal mode is easier to read (to me at least).. it's still the same data, just
not as 'wordy' which can speed up the game by a few frames...

Also a major difference.. SIMPLE mode gives you feedback on your Parrys and Blocks.. Normal mode does not.