[Player Event Logs] Migrate and Deprecate QS Legacy Logging (#4542)

* First pass of player_event_loot_items

* Second pass of player_event_loot_items

* Third pass of player_event_loot_items

* Example without RecordDetailEvent template

* Cleanup the removal of the template

* Fourth Pass

Add retention for etl tables
Rename tables/fields to etl nomenclature
Combine database work to one atomic load

* Reposition to reduce db tasks

* Refactor etl processing for easier additions

* Add merchant purchase event
testing passed though appears that the event itself has a few bugs.  Will fix them in another commit

* Fix PlayerEventMerchantPurchase in client_packet.cpp

* WIP - Handin

* Handin Event added

* Cleanup

* All a rentention period of 0 days which deletes all current records.

* Updates

Cleanup and refactor a few items.

* Cleanup and Formatting

Cleanup and Formatting

* Add etl for
Playerevent::Trade
PlayerEvent::Speech (new event to mirror functionality of qs_speech

* Add etl for
Playerevent::KilledNPC, KilledNamedNPC and KilledRaidNPC

* Add etl for Playerevent::AA_purchase

Add etl for Playerevent::AA_purchase

* Cleanup before PR

* Review comment updates.

* Add world cli etl:settings to output a json on all player event details.

* Add reserve for all etl_queues
Correct a failed test case for improper next id for etl tables when table is first created.

* Potential solution for a dedicated database connection for player events.

* Simple thread for player_events.  Likely there is a better way to do this.

* Add zone to qs communications for recordplayerevents

First pass of enabling zone to qs direct transport to allow for PlayerEvents to bypass world.

* Cleanup a linux compile issue

* Add augments to LOOT ITEM and DESTROY ITEM

* Add augments to ITEMCREATION, FORAGESUCCESS, FISHSUCCESS, DESTROYITEM, LOOTITEM, DROPPEDITEM, TRADERPURCHASE, TRADERSELL, GUILDTRIBUTEDONATE and cleaned up the naming convention of augments

* Formatting fixes

* Swap out GetNextTableId

* Statically load counter

* Add counter.clear() since the counter is static

* Upload optional QS conversion scripts

* Remove all qs_tables and code referencing them

* Update database.cpp

* Simplify ProcessBatchQueue

* Simplify PorcessBatchQueue

* Simplify event truncation

* Build event truncation to bulk query by retention groups

* Post rebase

* Update player_events.h

* Fix build

* Update npc.cpp

* First pass of direct zone to qs sending for player events

* Remove keepalive logic

* Fix event ordering

* Cleanup

* Update player_event_logs.cpp

* Wipe event data after ETL processed

* Split up database connections, hot reload logs for QS

* Load rules from database vs qs_database

* Update player_event_logs.cpp

* Hot toggle queryserv connect

---------

Co-authored-by: Akkadius <akkadius1@gmail.com>

utils/sql/svn/2268_QueryServ.sql

@@ -1,22 +0,0 @@
-SET FOREIGN_KEY_CHECKS=0;
--- ----------------------------
--- Table structure for `qs_player_npc_kill_record`
--- ----------------------------
-DROP TABLE IF EXISTS `qs_player_npc_kill_record`;
-CREATE TABLE `qs_player_npc_kill_record` (
-  `fight_id` int(11) NOT NULL AUTO_INCREMENT,
-  `npc_id` int(11) DEFAULT NULL,
-  `type` int(11) DEFAULT NULL,
-  `zone_id` int(11) DEFAULT NULL,
-  `time` timestamp NULL DEFAULT NULL ON UPDATE CURRENT_TIMESTAMP,
-  PRIMARY KEY (`fight_id`)
-) ENGINE=InnoDB AUTO_INCREMENT=67 DEFAULT CHARSET=utf8;
-
--- ----------------------------
--- Table structure for `qs_player_npc_kill_record_entries`
--- ----------------------------
-DROP TABLE IF EXISTS `qs_player_npc_kill_record_entries`;
-CREATE TABLE `qs_player_npc_kill_record_entries` (
-  `event_id` int(11) DEFAULT '0',
-  `char_id` int(11) DEFAULT '0'
-) ENGINE=InnoDB DEFAULT CHARSET=utf8;

utils/sql/svn/2304_QueryServ.sql

@@ -1,41 +0,0 @@
-SET FOREIGN_KEY_CHECKS=0;
--- ----------------------------
--- Table structure for `qs_player_npc_kill_record`
--- ----------------------------
-DROP TABLE IF EXISTS `qs_player_trade_record`;
-CREATE TABLE `qs_player_trade_record` (
-  `trade_id` int(11) NOT NULL AUTO_INCREMENT,
-  `time` timestamp NULL DEFAULT NULL ON UPDATE CURRENT_TIMESTAMP,
-  `char1_id` int(11) DEFAULT '0',
-  `char1_pp` int(11) DEFAULT '0',
-  `char1_gp` int(11) DEFAULT '0',
-  `char1_sp` int(11) DEFAULT '0',
-  `char1_cp` int(11) DEFAULT '0',
-  `char1_items` mediumint(7) DEFAULT '0',
-  `char2_id` int(11) DEFAULT '0',
-  `char2_pp` int(11) DEFAULT '0',
-  `char2_gp` int(11) DEFAULT '0',
-  `char2_sp` int(11) DEFAULT '0',
-  `char2_cp` int(11) DEFAULT '0',
-  `char2_items` mediumint(7) DEFAULT '0',
-  PRIMARY KEY (`trade_id`)
-) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=utf8;
-
--- ----------------------------
--- Table structure for `qs_player_npc_kill_record_entries`
--- ----------------------------
-DROP TABLE IF EXISTS `qs_player_trade_record_entries`;
-CREATE TABLE `qs_player_trade_record_entries` (
-  `event_id` int(11) DEFAULT '0',
-  `from_id` int(11) DEFAULT '0',
-  `from_slot` mediumint(7) DEFAULT '0',
-  `to_id` int(11) DEFAULT '0',
-  `to_slot` mediumint(7) DEFAULT '0',
-  `item_id` int(11) DEFAULT '0',
-  `charges` mediumint(7) DEFAULT '0',
-  `aug_1` int(11) DEFAULT '0',
-  `aug_2` int(11) DEFAULT '0',
-  `aug_3` int(11) DEFAULT '0',
-  `aug_4` int(11) DEFAULT '0',
-  `aug_5` int(11) DEFAULT '0'
-) ENGINE=InnoDB DEFAULT CHARSET=utf8;

utils/sql/svn/2361_QueryServ.sql

@@ -1,141 +0,0 @@
-SET FOREIGN_KEY_CHECKS=0;
--- ----------------------------
--- Table structure for `qs_merchant_transaction_record`
--- ----------------------------
-DROP TABLE IF EXISTS `qs_merchant_transaction_record`;
-CREATE TABLE `qs_merchant_transaction_record` (
-  `transaction_id` int(11) NOT NULL AUTO_INCREMENT,
-  `time` timestamp NULL DEFAULT NULL ON UPDATE CURRENT_TIMESTAMP,
-  `zone_id` int(11) DEFAULT '0',
-  `merchant_id` int(11) DEFAULT '0',
-  `merchant_pp` int(11) DEFAULT '0',
-  `merchant_gp` int(11) DEFAULT '0',
-  `merchant_sp` int(11) DEFAULT '0',
-  `merchant_cp` int(11) DEFAULT '0',
-  `merchant_items` mediumint(7) DEFAULT '0',
-  `char_id` int(11) DEFAULT '0',
-  `char_pp` int(11) DEFAULT '0',
-  `char_gp` int(11) DEFAULT '0',
-  `char_sp` int(11) DEFAULT '0',
-  `char_cp` int(11) DEFAULT '0',
-  `char_items` mediumint(7) DEFAULT '0',
-  PRIMARY KEY (`transaction_id`)
-) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=utf8;
-
--- ----------------------------
--- Table structure for `qs_merchant_transaction_record_entries`
--- ----------------------------
-DROP TABLE IF EXISTS `qs_merchant_transaction_record_entries`;
-CREATE TABLE `qs_merchant_transaction_record_entries` (
-  `event_id` int(11) DEFAULT '0',
-  `char_slot` mediumint(7) DEFAULT '0',
-  `item_id` int(11) DEFAULT '0',
-  `charges` mediumint(7) DEFAULT '0',
-  `aug_1` int(11) DEFAULT '0',
-  `aug_2` int(11) DEFAULT '0',
-  `aug_3` int(11) DEFAULT '0',
-  `aug_4` int(11) DEFAULT '0',
-  `aug_5` int(11) DEFAULT '0'
-) ENGINE=InnoDB DEFAULT CHARSET=utf8;
-
--- ----------------------------
--- Table structure for `qs_player_delete_record`
--- ----------------------------
-DROP TABLE IF EXISTS `qs_player_delete_record`;
-CREATE TABLE `qs_player_delete_record` (
-  `delete_id` int(11) NOT NULL AUTO_INCREMENT,
-  `time` timestamp NULL DEFAULT NULL ON UPDATE CURRENT_TIMESTAMP,
-  `char_id` int(11) DEFAULT '0',
-  `stack_size` mediumint(7) DEFAULT '0',
-  `char_items` mediumint(7) DEFAULT '0',
-  PRIMARY KEY (`delete_id`)
-) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=utf8;
-
--- ----------------------------
--- Table structure for `qs_player_delete_record_entries`
--- ----------------------------
-DROP TABLE IF EXISTS `qs_player_delete_record_entries`;
-CREATE TABLE `qs_player_delete_record_entries` (
-  `event_id` int(11) DEFAULT '0',
-  `char_slot` mediumint(7) DEFAULT '0',
-  `item_id` int(11) DEFAULT '0',
-  `charges` mediumint(7) DEFAULT '0',
-  `aug_1` int(11) DEFAULT '0',
-  `aug_2` int(11) DEFAULT '0',
-  `aug_3` int(11) DEFAULT '0',
-  `aug_4` int(11) DEFAULT '0',
-  `aug_5` int(11) DEFAULT '0'
-) ENGINE=InnoDB DEFAULT CHARSET=utf8;
-
--- ----------------------------
--- Table structure for `qs_player_handin_record`
--- ----------------------------
-DROP TABLE IF EXISTS `qs_player_handin_record`;
-CREATE TABLE `qs_player_handin_record` (
-  `handin_id` int(11) NOT NULL AUTO_INCREMENT,
-  `time` timestamp NULL DEFAULT NULL ON UPDATE CURRENT_TIMESTAMP,
-  `quest_id` int(11) DEFAULT '0',
-  `char_id` int(11) DEFAULT '0',
-  `char_pp` int(11) DEFAULT '0',
-  `char_gp` int(11) DEFAULT '0',
-  `char_sp` int(11) DEFAULT '0',
-  `char_cp` int(11) DEFAULT '0',
-  `char_items` mediumint(7) DEFAULT '0',
-  `npc_id` int(11) DEFAULT '0',
-  `npc_pp` int(11) DEFAULT '0',
-  `npc_gp` int(11) DEFAULT '0',
-  `npc_sp` int(11) DEFAULT '0',
-  `npc_cp` int(11) DEFAULT '0',
-  `npc_items` mediumint(7) DEFAULT '0',
-  PRIMARY KEY (`handin_id`)
-) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=utf8;
-
--- ----------------------------
--- Table structure for `qs_player_handin_record_entries`
--- ----------------------------
-DROP TABLE IF EXISTS `qs_player_handin_record_entries`;
-CREATE TABLE `qs_player_handin_record_entries` (
-  `event_id` int(11) DEFAULT '0',
-  `action_type` char(6) Default 'action',
-  `char_slot` mediumint(7) DEFAULT '0',
-  `item_id` int(11) DEFAULT '0',
-  `charges` mediumint(7) DEFAULT '0',
-  `aug_1` int(11) DEFAULT '0',
-  `aug_2` int(11) DEFAULT '0',
-  `aug_3` int(11) DEFAULT '0',
-  `aug_4` int(11) DEFAULT '0',
-  `aug_5` int(11) DEFAULT '0'
-) ENGINE=InnoDB DEFAULT CHARSET=utf8;
-
--- ----------------------------
--- Table structure for `qs_player_move_record`
--- ----------------------------
-DROP TABLE IF EXISTS `qs_player_move_record`;
-CREATE TABLE `qs_player_move_record` (
-  `move_id` int(11) NOT NULL AUTO_INCREMENT,
-  `time` timestamp NULL DEFAULT NULL ON UPDATE CURRENT_TIMESTAMP,
-  `char_id` int(11) DEFAULT '0',
-  `from_slot` mediumint(7) DEFAULT '0',
-  `to_slot` mediumint(7) DEFAULT '0',
-  `stack_size` mediumint(7) DEFAULT '0',
-  `char_items` mediumint(7) DEFAULT '0',
-  `postaction` tinyint(1) DEFAULT '0',
-  PRIMARY KEY (`move_id`)
-) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=utf8;
-
--- ----------------------------
--- Table structure for `qs_player_move_record_entries`
--- ----------------------------
-DROP TABLE IF EXISTS `qs_player_move_record_entries`;
-CREATE TABLE `qs_player_move_record_entries` (
-  `event_id` int(11) DEFAULT '0',
-  `from_slot` mediumint(7) DEFAULT '0',
-  `to_slot`  mediumint(7) DEFAULT '0',
-  `item_id` int(11) DEFAULT '0',
-  `charges` mediumint(7) DEFAULT '0',
-  `aug_1` int(11) DEFAULT '0',
-  `aug_2` int(11) DEFAULT '0',
-  `aug_3` int(11) DEFAULT '0',
-  `aug_4` int(11) DEFAULT '0',
-  `aug_5` int(11) DEFAULT '0'
-) ENGINE=InnoDB DEFAULT CHARSET=utf8;