<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <title>Aura – aura-analytics</title>
    <link>/tags/aura-analytics/</link>
    <description>Recent content in aura-analytics on Aura</description>
    <generator>Hugo -- gohugo.io</generator>
    <language>en</language>
    
	  <atom:link href="/tags/aura-analytics/index.xml" rel="self" type="application/rss+xml" />
    
    
      
        
      
    
    
    <item>
      <title>Docs: </title>
      <link>/docs/developers-workspace/monitoring/active-listening/</link>
      <pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate>
      
      <guid>/docs/developers-workspace/monitoring/active-listening/</guid>
      <description>
        
        
        &lt;h1 id=&#34;aura-analytics-200&#34;&gt;Aura Analytics 2.0.0&lt;/h1&gt;


&lt;div class=&#34;pageinfo pageinfo-primary&#34;&gt;
&lt;p&gt;Description of &lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt;, the monitoring tool designed and managed by &lt;em&gt;&lt;strong&gt;Aura Global Team&lt;/strong&gt;&lt;/em&gt; that allows &lt;strong&gt;active listening&lt;/strong&gt; in Aura&lt;/p&gt;

&lt;/div&gt;

&lt;h2 id=&#34;what-is-aura-analytics-200&#34;&gt;What is Aura Analytics 2.0.0?&lt;/h2&gt;
&lt;p&gt;&lt;strong&gt;Active listening&lt;/strong&gt; is defined as a key process that involves a &lt;strong&gt;continuous monitoring of Aura performance based on real logs from the users&lt;/strong&gt; to analyze them and gather insights on the efficiency and effectiveness of Aura as a system and also to track the interaction of our users with Aura.&lt;/p&gt;
&lt;p&gt;In this framework, &lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt; is a tool used by &lt;strong&gt;Aura Global Team&lt;/strong&gt; that uses &lt;strong&gt;active listening&lt;/strong&gt; with the ultimate goal of &lt;strong&gt;improving Aura quality&lt;/strong&gt;, as it generates accurate information to carry out both &lt;strong&gt;corrective and predictive actions&lt;/strong&gt; and to decide &lt;strong&gt;how Aura should evolve in the future&lt;/strong&gt;.&lt;/p&gt;
&lt;h2 id=&#34;how-does-aura-analytics-200-work&#34;&gt;How does Aura Analytics 2.0.0 work?&lt;/h2&gt;
&lt;ul&gt;
&lt;li&gt;
&lt;p&gt;The process is built upon Aura users logs generated in production environment&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;From these logs, &lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt; create &lt;em&gt;PPDs (Privacy-Preserving Datasets)&lt;/em&gt;&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;Datasets are processed, enabling the visualization through dashboards and the extraction of statistical insights&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;The Aura Global Team consumes this data to support decision-making processes&lt;/p&gt;
&lt;/li&gt;
&lt;/ul&gt;
&lt;h2 id=&#34;target-users&#34;&gt;Target users&lt;/h2&gt;
&lt;ul&gt;
&lt;li&gt;
&lt;p&gt;The &lt;em&gt;&lt;strong&gt;Aura Global Team&lt;/strong&gt;&lt;/em&gt; is the target user of the &lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt; tool, responsible for its design and management as well as for the interpretation of results for decision-making.&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;OBs&lt;/strong&gt; should allow the generation of datasets from their Aura users logs in their local environment just by installing and executing a single process, as shown in the document &lt;a href=&#34;../../docs/developers-workspace/monitoring/active-listening/guidelines-obs/&#34;&gt;Guidelines for OBs&lt;/a&gt;.&lt;/p&gt;
&lt;/li&gt;
&lt;/ul&gt;
&lt;h2 id=&#34;index-of-documents&#34;&gt;Index of documents&lt;/h2&gt;
&lt;p&gt;&lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt; includes the following documents:&lt;/p&gt;
&lt;!-- no toc --&gt;
&lt;ul&gt;
&lt;li&gt;&lt;a href=&#34;#aura-analytics-versions&#34;&gt;&lt;strong&gt;Version history&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;../../docs/developers-workspace/monitoring/active-listening/architecture&#34;&gt;&lt;strong&gt;Architecture overview and main processes and components&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;../../docs/developers-workspace/monitoring/active-listening/operation&#34;&gt;&lt;strong&gt;Internal operation&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;../../docs/developers-workspace/monitoring/active-listening/guidelines-obs&#34;&gt;&lt;strong&gt;Guidelines for OBs&lt;/strong&gt;&lt;/a&gt; willing to consume data provided by &lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;../../docs/developers-workspace/monitoring/active-listening/analytics-dashboard&#34;&gt;&lt;strong&gt;Aura Analytics dashboard&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href=&#34;../../docs/developers-workspace/monitoring/active-listening/annex-dataset-fields-detail/&#34;&gt;&lt;strong&gt;Annex: Dataset fields&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt;
&lt;h2 id=&#34;aura-analytics-versions&#34;&gt;Aura Analytics versions&lt;/h2&gt;
&lt;h3 id=&#34;release-100&#34;&gt;Release 1.0.0&lt;/h3&gt;
&lt;p&gt;The first release 1.0.0. sets up the basic paths, deploys the PPD infrastructure and produce:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Version 1.0.0. of the OB Analytics system, which includes the OB Dashboard.&lt;/li&gt;
&lt;li&gt;The first version of pre-processed datasets (clean PPDs) for training and analytics at Aura Global.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;As mentioned, this version enables going further by:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;
&lt;p&gt;Enhancing the analytics dashboard with new visualizations.&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;Processing the PPD files as desired (they are standard CSV files, which can be ingested in alternative platforms if desired). Restrictions on them are softer than on the original logs due to the anonymization process they have been subjected to, although they are still subjected to management precautions (a code of conduct is being prepared for that).&lt;/p&gt;
&lt;/li&gt;
&lt;/ul&gt;
&lt;h3 id=&#34;release-110&#34;&gt;Release 1.1.0&lt;/h3&gt;
&lt;p&gt;Version 1.1.0. introduces the following changes:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;The table of data has been enlarged with these new fields: &lt;code&gt;AURA_ID&lt;/code&gt;, &lt;code&gt;STATUS_CD&lt;/code&gt;, &lt;code&gt;sesId&lt;/code&gt;, &lt;code&gt;sesSize&lt;/code&gt;, &lt;code&gt;sesDuration&lt;/code&gt;.&lt;/li&gt;
&lt;li&gt;An expanded list of test users is used, so that the &lt;code&gt;userType&lt;/code&gt; column contains more identifications.&lt;/li&gt;
&lt;li&gt;The code for data ingestion into a local Kibana, which previously consisted on a single Python script, has been turned into a full Python package to be installed, due to its increasing complexity.&lt;/li&gt;
&lt;/ul&gt;
&lt;h3 id=&#34;release-200&#34;&gt;Release 2.0.0&lt;/h3&gt;
&lt;p&gt;Version 2.0.0 introduces the following changes:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;In 2.0.0 version, &lt;strong&gt;Aura Analytics&lt;/strong&gt; has undergone a refactor to improve its structure and make it easier to understand, maintain and extend in the future.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt; simplifies the deployment and execution process.&lt;/li&gt;
&lt;li&gt;But one of the most significant enhancements in &lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt; is its capability to manage both processed and to-process files centrally in one place (database). &lt;/li&gt;
&lt;/ul&gt;
&lt;h2 id=&#34;prerequisites-and-recommended-tools&#34;&gt;Prerequisites and recommended tools&lt;/h2&gt;
&lt;p&gt;The prerequisites for the use of &lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt; are set below:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Recommended tool for data visualization: &lt;a href=&#34;https://www.elastic.co/es/elastic-stack/&#34;&gt;ELK stack&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt;

      </description>
    </item>
    
    <item>
      <title>Docs: </title>
      <link>/docs/developers-workspace/monitoring/active-listening/architecture/</link>
      <pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate>
      
      <guid>/docs/developers-workspace/monitoring/active-listening/architecture/</guid>
      <description>
        
        
        &lt;h1 id=&#34;aura-analytics-200-architecture&#34;&gt;Aura Analytics 2.0.0. architecture&lt;/h1&gt;


&lt;div class=&#34;pageinfo pageinfo-primary&#34;&gt;
&lt;p&gt;Technical architecture of &lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt; and description of main processes and components&lt;/p&gt;

&lt;/div&gt;

&lt;h2 id=&#34;architecture-overview&#34;&gt;Architecture overview&lt;/h2&gt;
&lt;p&gt;&lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt; contains two different environments:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;OB local environment&lt;/strong&gt;: Processes in this side are managed by the OB, that should install and execute certain processes related to the PPD-Creator for the creation of raw datasets.&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;Global environment&lt;/strong&gt;: Processes here are managed by Aura Global Team for data recovery, processing and generation of dashboards and statistics. The output includes data and metrics to be consumed by Aura Global Team for decision-making.&lt;/p&gt;
&lt;/li&gt;
&lt;/ul&gt;
&lt;h3 id=&#34;aura-analytics-200-architecture-flowchart&#34;&gt;Aura Analytics 2.0.0 architecture flowchart&lt;/h3&gt;
&lt;p&gt;The following diagram shows an overview of &lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt; architecture, including the environments involved and the main components and processes, which are fully described in succeeding sections.&lt;/p&gt;
&lt;p&gt;&lt;img src=&#34;../../images/active-listening/architecture.png&#34; alt=&#34;Architecture flowchart&#34;&gt;
&lt;i&gt;Figure 1. Aura Analytics 2.0.0 Architecture flowchart&lt;/i&gt;&lt;/p&gt;
&lt;h2 id=&#34;aura-analytics-200-processes&#34;&gt;Aura Analytics 2.0.0 processes&lt;/h2&gt;
&lt;h3 id=&#34;ppd-creator-process&#34;&gt;PPD-Creator process&lt;/h3&gt;
&lt;p&gt;The PPD-Creator is a Python module for the creation of PPD-Raw datasets.&lt;/p&gt;
&lt;p&gt;It is the only component that belongs to the OB environment. The OB should install it and is responsible for its execution. The PPD-Raw datasets will be stored in the destination blob &lt;code&gt;PPD-RAW&lt;/code&gt;.&lt;/p&gt;
&lt;p&gt;This process reads the files included in &lt;code&gt;OB MANAGED INSTANCES&lt;/code&gt; columns of the tables in &lt;a href=&#34;../../docs/developers-workspace/monitoring/active-listening/annex-dataset-fields-detail/&#34;&gt;Annex: Dataset fields&lt;/a&gt;. The result of this process is the &lt;code&gt;PPD RAW&lt;/code&gt; columns of the tables in the above-mentioned annex.&lt;/p&gt;
&lt;p&gt;The main tasks executed by the PPD-Creator are summarized below:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Reads the Aura log files in a &lt;strong&gt;Kernel&lt;/strong&gt; Blob.&lt;/li&gt;
&lt;li&gt;Anonymize the sensible fields (&lt;code&gt;AuraID&lt;/code&gt;, &lt;code&gt;AuraGlobalID&lt;/code&gt;, and personal information of user sentence such as DNI, phone numbers, etc).&lt;/li&gt;
&lt;li&gt;Save the anonymized files to another directory of blob (PPD-Raw).&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;&lt;img src=&#34;../../images/active-listening/ppd-creator.png&#34; alt=&#34;PPD-Creator process&#34;&gt;
&lt;i&gt;Figure 2. PPD-Creator process&lt;/i&gt;&lt;/p&gt;
&lt;p&gt;The PPD-Creator anonymizes the following data, in the different OBs:&lt;/p&gt;
&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;&lt;strong&gt;ES&lt;/strong&gt;&lt;/th&gt;
&lt;th&gt;&lt;strong&gt;UK&lt;/strong&gt;&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;dni&lt;/td&gt;
&lt;td&gt;creditcard&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;nie&lt;/td&gt;
&lt;td&gt;insurance&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;phone&lt;/td&gt;
&lt;td&gt;postcode&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;email&lt;/td&gt;
&lt;td&gt;imei&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;phone&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;imsi&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;email&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;twitter&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;passport&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;
&lt;h3 id=&#34;manage-ppd-raw-process&#34;&gt;Manage PPD-Raw process&lt;/h3&gt;
&lt;p&gt;The Manage PPD-Raw process inserts the &lt;code&gt;PPD-Raw&lt;/code&gt; path files (output from PPD-Creator) to PostgreSQL table for files management data centric:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;It reads the output of PPD-Creator JSON file&lt;/li&gt;
&lt;li&gt;Afterwards, it saves the paths to PostgreSQL server&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;&lt;img src=&#34;../../images/active-listening/manage-ppd-raw.png&#34; alt=&#34;Manage PPD-Raw process&#34;&gt;
&lt;i&gt;Figure 3. Manage PPD-Raw process&lt;/i&gt;&lt;/p&gt;
&lt;h3 id=&#34;ppd-clean-process&#34;&gt;PPD-Clean process&lt;/h3&gt;
&lt;p&gt;The PPD-Clean is a Python package used to clean PPD-Raw datasets.&lt;/p&gt;
&lt;p&gt;Firstly, this process locates the directory where the &lt;code&gt;PPD-Raw&lt;/code&gt; files are located, reads the corresponding files and processes them.&lt;/p&gt;
&lt;p&gt;Once the process is finished, it writes to the &lt;code&gt;files_processed&lt;/code&gt; table in the database and saves them in the PPD-Clean directory.&lt;/p&gt;
&lt;p&gt;The main tasks executed by the PPD-Clean are summarized below:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Apply transformations to columns&lt;/li&gt;
&lt;li&gt;Extract the explicit frustration&lt;/li&gt;
&lt;li&gt;Calculates the Nones n-grams&lt;/li&gt;
&lt;li&gt;Save the data in Directory or blob, PostgreSQL server and ElasticSearch for visualization&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;&lt;img src=&#34;../../images/active-listening/ppd-cleaner.png&#34; alt=&#34;PPD-Clean process&#34;&gt;
&lt;i&gt;Figure 4. PPD-Clean process&lt;/i&gt;&lt;/p&gt;
&lt;h3 id=&#34;user-dynamics-process&#34;&gt;User Dynamics process&lt;/h3&gt;
&lt;p&gt;User dynamics is a script used to measure the user’s behavior through metrics. It extracts statistics on the recurrence of users in Aura in a monthly basis.&lt;/p&gt;
&lt;p&gt;The processes executed are summarized below:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;User dynamics reads the &lt;code&gt;file_processed&lt;/code&gt; table of the database and the all &lt;code&gt;PPD-Clean&lt;/code&gt; files stored for 1 month.&lt;/li&gt;
&lt;li&gt;It extracts metrics regarding new users, recurrent users, lost users and recovered users.&lt;/li&gt;
&lt;li&gt;Afterwards, it saves these metrics in the &lt;code&gt;User_dynamics&lt;/code&gt; schema, in a PostgreSQL database, within the tables &lt;code&gt;connections&lt;/code&gt;, &lt;code&gt;daycount&lt;/code&gt;, &lt;code&gt;user&lt;/code&gt; and &lt;code&gt;channel&lt;/code&gt;.&lt;/li&gt;
&lt;li&gt;Data is also saved in ElasticSearch.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;&lt;img src=&#34;../../images/active-listening/user-dynamics.png&#34; alt=&#34;User Dynamics process&#34;&gt;
&lt;i&gt;Figure 5. User Dynamics process&lt;/i&gt;&lt;/p&gt;
&lt;h2 id=&#34;components&#34;&gt;Components&lt;/h2&gt;
&lt;h3 id=&#34;active-listening-database&#34;&gt;Active Listening Database&lt;/h3&gt;
&lt;p&gt;The Active Listening Database is a PostgreSQL database that stores the processed and to-process files centrally in one place. It is used by the PPD-Clean and User Dynamics processes to store the processed data and metrics.&lt;/p&gt;
&lt;h4 id=&#34;schema-files-management&#34;&gt;Schema files management&lt;/h4&gt;
&lt;p&gt;Currently, in the Active Listening project, we have input and output files for each of the processes and files that are processed. With the proposed database solution through the files management database, a more efficient management of raw files is achieved:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;The PPD-Creator process transfers files from the OB to a shared blob.&lt;/li&gt;
&lt;li&gt;The transferred files are written to a file in that blob called &lt;code&gt;aura-sync-cache-dst.json&lt;/code&gt;.&lt;/li&gt;
&lt;li&gt;The &lt;strong&gt;manage_ppd_raw&lt;/strong&gt; process will read the &lt;code&gt;aura-sync-cache-dst.json&lt;/code&gt; file from the PPD-Raw folder and ingest the records into the &lt;code&gt;FILE_PPD_RAW&lt;/code&gt; table of the database.&lt;/li&gt;
&lt;li&gt;It will also insert into the &lt;code&gt;EMPTY_DATA_FILES&lt;/code&gt; table the days that are not found in the JSON file. This table is necessary for logging metrics in Prometheus. This process will run daily.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;&lt;img src=&#34;../../images/active-listening/files-management-db.png&#34; alt=&#34;files management db&#34;&gt;
&lt;i&gt;Figure 6. Files management database&lt;/i&gt;&lt;/p&gt;
&lt;h4 id=&#34;schema-user-dynamics&#34;&gt;Schema user dynamics&lt;/h4&gt;
&lt;p&gt;The User Dynamics process generates the statistics of Aura users, number of daily active users and types of users, with 4 categories: new, recurring, lost and recovered.&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;The Channel table contains all the channels in Aura that have been processed by the User Dynamics process.&lt;/li&gt;
&lt;li&gt;The &lt;code&gt;User&lt;/code&gt; table contains the unique Aura users in each environment and country.&lt;/li&gt;
&lt;li&gt;The &lt;code&gt;Daycount&lt;/code&gt; table contains the number of total users for each day, indicating how many of them are new, recurring, recovered or lost users, the number of weekly unique recurring users and the number of monthly unique recurring users.&lt;/li&gt;
&lt;li&gt;The &lt;code&gt;Connection&lt;/code&gt; table has the status of the user for each day (whether it is new, recurring, lost or recovered).&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;&lt;img src=&#34;../../images/active-listening/user-dynamics-db.png&#34; alt=&#34;user dynamics db&#34;&gt;&lt;br&gt;
&lt;i&gt;Figure 7. User dynamics database&lt;/i&gt;&lt;/p&gt;
&lt;h3 id=&#34;aura-analytics-dashboard&#34;&gt;Aura Analytics Dashboard&lt;/h3&gt;
&lt;p&gt;&lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt; produces as a result, among other elements, an analytics component named &lt;strong&gt;Aura Analytics Dashboard&lt;/strong&gt; that is the one used by Aura Global Team to gather statistics on the production system and to analyze user&amp;rsquo;s behavior.&lt;/p&gt;
&lt;p&gt;This Analytics Dashboard is based on the &lt;a href=&#34;https://www.elastic.co/what-is/elk-stack&#34;&gt;ELK stack&lt;/a&gt; that contains:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;ElasticSearch&lt;/strong&gt;: distributed search and analytics engine at the heart of the Elastic Stack. It allows the storage of data and its subsequent indexing, search and analysis.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Kibana&lt;/strong&gt;: provides a visualization tool that includes dashboards and panels created over the ElasticSearch data. Users interactively explore, visualize and share insights into data and manage and monitor the stack.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;Once installed:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;An ElasticSearch index is created. It is called &lt;code&gt;aura-ppd-ENTITY-COUNTRY-YEAR&lt;/code&gt;, and its index schema contains a cleaned version of the &lt;code&gt;AURA MESSAGE&lt;/code&gt;, &lt;code&gt;RECOGNIZER&lt;/code&gt; or &lt;code&gt;API&lt;/code&gt; tables (which registers input and output messages).&lt;/li&gt;
&lt;li&gt;A Kibana index pattern is created, matching the uploaded ElasticSearch index.&lt;/li&gt;
&lt;li&gt;A pre-defined set of visualizations are installed in Kibana over that index pattern, as a means to get a default peek on the index data. See the section &lt;a href=&#34;../../docs/developers-workspace/monitoring/active-listening/analytics-dashboard/#pre-installed-analytics-dashboard&#34;&gt;pre-installed analytics dashboard&lt;/a&gt;.&lt;/li&gt;
&lt;li&gt;The system automatically ingests any new clean PPD being produced in the ElasticSearch database, so that the index and dashboards remain up to date.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;In principle, the PPD creation process specifies daily production, since Aura logs are sent to &lt;strong&gt;Kernel&lt;/strong&gt; once a day. This means that information about Aura behavior and user actions on one given day will be available in the dashboards of the following day.&lt;/p&gt;
&lt;p&gt;&lt;i class=&#34;fa-solid fa-triangle-exclamation fa-xl&#34; style=&#34;color: #f45815;&#34;&gt;&lt;/i&gt; As mentioned above, &lt;strong&gt;the Aura Analytics Dashboard is conceived to be used by Aura Global Team&lt;/strong&gt;. However, OBs can install locally the ELK stack or any other visualization tool for data consumption. Access to the document &lt;a href=&#34;../../docs/developers-workspace/monitoring/active-listening/guidelines-obs/#local-data-visualization-optional&#34;&gt;Local data visualization&lt;/a&gt; for further details.&lt;/p&gt;

      </description>
    </item>
    
    <item>
      <title>Docs: </title>
      <link>/docs/developers-workspace/monitoring/active-listening/operation/</link>
      <pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate>
      
      <guid>/docs/developers-workspace/monitoring/active-listening/operation/</guid>
      <description>
        
        
        &lt;h1 id=&#34;aura-analytics-200-operation&#34;&gt;Aura Analytics 2.0.0 operation&lt;/h1&gt;


&lt;div class=&#34;pageinfo pageinfo-primary&#34;&gt;
&lt;p&gt;Discover &lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt; operation at a glance&lt;/p&gt;

&lt;/div&gt;

&lt;h2 id=&#34;introduction&#34;&gt;Introduction&lt;/h2&gt;
&lt;p&gt;Based on &lt;a href=&#34;../../docs/developers-workspace/monitoring/active-listening/architecture/&#34;&gt;&lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt; architecture&lt;/a&gt;, the current documents provides an overview of its global operation.&lt;/p&gt;
&lt;p&gt;&lt;i class=&#34;fa-solid fa-circle-info fa-xl&#34; style=&#34;color: #3a13fb;&#34;&gt;&lt;/i&gt; Take the &lt;a href=&#34;../../docs/developers-workspace/monitoring/active-listening/architecture/#aura-analytics-200-architecture-flowchart&#34;&gt;Aura Analytics 2.0.0 architecture flowchart&lt;/a&gt; as a reference to follow each step of the dataflow described below:&lt;/p&gt;
&lt;ol&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;Aura logs&lt;/strong&gt; generated in local instance are converted to datasets and transferred to local &lt;strong&gt;Kernel&lt;/strong&gt; via the standard
procedure and with the established frequency (typically, daily).
Once there, the &lt;strong&gt;Active listening&lt;/strong&gt; process flow fires up daily.&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;PPD-Creator&lt;/strong&gt;: This is the first process that runs, and it is the only one executed in the OBs&amp;rsquo; environment. It
retrieves &lt;strong&gt;Kernel&lt;/strong&gt; data, anonymizes all sensitive data that could identify users, and then transfers this data to
an environment shared with the Aura Global team.&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;Manage-PPD-Raw&lt;/strong&gt;: This is the first process executed from the global environment. It solely stores the
paths of the data transferred by the PPD-Creator into a PostgreSQL database to keep a record of which data has been
transferred.&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;PPD-Clean&lt;/strong&gt;: This process runs from the global environment. Once the data is anonymized, it is processed to
extract additional features (such as user frustration or the extraction of n-grams from user phrases about iterations
that do not have an intent).&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;Once the data is processed, a path is saved in the environment and also in &lt;strong&gt;ElasticSearch&lt;/strong&gt; to create dashboards that tracks Aura usage by its customers.&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;User-Dynamics&lt;/strong&gt;: This is the last process, also executed in global environment. It is responsible for extracting
statistics about users’ recurrence and the number of users per day. Among that, it identifies new users, recurring
users (those making iterations every day), recovered users (those who have stopped using Aura at some point and have
returned to the system) and lost users (those who have stopped using Aura in 3 months).&lt;/p&gt;
&lt;/li&gt;
&lt;/ol&gt;
&lt;p&gt;Examples of different dashboards are included below:&lt;/p&gt;
&lt;p&gt;&lt;img src=&#34;../../images/active-listening/elastic-search-users-dashboard.png&#34; alt=&#34;elastic-search-users-dashboard&#34;&gt;
&lt;i&gt;Figure 1. Users dashboard&lt;/i&gt;&lt;/p&gt;
&lt;p&gt;&lt;img src=&#34;../../images/active-listening/elastic-search-daily-iterations-dashboard.png&#34; alt=&#34;elastic-search-daily-iterations-dashboard&#34;&gt;
&lt;i&gt;Figure 2. Daily users dashboard&lt;/i&gt;&lt;/p&gt;
&lt;p&gt;&lt;img src=&#34;../../images/active-listening/elastic-search-weekly-iterations-dashboard.png&#34; alt=&#34;elastic-search-weekly-iterations-dashboard&#34;&gt;
&lt;i&gt;Figure 3. Weekly users dashboard&lt;/i&gt;&lt;/p&gt;
&lt;p&gt;&lt;img src=&#34;../../images/active-listening/elastic-search-trend-dashboard.png&#34; alt=&#34;elastic-search-trend-dashboard&#34;&gt;
&lt;i&gt;Figure 4. Trends dashboards&lt;/i&gt;&lt;/p&gt;

      </description>
    </item>
    
    <item>
      <title>Docs: </title>
      <link>/docs/developers-workspace/monitoring/active-listening/guidelines-obs/</link>
      <pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate>
      
      <guid>/docs/developers-workspace/monitoring/active-listening/guidelines-obs/</guid>
      <description>
        
        
        &lt;h1 id=&#34;guidelines-for-obs&#34;&gt;Guidelines for OBs&lt;/h1&gt;


&lt;div class=&#34;pageinfo pageinfo-primary&#34;&gt;
&lt;p&gt;Guidelines for OBs to allow the generation of datasets from their Aura users logs in local environment&lt;/p&gt;

&lt;/div&gt;

&lt;h1 id=&#34;introduction&#34;&gt;Introduction&lt;/h1&gt;
&lt;p&gt;As seen in the &lt;a href=&#34;../../docs/developers-workspace/monitoring/active-listening/architecture/#aura-analytics-200-architecture-flowchart&#34;&gt;Aura Analytics 2.0.0 architecture flowchart&lt;/a&gt;, &lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt; contains two different environments: the OB local environment, managed by the OB and the Global one, managed by Aura Global Team.&lt;/p&gt;
&lt;p&gt;Within this framework, the current guidelines are &lt;strong&gt;tailored towards OBs&lt;/strong&gt;, indicating how to install and execute the PPD-Creator, for the creation and processing of PPD RAW datasets.&lt;/p&gt;
&lt;p&gt;Once it is carried out, the subsequent processes of &lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt; are executed in global environment by Aura Global Team.&lt;/p&gt;
&lt;h2 id=&#34;installation-of-ppd-creator&#34;&gt;Installation of PPD-Creator&lt;/h2&gt;
&lt;p&gt;The OB must install and store the PPD-Creator in a specific destination blob PPD-RAW and is responsible for its execution.&lt;/p&gt;
&lt;p&gt;Guidelines are included in installer Aurak8s documentation: &lt;a href=&#34;../../docs/deployment/installer/#activelistening&#34;&gt;Active listening deployment&lt;/a&gt;.&lt;/p&gt;
&lt;h2 id=&#34;execution-of-ppd-creator&#34;&gt;Execution of PPD-Creator&lt;/h2&gt;
&lt;p&gt;The execution of the PPD-Creator must be done by the OBs, previous to its installation.&lt;/p&gt;
&lt;h3 id=&#34;parameters-to-launch-the-ppd-creator&#34;&gt;Parameters to launch the PPD-Creator&lt;/h3&gt;
&lt;p&gt;These are the parameters that the PPD-Creator takes from &lt;strong&gt;Kernel&lt;/strong&gt;:&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;Mandatory parameters:&lt;/strong&gt;&lt;/p&gt;
&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Parameter&lt;/th&gt;
&lt;th&gt;Description&lt;/th&gt;
&lt;th&gt;Example&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--src-type&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Source type&lt;/td&gt;
&lt;td&gt;&amp;lsquo;aws&amp;rsquo;, &amp;rsquo;local&amp;rsquo;, &amp;lsquo;azure&amp;rsquo;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--src-name&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Source folder name (raw files)&lt;/td&gt;
&lt;td&gt;&lt;code&gt;/directory/data/&lt;/code&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--dst-type&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Destination type&lt;/td&gt;
&lt;td&gt;&amp;lsquo;aws&amp;rsquo;, &amp;rsquo;local&amp;rsquo;, &amp;lsquo;azure&amp;rsquo;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--dst-name&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Destination folder name (raw files processed)&lt;/td&gt;
&lt;td&gt;&lt;code&gt;/directory/data/output&lt;/code&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--country&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Customize for a lang_country pair&lt;/td&gt;
&lt;td&gt;es&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--table&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Table to process {message, grootmessage, recognizer, api}&lt;/td&gt;
&lt;td&gt;MESSAGE&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--environment&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Environment to process (ap-one, ap-two, prod)&lt;/td&gt;
&lt;td&gt;ap-one&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;OPERATIONS&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--transfer&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;File processing: transfer, anonymize and group files&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--copy&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Raw file copy &amp;ndash; no processing&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--copy-fix&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;File copy + apply small fixes&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--show&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Show available files; no action performed&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;
&lt;p&gt;&lt;strong&gt;Optional parameters:&lt;/strong&gt;&lt;/p&gt;
&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Parameter&lt;/th&gt;
&lt;th&gt;Description&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--src-user&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Access key for the source folder&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--src-pass&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Source access secret&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--src-encryption&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Encryption key for data in source&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--dst-user&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Access key for the destination folder&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--dst-pass&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Destination access secret&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--dst-encryption&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Encryption key for data in destination&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--cloud-type&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Cloud type (‘aws’,’azure’)&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--dry-run&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Process dry-run: no action performed&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--reraise&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Re-raise exceptions on errors&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--options-file&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Read additional options from a file in dest repo&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--verbose&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Verbose level&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--console&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Act as a console app (format logs as console messages, raise on errors)&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--dest-log-skip&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Do not write the logfile at the destination folder&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--dest-log-dir&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Logging subdirectory at destination&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--show-input&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Print out input arguments&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--anon-key/ encryption-key&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Encryption key for anonymization of sensitive columns&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--max-files&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Maximum number of files to process&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--folders/month&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Restrict transfer to certain folders (i.e. months)&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--tables&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Restrict transfer to certain tables&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--reset&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Reset the index and re-process&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--encrypt-index&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Save the index files encrypted or unencrypted (default depends on cloud type)&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--raw&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Copy as raw data instead of text file&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--fix-header&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Fix file header&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;--fix-anon&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Fix anonymized fields in API columns&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;
&lt;h3 id=&#34;launching-ppd-creator&#34;&gt;Launching PPD-Creator&lt;/h3&gt;
&lt;p&gt;Execute the following command:&lt;/p&gt;
&lt;div class=&#34;highlight&#34;&gt;&lt;pre tabindex=&#34;0&#34; style=&#34;background-color:#f8f8f8;-moz-tab-size:4;-o-tab-size:4;tab-size:4;&#34;&gt;&lt;code class=&#34;language-bash&#34; data-lang=&#34;bash&#34;&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;docker run aura/ppd-creator --country &amp;lt;country-code&amp;gt; --anon-key &amp;lt;KEY&amp;gt; &amp;lt;source-params&amp;gt; &amp;lt;dest-params&amp;gt;
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;Example:&lt;/p&gt;
&lt;div class=&#34;highlight&#34;&gt;&lt;pre tabindex=&#34;0&#34; style=&#34;background-color:#f8f8f8;-moz-tab-size:4;-o-tab-size:4;tab-size:4;&#34;&gt;&lt;code class=&#34;language-bash&#34; data-lang=&#34;bash&#34;&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;docker run aura/ppd-creator &lt;span style=&#34;color:#4e9a06&#34;&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#4e9a06&#34;&gt;&lt;/span&gt;   --country ar &lt;span style=&#34;color:#4e9a06&#34;&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#4e9a06&#34;&gt;&lt;/span&gt;   --anon-key as34-dre23-4127 &lt;span style=&#34;color:#4e9a06&#34;&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#4e9a06&#34;&gt;&lt;/span&gt;   --src-name 4P-bucket-name-for-uk &lt;span style=&#34;color:#4e9a06&#34;&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#4e9a06&#34;&gt;&lt;/span&gt;   --src-user EF45IHWD34DE4FGA &lt;span style=&#34;color:#4e9a06&#34;&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#4e9a06&#34;&gt;&lt;/span&gt;   --src-pass k/Erf/6DSWWPjhdde1/abc123def-2331ldf &lt;span style=&#34;color:#4e9a06&#34;&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#4e9a06&#34;&gt;&lt;/span&gt;   --dst-name aura-ppd-ar &lt;span style=&#34;color:#4e9a06&#34;&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#4e9a06&#34;&gt;&lt;/span&gt;   --dst-user EF4341sdf3EFGUA1 &lt;span style=&#34;color:#4e9a06&#34;&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#4e9a06&#34;&gt;&lt;/span&gt;   --dst-pass J/DQW/Sdde5k12ldsf/1abcde12dd1d-123c11 &lt;span style=&#34;color:#4e9a06&#34;&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#4e9a06&#34;&gt;&lt;/span&gt;   --dst-encryption 1234ab56-12a3-45eb-8e06-8c522cdbb668-75f1b00f-6ca6-4a13-a741-64514cce728b &lt;span style=&#34;color:#4e9a06&#34;&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#4e9a06&#34;&gt;&lt;/span&gt;   --table message &lt;span style=&#34;color:#4e9a06&#34;&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#4e9a06&#34;&gt;&lt;/span&gt;   --environment prod &lt;span style=&#34;color:#4e9a06&#34;&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#4e9a06&#34;&gt;&lt;/span&gt;   --transfer
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;h3 id=&#34;output-from-ppd-creator&#34;&gt;Output from PPD-Creator&lt;/h3&gt;
&lt;p&gt;The output includes the following items:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;
&lt;p&gt;&lt;code&gt;BOT_XXXXXX.txt.bz2&lt;/code&gt;: raw files (processed).&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;code&gt;log&lt;/code&gt; folder: if the logging options have been configured.&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;code&gt;aura-sync-cache-dst.json&lt;/code&gt;: table/month: processed files (automatically generated in destination). For example:&lt;/p&gt;
&lt;div class=&#34;highlight&#34;&gt;&lt;pre tabindex=&#34;0&#34; style=&#34;background-color:#f8f8f8;-moz-tab-size:4;-o-tab-size:4;tab-size:4;&#34;&gt;&lt;code class=&#34;language-json&#34; data-lang=&#34;json&#34;&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;{&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;  &lt;span style=&#34;color:#204a87;font-weight:bold&#34;&gt;&amp;#34;AURA_DATA/ES/API/202212/&amp;#34;&lt;/span&gt;&lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;:&lt;/span&gt; &lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;[&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;    &lt;span style=&#34;color:#4e9a06&#34;&gt;&amp;#34;BOT_04095750-724e-11ed-9565-53054255c842_ES_API_20221202T150000Z.txt.bz2&amp;#34;&lt;/span&gt;&lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;,&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;    &lt;span style=&#34;color:#4e9a06&#34;&gt;&amp;#34;BOT_d2e93fc0-7656-11ed-a8eb-49a811568ab3_ES_API_20221207T170000Z.txt.bz2&amp;#34;&lt;/span&gt;&lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;,&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;    &lt;span style=&#34;color:#4e9a06&#34;&gt;&amp;#34;BOT_987780e0-7660-11ed-ba4a-2dac114c5321_ES_API_20221207T180000Z.txt.bz2&amp;#34;&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;  &lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;],&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;  &lt;span style=&#34;color:#a40000&#34;&gt;...&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;}&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;code&gt;aura-sync-cache-src.json&lt;/code&gt;: table/month: raw files_to_process (source).
For example:&lt;/p&gt;
&lt;div class=&#34;highlight&#34;&gt;&lt;pre tabindex=&#34;0&#34; style=&#34;background-color:#f8f8f8;-moz-tab-size:4;-o-tab-size:4;tab-size:4;&#34;&gt;&lt;code class=&#34;language-json&#34; data-lang=&#34;json&#34;&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;{&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#204a87;font-weight:bold&#34;&gt;&amp;#34;AURA_DATA/ES/API/202212/&amp;#34;&lt;/span&gt;&lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;:&lt;/span&gt; &lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;[&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;  &lt;span style=&#34;color:#4e9a06&#34;&gt;&amp;#34;BOT_04095750-724e-11ed-9565-53054255c842_ES_API_20221202T150000Z.txt&amp;#34;&lt;/span&gt;&lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;,&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;  &lt;span style=&#34;color:#4e9a06&#34;&gt;&amp;#34;BOT_05a5b860-7663-11ed-bbf7-cb8fd9eb3c25_ES_API_20221207T190000Z.txt&amp;#34;&lt;/span&gt;&lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;,&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;  &lt;span style=&#34;color:#4e9a06&#34;&gt;&amp;#34;BOT_05ae43e0-7663-11ed-a0aa-8b7e0e134809_ES_API_20221207T190000Z.txt&amp;#34;&lt;/span&gt;&lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;,&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;  &lt;span style=&#34;color:#4e9a06&#34;&gt;&amp;#34;BOT_0d69fb10-7492-11ed-a1fc-95dce7e56901_ES_API_20221205T110000Z.txt&amp;#34;&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;],&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;  &lt;span style=&#34;color:#a40000&#34;&gt;...&lt;/span&gt; 
&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;}&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;code&gt;aura-sync-key-dst.json&lt;/code&gt;: key used to encrypt sensitive fields.
For example:&lt;/p&gt;
&lt;div class=&#34;highlight&#34;&gt;&lt;pre tabindex=&#34;0&#34; style=&#34;background-color:#f8f8f8;-moz-tab-size:4;-o-tab-size:4;tab-size:4;&#34;&gt;&lt;code class=&#34;language-json&#34; data-lang=&#34;json&#34;&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;{&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;  &lt;span style=&#34;color:#204a87;font-weight:bold&#34;&gt;&amp;#34;sample&amp;#34;&lt;/span&gt;&lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;:&lt;/span&gt; &lt;span style=&#34;color:#4e9a06&#34;&gt;&amp;#34;abcd1234-ab12-12ab-ab12-1abc234e56fg&amp;#34;&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style=&#34;display:flex;&#34;&gt;&lt;span&gt;&lt;span style=&#34;color:#000;font-weight:bold&#34;&gt;}&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/li&gt;
&lt;/ul&gt;
&lt;h2 id=&#34;local-data-visualization-optional&#34;&gt;Local data visualization (optional)&lt;/h2&gt;
&lt;p&gt;As explained before, &lt;strong&gt;Aura Global Team&lt;/strong&gt; will be in charge of the analysis of the generated data through the global tool &lt;a href=&#34;../../docs/developers-workspace/monitoring/active-listening/architecture/#aura-analytics-dashboard&#34;&gt;Aura Analytics Dashboard&lt;/a&gt;.&lt;/p&gt;
&lt;p&gt;Nevertheless, just in case the OB wants to visualize certain data locally:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;This will be done following a prior agreement with the OB on privacy-related matters.&lt;/li&gt;
&lt;li&gt;Aura Global Team will provide access to the clean data stored in the corresponding PPD-clean blob container.&lt;/li&gt;
&lt;li&gt;The OB can install locally the ELK stack or other alternative tool for data visualization.&lt;/li&gt;
&lt;li&gt;No support will be offered by Aura Global team for this task.&lt;/li&gt;
&lt;/ul&gt;

      </description>
    </item>
    
    <item>
      <title>Docs: </title>
      <link>/docs/developers-workspace/monitoring/active-listening/annex-dataset-fields-detail/</link>
      <pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate>
      
      <guid>/docs/developers-workspace/monitoring/active-listening/annex-dataset-fields-detail/</guid>
      <description>
        
        
        &lt;h1 id=&#34;annex-dataset-fields-detail&#34;&gt;Annex: Dataset fields detail&lt;/h1&gt;


&lt;div class=&#34;pageinfo pageinfo-primary&#34;&gt;
&lt;p&gt;The current annex describes the process that each field of &lt;strong&gt;Aura Analytics 2.0.0&lt;/strong&gt; data model is going through towards a clean PPD&lt;/p&gt;

&lt;/div&gt;

&lt;h2 id=&#34;introduction&#34;&gt;Introduction&lt;/h2&gt;
&lt;p&gt;The objective of the following tables is to explain the process that each field is going through within this flow:&lt;/p&gt;
&lt;style type=&#34;text/css&#34;&gt;
.tg  {border-collapse:collapse;border-spacing:0;margin:0px auto;}
.tg td{border-style:solid;border-width:0px;font-family:Arial, sans-serif;font-size:14px;overflow:hidden;
  padding:10px 5px;word-break:normal;}
.tg th{border-style:solid;border-width:0px;font-family:Arial, sans-serif;font-size:14px;font-weight:normal;
  overflow:hidden;padding:10px 5px;word-break:normal;}
.tg .tg-mtpk{background-color:#ffffc7;color:#343434;font-weight:bold;text-align:left;vertical-align:top}
.tg .tg-ijnu{background-color:#ecf4ff;color:#00009b;font-weight:bold;text-align:left;vertical-align:top}
&lt;/style&gt;
&lt;table class=&#34;tg&#34;&gt;
&lt;tbody&gt;
  &lt;tr&gt;
    &lt;td class=&#34;tg-ijnu&#34;&gt;     Aura datasets      &lt;/td&gt;
    &lt;td class=&#34;tg-mtpk&#34;&gt;   &amp;gt;&amp;gt;&amp;gt;   &lt;/td&gt;
    &lt;td class=&#34;tg-ijnu&#34;&gt;    PPD_RAW    &lt;/td&gt;
    &lt;td class=&#34;tg-mtpk&#34;&gt;   &amp;gt;&amp;gt;&amp;gt;   &lt;/td&gt;
    &lt;td class=&#34;tg-ijnu&#34;&gt;   PPD_CLEAN   &lt;/td&gt;
  &lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;
&lt;ul&gt;
&lt;li&gt;
&lt;p&gt;Each cell of the table explains the process that the data field is undergoing in this specific moment before it gets
to the concrete stage (table column).&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;For example, the field &lt;code&gt;GLOBAL_AURA_ID&lt;/code&gt; is undergoing a &amp;ldquo;hashing&amp;rdquo; before it gets stored in &lt;code&gt;PPD_RAW&lt;/code&gt;. After this,
the &amp;ldquo;hashed data&amp;rdquo; is progressed without any further processing to &lt;code&gt;PPD_CLEAN&lt;/code&gt;.&lt;/p&gt;
&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;Tables used in the Active Listening process are described in the following sections. They belong to the &lt;a href=&#34;../../docs/components/kpi-entities/aura-entities-definition/&#34;&gt;Aura Entities
database&lt;/a&gt;.&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;
&lt;p&gt;Columns &lt;code&gt;FIELD&lt;/code&gt; and &lt;code&gt;DESCRIPTION&lt;/code&gt;: instances managed by the OB&lt;/p&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;Columns &lt;code&gt;PPD RAW&lt;/code&gt; and &lt;code&gt;PPD CLEAN&lt;/code&gt;: instances managed by Aura Global Team&lt;/p&gt;
&lt;/li&gt;
&lt;/ul&gt;
&lt;h3 id=&#34;message-dataset&#34;&gt;MESSAGE dataset&lt;/h3&gt;
&lt;p&gt;Message dataset (stored in local &lt;strong&gt;Kernel&lt;/strong&gt;).&lt;/p&gt;
&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;#&lt;/th&gt;
&lt;th&gt;FIELD&lt;/th&gt;
&lt;th&gt;DESCRIPTION&lt;/th&gt;
&lt;th&gt;PPD RAW&lt;/th&gt;
&lt;th&gt;PPD CLEAN&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;1&lt;/td&gt;
&lt;td&gt;USER_ID&lt;/td&gt;
&lt;td&gt;Unique user ID in the OB systems&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;2&lt;/td&gt;
&lt;td&gt;MSG_DT&lt;/td&gt;
&lt;td&gt;Timestamp of the data&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;3&lt;/td&gt;
&lt;td&gt;MSG_ID&lt;/td&gt;
&lt;td&gt;Unique ID of the message&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;4&lt;/td&gt;
&lt;td&gt;ACTION_CD&lt;/td&gt;
&lt;td&gt;Code of the action that produces the data&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;5&lt;/td&gt;
&lt;td&gt;AURA_ID&lt;/td&gt;
&lt;td&gt;User logging ID in Aura. The user will have a new &lt;code&gt;Aura_id&lt;/code&gt; each time she logs in Aura.&lt;/td&gt;
&lt;td&gt;Hashed&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;6&lt;/td&gt;
&lt;td&gt;PHONE_ID&lt;/td&gt;
&lt;td&gt;Phone number of the user&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;7&lt;/td&gt;
&lt;td&gt;CHANNEL_CD&lt;/td&gt;
&lt;td&gt;Code of the channel where the action happened&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;8&lt;/td&gt;
&lt;td&gt;SUBSCRIPTION_CD&lt;/td&gt;
&lt;td&gt;Code of the subscription type of the user in the OB&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;9&lt;/td&gt;
&lt;td&gt;DOMAIN_CD&lt;/td&gt;
&lt;td&gt;Code of the domain where the action happened&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;10&lt;/td&gt;
&lt;td&gt;CATEGORY_CD&lt;/td&gt;
&lt;td&gt;Code of the category where the action happened&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;11&lt;/td&gt;
&lt;td&gt;COUNTRY_CD&lt;/td&gt;
&lt;td&gt;Code of the country&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;12&lt;/td&gt;
&lt;td&gt;CORR_ID&lt;/td&gt;
&lt;td&gt;Correlator ID of the request that produces this data&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;13&lt;/td&gt;
&lt;td&gt;IS_CACHED&lt;/td&gt;
&lt;td&gt;Shows if the entity content was already cached or not&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;14&lt;/td&gt;
&lt;td&gt;STATUS_CD&lt;/td&gt;
&lt;td&gt;Status code of the action, if meaningful&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;15&lt;/td&gt;
&lt;td&gt;REASON&lt;/td&gt;
&lt;td&gt;Result of the action in error case, code of the error&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;16&lt;/td&gt;
&lt;td&gt;VERSION_ID&lt;/td&gt;
&lt;td&gt;Aura version that produces this data&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;17&lt;/td&gt;
&lt;td&gt;LANG_CD&lt;/td&gt;
&lt;td&gt;Language configured by the user for communication&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;18&lt;/td&gt;
&lt;td&gt;TZ_CD&lt;/td&gt;
&lt;td&gt;Timezone where the communication happened&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;19&lt;/td&gt;
&lt;td&gt;DURATION_NU&lt;/td&gt;
&lt;td&gt;Duration in milliseconds of the action&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;20&lt;/td&gt;
&lt;td&gt;MESSAGE&lt;/td&gt;
&lt;td&gt;Content of the message&lt;/td&gt;
&lt;td&gt;Anonymized&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;21&lt;/td&gt;
&lt;td&gt;DIALOG_ID&lt;/td&gt;
&lt;td&gt;Id of the dialog where the message happens&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;22&lt;/td&gt;
&lt;td&gt;CONVERSATION_ID&lt;/td&gt;
&lt;td&gt;Id of the conversation where the message happens&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;23&lt;/td&gt;
&lt;td&gt;WIN_RECOGNIZER_CD&lt;/td&gt;
&lt;td&gt;Code of the recognizer that wins for this message&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;24&lt;/td&gt;
&lt;td&gt;WIN_RECOGNIZER_SCORE_NU&lt;/td&gt;
&lt;td&gt;Score of the recognizer that wins for this message&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;25&lt;/td&gt;
&lt;td&gt;INTENT&lt;/td&gt;
&lt;td&gt;Selected intent&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;26&lt;/td&gt;
&lt;td&gt;ENTITIES&lt;/td&gt;
&lt;td&gt;List of entities determined by the recognizer&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;27&lt;/td&gt;
&lt;td&gt;MODALITY_CD&lt;/td&gt;
&lt;td&gt;How does the user communicate with Aura&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;28&lt;/td&gt;
&lt;td&gt;AURA_ID_GLOBAL&lt;/td&gt;
&lt;td&gt;Identifies the same &lt;code&gt;user_id&lt;/code&gt; logged with the same authentication method&lt;/td&gt;
&lt;td&gt;Hashed&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;29&lt;/td&gt;
&lt;td&gt;ACCOUNT_NUMBER&lt;/td&gt;
&lt;td&gt;Unique account number of the user&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;
&lt;h3 id=&#34;grootmessage-dataset&#34;&gt;GROOTMESSAGE dataset&lt;/h3&gt;
&lt;p&gt;Groot Message dataset (stored in local &lt;strong&gt;Kernel&lt;/strong&gt;).&lt;/p&gt;
&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;#&lt;/th&gt;
&lt;th&gt;FIELD&lt;/th&gt;
&lt;th&gt;DESCRIPTION&lt;/th&gt;
&lt;th&gt;PPD RAW&lt;/th&gt;
&lt;th&gt;PPD CLEAN&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;1&lt;/td&gt;
&lt;td&gt;USER_ID&lt;/td&gt;
&lt;td&gt;Unique user ID in the OB systems&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;2&lt;/td&gt;
&lt;td&gt;MSG_DT&lt;/td&gt;
&lt;td&gt;Timestamp of the data&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;3&lt;/td&gt;
&lt;td&gt;MSG_ID&lt;/td&gt;
&lt;td&gt;Unique ID of the message&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;4&lt;/td&gt;
&lt;td&gt;ACTION_CD&lt;/td&gt;
&lt;td&gt;Code of the action that produces the data&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;5&lt;/td&gt;
&lt;td&gt;AURA_ID&lt;/td&gt;
&lt;td&gt;User logging ID in Aura. The user will have a new &lt;code&gt;Aura_id&lt;/code&gt; each time she logs in Aura.&lt;/td&gt;
&lt;td&gt;Hashed&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;6&lt;/td&gt;
&lt;td&gt;PHONE_ID&lt;/td&gt;
&lt;td&gt;Phone number of the user&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;7&lt;/td&gt;
&lt;td&gt;CHANNEL_CD&lt;/td&gt;
&lt;td&gt;Code of the channel where the action happened&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;8&lt;/td&gt;
&lt;td&gt;DOMAIN_CD&lt;/td&gt;
&lt;td&gt;Code of the domain where the action happened&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;9&lt;/td&gt;
&lt;td&gt;CATEGORY_CD&lt;/td&gt;
&lt;td&gt;Code of the category where the action happened&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;10&lt;/td&gt;
&lt;td&gt;COUNTRY_CD&lt;/td&gt;
&lt;td&gt;Code of the country&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;11&lt;/td&gt;
&lt;td&gt;CORR_ID&lt;/td&gt;
&lt;td&gt;Correlator ID of the request that produces this data&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;12&lt;/td&gt;
&lt;td&gt;IS_CACHED&lt;/td&gt;
&lt;td&gt;Shows if the entity content was already cached or not&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;13&lt;/td&gt;
&lt;td&gt;STATUS_CD&lt;/td&gt;
&lt;td&gt;Status code of the action, if meaningful&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;14&lt;/td&gt;
&lt;td&gt;REASON&lt;/td&gt;
&lt;td&gt;Result of the action in error case, code of the error&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;15&lt;/td&gt;
&lt;td&gt;VERSION_ID&lt;/td&gt;
&lt;td&gt;Aura version that produces this data&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;16&lt;/td&gt;
&lt;td&gt;LANG_CD&lt;/td&gt;
&lt;td&gt;Language configured by the user for communication&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;17&lt;/td&gt;
&lt;td&gt;TZ_CD&lt;/td&gt;
&lt;td&gt;Timezone where the communication happened&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;18&lt;/td&gt;
&lt;td&gt;DURATION_NU&lt;/td&gt;
&lt;td&gt;Duration in milliseconds of the action&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;19&lt;/td&gt;
&lt;td&gt;MESSAGE&lt;/td&gt;
&lt;td&gt;Content of the message&lt;/td&gt;
&lt;td&gt;Anonymized&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;20&lt;/td&gt;
&lt;td&gt;CHANNEL_CONVERSATION_CD&lt;/td&gt;
&lt;td&gt;Id of the channel conversation where the message happens&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;21&lt;/td&gt;
&lt;td&gt;SKILL_CONVERSATION_CD&lt;/td&gt;
&lt;td&gt;Id of the skill conversation&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;22&lt;/td&gt;
&lt;td&gt;WIN_RECOGNIZER_CD&lt;/td&gt;
&lt;td&gt;Code of the recognizer that wins for this message&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;23&lt;/td&gt;
&lt;td&gt;WIN_RECOGNIZER_SCORE_NU&lt;/td&gt;
&lt;td&gt;Score of the recognizer that wins for this message&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;24&lt;/td&gt;
&lt;td&gt;AURA_ID_GLOBAL&lt;/td&gt;
&lt;td&gt;Identifies the same &lt;code&gt;user_id&lt;/code&gt; logged with the same authentication method&lt;/td&gt;
&lt;td&gt;Hashed&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;25&lt;/td&gt;
&lt;td&gt;ACCOUNT_NUMBER&lt;/td&gt;
&lt;td&gt;Unique account number of the user&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;26&lt;/td&gt;
&lt;td&gt;SKILL_CD&lt;/td&gt;
&lt;td&gt;Unique id of skill&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;
&lt;h3 id=&#34;recognizer-dataset&#34;&gt;RECOGNIZER dataset&lt;/h3&gt;
&lt;p&gt;Recognizer dataset stored in local &lt;strong&gt;Kernel&lt;/strong&gt;.&lt;/p&gt;
&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;#&lt;/th&gt;
&lt;th&gt;FIELD&lt;/th&gt;
&lt;th&gt;DESCRIPTION&lt;/th&gt;
&lt;th&gt;PPD RAW&lt;/th&gt;
&lt;th&gt;PPD CLEAN&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;1&lt;/td&gt;
&lt;td&gt;USER_ID&lt;/td&gt;
&lt;td&gt;Unique user ID in the OB systems&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;2&lt;/td&gt;
&lt;td&gt;RECOGNIZER_DT&lt;/td&gt;
&lt;td&gt;Timestamp of the data&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;3&lt;/td&gt;
&lt;td&gt;RECOGNIZER_ID&lt;/td&gt;
&lt;td&gt;Unique ID of the recognizer&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;4&lt;/td&gt;
&lt;td&gt;ACTION_CD&lt;/td&gt;
&lt;td&gt;Code of the action that produces the data&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;5&lt;/td&gt;
&lt;td&gt;AURA_ID&lt;/td&gt;
&lt;td&gt;User logging ID in Aura. The user will have a new &lt;code&gt;Aura_id&lt;/code&gt; each time she logs in Aura.&lt;/td&gt;
&lt;td&gt;Hashed&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;6&lt;/td&gt;
&lt;td&gt;PHONE_ID&lt;/td&gt;
&lt;td&gt;Phone number of the user&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;7&lt;/td&gt;
&lt;td&gt;CHANNEL_CD&lt;/td&gt;
&lt;td&gt;Code of the channel where the action happened&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;8&lt;/td&gt;
&lt;td&gt;DOMAIN_CD&lt;/td&gt;
&lt;td&gt;Code of the domain where the action happened&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;9&lt;/td&gt;
&lt;td&gt;CATEGORY_CD&lt;/td&gt;
&lt;td&gt;Code of the category where the action happened&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;10&lt;/td&gt;
&lt;td&gt;COUNTRY_CD&lt;/td&gt;
&lt;td&gt;Code of the country&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;11&lt;/td&gt;
&lt;td&gt;CORR_ID&lt;/td&gt;
&lt;td&gt;Correlator ID of the request that produces this data&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;12&lt;/td&gt;
&lt;td&gt;IS_CACHED&lt;/td&gt;
&lt;td&gt;Shows if the entity content was already cached or not&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;13&lt;/td&gt;
&lt;td&gt;STATUS_CD&lt;/td&gt;
&lt;td&gt;Status code of the action, if meaningful&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;14&lt;/td&gt;
&lt;td&gt;REASON&lt;/td&gt;
&lt;td&gt;Result of the action in error case, code of the error&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;15&lt;/td&gt;
&lt;td&gt;VERSION_ID&lt;/td&gt;
&lt;td&gt;Aura version that produces this data&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;16&lt;/td&gt;
&lt;td&gt;LANG_CD&lt;/td&gt;
&lt;td&gt;Language configured by the user for communication&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;17&lt;/td&gt;
&lt;td&gt;TZ_CD&lt;/td&gt;
&lt;td&gt;Timezone where the communication happened&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;18&lt;/td&gt;
&lt;td&gt;DURATION_NU&lt;/td&gt;
&lt;td&gt;Duration in milliseconds of the action&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;19&lt;/td&gt;
&lt;td&gt;SCORE_NU&lt;/td&gt;
&lt;td&gt;Score returned by the recognizer&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;20&lt;/td&gt;
&lt;td&gt;INPUT&lt;/td&gt;
&lt;td&gt;User input sent to the recognizer. Null if incoming message is an AuraCommand&lt;/td&gt;
&lt;td&gt;Anonymized&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;21&lt;/td&gt;
&lt;td&gt;OUTPUT&lt;/td&gt;
&lt;td&gt;Complete output generated by the recognizer&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;22&lt;/td&gt;
&lt;td&gt;INTENT&lt;/td&gt;
&lt;td&gt;Intent returned by the recognizer&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;23&lt;/td&gt;
&lt;td&gt;ENTITIES&lt;/td&gt;
&lt;td&gt;Entities returned by the recognizer due to the intent&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;24&lt;/td&gt;
&lt;td&gt;COMMON_THRESHOLD_NU&lt;/td&gt;
&lt;td&gt;Common threshold used to determine the best answer of all recognizers&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;25&lt;/td&gt;
&lt;td&gt;THRESHOLD&lt;/td&gt;
&lt;td&gt;Specific threshold of the specific recognizer being executed&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;26&lt;/td&gt;
&lt;td&gt;EXPECTED_INTENT&lt;/td&gt;
&lt;td&gt;Intent expected to be returned by the recognizer&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;27&lt;/td&gt;
&lt;td&gt;EXPECTED_ENTITIES&lt;/td&gt;
&lt;td&gt;Entities expected to be returned by the recognizer due to the intent&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;28&lt;/td&gt;
&lt;td&gt;AURA_ID_GLOBAL&lt;/td&gt;
&lt;td&gt;Identifies the same &lt;code&gt;user_id&lt;/code&gt; logged with the same authentication method&lt;/td&gt;
&lt;td&gt;Hashed&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;29&lt;/td&gt;
&lt;td&gt;ACCOUNT_NUMBER&lt;/td&gt;
&lt;td&gt;Unique account number of the user&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;
&lt;p&gt;This Markdown table can be directly used in your GitHub Markdown files.&lt;/p&gt;
&lt;h3 id=&#34;api-dataset&#34;&gt;API dataset&lt;/h3&gt;
&lt;p&gt;API request dataset (stored in local &lt;strong&gt;Kernel&lt;/strong&gt;).&lt;/p&gt;
&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;#&lt;/th&gt;
&lt;th&gt;FIELD&lt;/th&gt;
&lt;th&gt;DESCRIPTION&lt;/th&gt;
&lt;th&gt;PPD RAW&lt;/th&gt;
&lt;th&gt;PPD CLEAN&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;1&lt;/td&gt;
&lt;td&gt;USER_ID&lt;/td&gt;
&lt;td&gt;Unique user ID in the OB systems&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;2&lt;/td&gt;
&lt;td&gt;REQUEST_DT&lt;/td&gt;
&lt;td&gt;Timestamp of the data&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;3&lt;/td&gt;
&lt;td&gt;REQUEST_ID&lt;/td&gt;
&lt;td&gt;Unique ID of the request&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;4&lt;/td&gt;
&lt;td&gt;ACTION_CD&lt;/td&gt;
&lt;td&gt;Code of the action that produces the data&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;5&lt;/td&gt;
&lt;td&gt;AURA_ID&lt;/td&gt;
&lt;td&gt;User logging ID in Aura. The user will have a new Aura_id each time she logs in Aura&lt;/td&gt;
&lt;td&gt;Hashed&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;6&lt;/td&gt;
&lt;td&gt;PHONE_ID&lt;/td&gt;
&lt;td&gt;Phone number of the user&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;7&lt;/td&gt;
&lt;td&gt;CHANNEL_CD&lt;/td&gt;
&lt;td&gt;Code of the channel where the action happened&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;8&lt;/td&gt;
&lt;td&gt;DOMAIN_CD&lt;/td&gt;
&lt;td&gt;Code of the domain where the action happened&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;9&lt;/td&gt;
&lt;td&gt;CATEGORY_CD&lt;/td&gt;
&lt;td&gt;Code of the category where the action happened&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;10&lt;/td&gt;
&lt;td&gt;COUNTRY_CD&lt;/td&gt;
&lt;td&gt;Code of the country&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;11&lt;/td&gt;
&lt;td&gt;CORR_ID&lt;/td&gt;
&lt;td&gt;Correlator ID of the request that produces this data&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;12&lt;/td&gt;
&lt;td&gt;IS_CACHED&lt;/td&gt;
&lt;td&gt;Shows if the entity content was already cached or not&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;13&lt;/td&gt;
&lt;td&gt;STATUS_CD&lt;/td&gt;
&lt;td&gt;Status code of the API request&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;14&lt;/td&gt;
&lt;td&gt;REASON&lt;/td&gt;
&lt;td&gt;Result of the action in error case, code of the error&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;15&lt;/td&gt;
&lt;td&gt;VERSION_ID&lt;/td&gt;
&lt;td&gt;Aura version that produces this data&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;16&lt;/td&gt;
&lt;td&gt;LANG_CD&lt;/td&gt;
&lt;td&gt;Language configured by the user for communication&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;17&lt;/td&gt;
&lt;td&gt;TZ_CD&lt;/td&gt;
&lt;td&gt;Timezone where the communication happened&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;18&lt;/td&gt;
&lt;td&gt;DURATION_NU&lt;/td&gt;
&lt;td&gt;Duration in milliseconds of the action&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;19&lt;/td&gt;
&lt;td&gt;HOST&lt;/td&gt;
&lt;td&gt;Host of the API&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;20&lt;/td&gt;
&lt;td&gt;PATH&lt;/td&gt;
&lt;td&gt;Specific path of the API being called&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;21&lt;/td&gt;
&lt;td&gt;HTTP_STATUS&lt;/td&gt;
&lt;td&gt;HTTP status of the server response&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;22&lt;/td&gt;
&lt;td&gt;RESPONSE&lt;/td&gt;
&lt;td&gt;Response body&lt;/td&gt;
&lt;td&gt;Anonymized&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;23&lt;/td&gt;
&lt;td&gt;AURA_ID_GLOBAL&lt;/td&gt;
&lt;td&gt;Identifies the same user_id logged with the same authentication method&lt;/td&gt;
&lt;td&gt;Hashed&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;24&lt;/td&gt;
&lt;td&gt;ACCOUNT_NUMBER&lt;/td&gt;
&lt;td&gt;Unique account number of the user&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;td&gt;NOT &lt;br&gt; transferred&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;25&lt;/td&gt;
&lt;td&gt;REQUEST&lt;/td&gt;
&lt;td&gt;Request body&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;

      </description>
    </item>
    
  </channel>
</rss>
