Key Concepts
Telemetry:
Telemetry refers to the automated collection and transmission of metric,log and trace data from remote sources to receivers for monitoring and analysis. In the context of systems and applications, telemetry data provides insights into how these systems are performing, how users are interacting with them, and other relevant information for monitoring and optimization.
Telemetry Pipeline:
A telemetry pipeline is a system or architecture that enables the collection, processing, and transmission of telemetry data. Telemetry data typically includes information about the performance, behavior, or status of a system or application. The pipeline ensures the efficient flow of this data from its source to its destination, often involving various stages such as collection, transformation, and storage.
Destination:
In the context of a telemetry pipeline, the destination refers to the endpoint where the telemetry data is ultimately sent for storage, analysis, or further processing. This could be a database, data warehouse, analytics platform, or any system designed to receive and handle telemetry data.
Source:
The source is the origin or point of generation of telemetry data. It could be a software application, a device, a sensor, or any component that produces data related to system performance or user interactions. The telemetry pipeline starts by collecting data from these sources.
Transform Function:
The transform function is a component in the telemetry pipeline responsible for processing and modifying telemetry data as it moves through the pipeline. This may involve converting data formats, aggregating information, filtering out irrelevant data, or applying other transformations to make the data more suitable for analysis or storage.
Central Management System: The central management module is a central interface application for managing and monitoring telemetry pipelines. The main purpose of this application is to configure telemetry pipelines running on worker nodes through this interface.
Kron TP Worker Node: Worker nodes are applications that will process the actual data and apply transformation functions. The configurations of these applications are managed by the central management module.
System of Record:
The system of record is the authoritative source or database that holds the original, definitive version of a particular set of data. In telemetry, it could be the primary storage system where raw data is securely maintained before any further processing or analysis.
System of Analysis:
The system of analysis is the platform or tools used to interpret, process, and derive insights from telemetry data. This can include analytics software, machine learning algorithms, or other tools that help organizations make informed decisions based on the collected telemetry information.