Commit Graph

149 Commits

Author SHA1 Message Date
freeleaps-gitops-bot
b9bca5be00 ci(bump): bump authentication image version for alpha to snapshot-6286c0f 2025-04-24 07:16:49 +00:00
zhenyus
4cd3f695f4 feat(opentelemetry): implement logging ingestion with OpenTelemetry collector and RBAC configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 22:34:09 +08:00
zhenyus
6d9d15d4d2 Add OpenTelemetry logging support across multiple services
- Introduced log ingestion configuration in values files for centralStorage, content, notification, and payment services.
- Updated deployment templates to conditionally include OpenTelemetry annotations and volume mounts based on log ingestion settings.
- Added OpenTelemetry RBAC configurations for service accounts and cluster roles to enable logging.
- Implemented OpenTelemetry collector configuration to process logs and export them to Loki.
- Ensured compatibility with existing Helm chart structure and maintained backward compatibility for services without log ingestion enabled.

Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 22:03:00 +08:00
zhenyus
84e4eb9f02 fix(opentelemetry): update logging level to info and remove debug exporter
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 20:11:45 +08:00
zhenyus
bd31bcda9d fix(opentelemetry): simplify log body assignment by removing unnecessary type conversion
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 20:06:59 +08:00
zhenyus
dc3e06738c fix(opentelemetry): update log body processing to directly use resource attributes
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 20:05:40 +08:00
zhenyus
ef0cf0fa87 fix(opentelemetry): add batch configuration for log processing
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 20:03:10 +08:00
zhenyus
ebeea26864 fix(opentelemetry): enhance log body processing by restructuring Kubernetes attributes handling
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 20:01:45 +08:00
zhenyus
6588193c7d fix(opentelemetry): reorder processors in log pipeline for correct processing sequence
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 19:53:40 +08:00
zhenyus
32d9f41ee5 fix(opentelemetry): update processor attributes to use environment variable values for improved metadata extraction
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 19:48:24 +08:00
zhenyus
ddabde9dc0 fix(opentelemetry): update environment variables and resource attributes for improved metadata extraction
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 19:43:22 +08:00
zhenyus
15dd1fba0b fix(opentelemetry): update resource attributes in distributor and log transformation for improved metadata extraction
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 17:43:08 +08:00
zhenyus
5c2ea75928 fix(opentelemetry): correct sources key in pod association configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 17:29:14 +08:00
zhenyus
9ceaaa3e0b fix(opentelemetry): restore and configure k8sattributes processor for enhanced metadata extraction
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 17:28:25 +08:00
zhenyus
c08ddf7f76 fix(opentelemetry): add resource attributes for application and environment in log transformation
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 17:20:39 +08:00
zhenyus
473f5cea54 fix(opentelemetry): update log transformation to use resource attributes for application and environment
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 17:17:40 +08:00
zhenyus
802b9bf8ba fix(opentelemetry): correct attribute path for service and deployment in log transformation
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 17:07:42 +08:00
zhenyus
c106c9a624 fix(loki): update resource_attributes to use regex for indexing labels
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 17:05:53 +08:00
zhenyus
f45f79e32e fix(opentelemetry): update processors in logs pipeline to use transform instead of attributes
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:44:36 +08:00
zhenyus
fb368eb8d8 fix(opentelemetry): remove commented-out k8sattributes actions for clarity
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:44:13 +08:00
zhenyus
b0a1e56a75 fix(opentelemetry): correct syntax for accessing context attributes in log transformation
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:43:24 +08:00
zhenyus
5f1742e22e refactor(opentelemetry): reorganize log transformation logic for clarity and consistency
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:42:28 +08:00
zhenyus
2e1879298f fix(opentelemetry): remove k8sattributes processor from logs pipeline for simplification
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:32:06 +08:00
zhenyus
1967a7444c fix(opentelemetry): comment out unused k8sattributes processor and related actions for clarity
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:31:29 +08:00
zhenyus
80e75eea27 fix(opentelemetry): add telemetry logging level configuration for improved log management
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:26:06 +08:00
zhenyus
4ee81552a2 fix(opentelemetry): streamline attributes configuration by removing redundant labeling actions
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:19:03 +08:00
zhenyus
222f5ee0fb feat(opentelemetry): add structured metadata support and update log transformation logic
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:16:03 +08:00
zhenyus
6bbc81a940 fix(opentelemetry): restore otlphttp/logs exporter configuration for log ingestion
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:00:50 +08:00
zhenyus
44e1213253 fix(opentelemetry): add labeling attributes for app and environment context
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 15:59:59 +08:00
zhenyus
884a535dd5 fix(auth): update lokiEndpoint to remove unnecessary path for log ingestion
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 15:29:35 +08:00
zhenyus
8dda0bada9 fix(opentelemetry): enhance log transformation by adding log statements and updating exporters
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 15:27:46 +08:00
zhenyus
4d591a03c0 fix(opentelemetry): reduce batch send size for log processing to improve performance
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 15:15:30 +08:00
zhenyus
0e967bf12c fix(opentelemetry): add debug exporter to log pipeline for detailed verbosity
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 15:09:44 +08:00
zhenyus
544293f7b2 fix(opentelemetry): refine log processing by removing unnecessary fields and enhancing attribute insertion
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 15:05:05 +08:00
zhenyus
90b4b3bb9b fix(opentelemetry): simplify log transformation by removing unnecessary merge operation
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 14:49:20 +08:00
zhenyus
3daf27cb4d fix(opentelemetry): enhance log transformation logic to include merging attributes
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 14:46:52 +08:00
zhenyus
19626a44fa fix(opentelemetry): update log ingestion settings and enhance transformation logic
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 14:38:55 +08:00
freeleaps-gitops-bot
d087f1d360 ci(bump): bump authentication image version for alpha to snapshot-ecad36a 2025-04-21 05:33:20 +00:00
freeleaps-gitops-bot
3132b59a81 ci(bump): bump authentication image version for alpha to snapshot-32c4fe9 2025-04-21 03:56:29 +00:00
freeleaps-gitops-bot
be745ba915 ci(bump): bump authentication image version for alpha to 1.1.1 2025-04-21 03:07:41 +00:00
freeleaps-gitops-bot
e937aaa092 ci(bump): bump authentication image version for prod to 1.1.1 2025-04-18 04:56:16 +00:00
zhenyus
33c91ecb8d fix: remove debug exporter and adjust k8sattributes processor configuration in OpenTelemetry setup
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 10:34:22 +08:00
zhenyus
354f6b2669 fix: add missing remove operator for body field in OpenTelemetry log processing
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:29:19 +08:00
zhenyus
b42a6ee07f fix: remove unnecessary transform processor from OpenTelemetry log pipeline
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:26:40 +08:00
zhenyus
e60016366e fix: correct indentation for OpenTelemetry config checksum annotation in deployment
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:26:19 +08:00
zhenyus
d7c952fe2e fix: add missing annotations for OpenTelemetry configuration in deployment
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:25:09 +08:00
zhenyus
c85f4966c5 fix: remove transform section from OpenTelemetry configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:23:27 +08:00
zhenyus
9f9151ad12 fix: remove unnecessary format field from loki exporter configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:19:30 +08:00
zhenyus
a72ed9b1b9 feat: add additional fields for pod IP and node name in OpenTelemetry log transformation
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:18:50 +08:00
zhenyus
61e3f5caff fix: add missing id field to json_parser operator and update transform statements in OpenTelemetry configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:17:23 +08:00