Loki 3.6.0 release notes

Features

Add method to get zone-aware partition consumers (#17377) (4a733fc)
analytics: Change how analytics proxy works (#19098)
API: Add endpoint returning tenant configured limits (#17101) (6818c90)
API: Loki Improvement Document (LID) for query splitting (#16958) (66f0f0b)
ci: Add workflow_dispatch for querytee-images workflow (#19541)
compactor: Compactor deletion manifest builder (#17474) (47961f8)
compactor HS: Add a dashboard for monitoring deletion with horizontally scalable compactor (#18588) (10db8ab)
compactor HS: Add a job runner for processing of deletion jobs (#18058)
compactor HS: Add job queue and deletion job builder (#17843) (#17843)
compactor HS: Add jsonnet for deploying horizontally scalable compactor (#18550) (5e28950)
compactor HS: Add support for applying storage updates after finishing processing of deletion manifest (#18294) (ba3c670)
compactor HS: Add support for worker for processing of jobs from the compactor's job queue (#18165) (d05c4bc)
compactor HS: Fixes and changes for getting horizontally scalable compactor to work well (#18526) (000f90d)
compactor HS: Refactor interfaces and build a link between delete requests manager and compactor for HS of compactor (#18326) (3646607)
compactor HS: Store index updates per processed segment in the manifest to the object storage (#18212) (8007e22)
compactor HS: tune compactor worker config and add experimental feature warning to the docs (#18539) (5bf3f74)
compactor HS: Use streaming RPCs for interacting with job queue over grpc (#18125) (385e317)
compactor HS: Wire things up and add some metrics (#18421) (bd29320)
compactor HS: Add a metric to track the number of jobs left to conclude ongoing unit of work (#19506)
dataobj executor: project node (#17312) (395030b)
dataobj, executor: filter node execution (#17327) (cf54d50)
data-objects: Add query stats collection to the dataobj readers (#17128) (9e68fb0)
data-objects: Add p50, p95 and p99 section sizes per tenant (#19054)
data-objects: Add p50, p95 and p99 sections per tenant to stats (#19044)
data-objects: Add tenant to section builders (#18864)
data-objects: Add tenant to section metadata (#18843)
data-objects: build multi-tenant data objects (#19034)
data-objects: decode tenant when reading streams and logs sections (#18846)
data-objects: print the tenant in the dump and stats sub-commands (#19033)
data-objects: improve dataobj-inspect command (#18618) (238e0b7)
data-objects: Initial index-builder implementation (#18297) (1f0edcd)
distributor: Add MaxRecvMsgSize config for uncompressed message size limits (#16915) (1d99f4d)
distributor: log ingestion policy when log_push_request is set (#18712) (0ec787f)
distributor: Mark truncated log lines with identifier (#18262) (0ee8e76)
distributor: stop pushing to the metadata topic from distributors (#17525) (e0f015c)
distributor: remove tenant topic tee (#19082)
distributor: check for failed reason in distributors (#18128) (104c457)
distributor: Add agent IPs to distributor log (#17011) (7fc9026)
distributor: Add enforceLimits to ingest_limits.go (#17117) (d197cda)
distributor: Add metric to track ingest limits failures in distributor (#17015) (7f1a1c7)
distributor: Add tests for enforcing limits in distributors (#17124) (69aeda1)
engine: Implements predicate mapping for DataObjScan (#17621) (cbb5be6)
engine, dataobj: logql bench wiring for new engine [non-fork] (#17627) (ccb65f9)
engine: Add json parsing stage to v2 engine (#19240)
engine: Add logfmt parse support to the v2 query engine (#18931)
engine: More aggregations for the new query engine (#19350)
engine: Prefetch inputs of Merge pipeline concurrently (#19039)
fluentbit: Update fluent/fluent-bit to v4 which adds support for structured metadata to the out_loki plugin (#17200) (f108e1c)
fluentd: Add 'compress gzip' setting to fluentd plugin (#18995)
GEL: Remove tokengen job and kubectl dependency. (#18803)
goldfish: improve query performance with indexes and partitions (#19023)
goldfish: Add user and query engine to Goldfish UI (#18801)
goldfish: capture logs drilldown flag in query samples (#19242)
goldfish: Add traceId support to goldfish (#18681) (2f0dc74)
goldfish: Add traceId to Goldfish UI (#18726) (4fabb8d)
goldfish: Goldfish UI (#17983) (462acb5)
goldfish: Goldfish UI Improvements (#18504) (b14a282)
helm: Add block_builder config to helm chart (#17451) (a9808a1)
helm: Add startupProbe to memcached(#19166)
helm: Add startupProbe to memcached exporter(#19165)
helm: Add configurable livenessProbe to single binary StatefulSet(#19072)
helm: Add dnsconfig to all missing resources(#18903)
helm: Add FOLDER_ANNOTATION logic for sidecar container in loki helm chart, making multi-tenant alerting easier (#13289) (833fcbc)
helm: Add health probes to admin-api (#18546) (358228a)
helm: Add health probes to bloom-builder (#18549)
helm: Add health probes to bloom-gateway(#18551)
helm: Add health probes to bloom-planner(#18552)
helm: Add health probes to gateway component(#18545)
helm: Add health probes to loki in backend(#18548)
helm: Add location snippet to nginx config (#18105) (5737751)
helm: Add missing revisionHistoryLimit (#18638) (d0e0d1a)
helm: Add more specificity to affinity and topology spread constraints(#19061)
helm: Add namespaceOverride(#18707)
helm: Add non-default-values.yaml to increase test coverage (#18360) (b0e04f4)
helm: Add option to use deployment type instead of daemonset in canary (#17364) (a6563cf)
helm: Add PDB for patternIngester (#17058) (7fad38d)
helm: Add readiness and liveness support for all memcached components (#18525) (9b54d9f)
helm: Add readiness probe for memcached (#15609) (6ed1461)
helm: Add replicas to loki-canary deployment (#19095)
helm: Add startupProbe to loki-sc-rules (#18547) (121e84e)
helm: Add support for custom alert rule annotations (#19193)
helm: Add tpl support for pattern_ingester and ingester_client (#16759) (901b2b0)
helm: Added trafficDistribution for service-distributor (#17742) (78f154f)
helm: Adds a flag for tokengen rbac components so that they can be disabled optionally (#15882) (10536b2)
helm: Allow configuring service types (#18708)
helm: Allow enabling user namespaces (#18661)
helm: Allow external memcached setup (#17432) (013aa17)
helm: Allow extraObjects to be defined as either a list or dictionary.(#13252) (#13252)
helm: Allow passing tenant password hash instead of password (#17049) (20b97f7)
helm: Allow setting labels for ingesters (#18536) (ab426be)
helm: Enable rules sidecar for the ruler pods (#17231) (2c5ad02)
helm: Expose all storage configuration (#18509) (db5e021)
helm: Expose labels on volumeClaimTemplates (#13317) (cdefbbf)
helm: Expose Loki UI in pure ingress (#18400) (21f3d09)
helm: Helm issue templates (#18693) (e0ec815)
helm: Implementing support of l2 chunksCache memcache (#17556) (039e7c1)
helm: Integrate the enterprise-provisioner into Loki helm chart (#17616)
helm: Make access modes for persistence on all PVCs and StatefulSets editable (#13474)
helm: Only delete PVC on statefulset deletion, not scaling (#19097)
helm: Support bypass all s3/gcs/azure config in object_store (#17597) (d6c2a8e)
helm: Support separate loki ruler storage configuration (#18510)
helm: Support templated loki.operational_config (#17045) (078f353) to 3.5.3 (#18619) (907bb61)
helm: Update Loki version in charts (#18447) (e2770ae)
helm: Use named ports for memcached services targetports (#18990)
helm: delete statefulset if volumeClaimTemplates changes (#19217)
helm: Added affinity property to the loki-canary deamonset (#17720)
ingester: Add ingester_chunks_flush_requests_total (#18696)
ingester: per policy overridable stream limits (#18994)
ingest-limits: Re-implement ExceedsLimits in ingest-limits-frontend (#17576) (7b88a02)
ingest-limits: Add exceeds limits RPC with no-op implementation (#17546) (cd5e7df)
ingest-limits: Add partition id caching (#16964) (54ff5dc)
ingest-limits: Append stream metadata records to Kafka-based WAL (#17602) (932f39b)
ingest-limits: Enforce synchronously max stream limit per partition (#17527) (c55f038)
ingest-limits: Support disabling the partition consumers cache (#17318) (1d68047)
kafka: Support multiple Kafka clients in component (#17757)
kafka: Adds partition-ingester push latency histogram (#17385) (01cf36d)
kafka: Optionally enable Kafka histograms for read/write latency (#17089) (e962398)
kafka: Refactors kafka/client to improve metric collection (#17308) (ab65ac5)
kafka: Support consuming records from Kafka (#17691)
limits: Add ability to filter tenant limits endpoint by allowlist (#18521) (73de7b5)
limits: Add a fast path for consuming records from Kafka (#17858)
limits: Add metric that tracks unanswered streams (#17966)
limits: limits-frontend failover to other zones (#17408)
limits: optimize rate buckets to avoid re-allocating slice (#17904)
limits: quick fix to produce a stream once per minute (#17996)
logcli: Add delete commands to logcli (#18375) (f38950a)
logcli: Add --log.level parameter to help with diagnosing errors when using logcli. (#19136)
logs drilldown: Return metric query partial results for drilldown (#18286) (c0c2265)
logs drilldown: Drilldown config endpoint (#19028)
logs drilldown: Implement unwrap as a projection (#19409)
logs drilldown: persist patterns as aggregated metrics (#17737)
logs drilldown: query persisted patterns (#17980)
loki-canary: Update loki canary to support batched log push (#17558)
metrics: Adds distributor lag counter to push.go (#18012)
metrics: Adds User-Agent to distributor push logging (#17764)
mixins: Allow disabling Thanos dashboard and fix dashboard's file name (#18749)
operator: Add alert LokiIngesterFlushFailureRateCritical (#18698)
operator: Add warning alert for when LokiStack is not getting ready (#19258)
operator: Allow users to configure virtual-host-style for S3 secrets (#17363) (c4dace5)
operator: Allow using resource requests as limits (#17484) (0b2bae8)
operator: deploy network policies with LokiStack (#19099)
operator: extend LokiStack authorization to support OTel Semantics (#16031)
operator: s3 validation reject endpoints that contain a URL path (#19356)
operator: Update Loki operand to v3.5.5 (#19187)
operator: Update Loki operand to v3.4.3 (#17847)
operator: Update Loki operand to v3.5.4 (#19122)
policies: Default ingestion policy mappings merged with per-tenant mappings (#18926)
pattern ingester: Pattern ingester pushes detected level as structured metadata (#16924) (66033bb)
pattern ingester: implement volume-based pattern filtering (#18838)
planning: Adds physical and logical nodes for range aggregation (#17974)
testing: Add ReasonFailed (#18055) (b15d85d)
testing return ReasonFailed from ingest-limits frontend (#18123) (c42ccc3)
thanos: Allow dashes in storage_prefix config (#16934) (c01d9c7)
tools: Querytee Goldfish (#17959) (7775a41)
tools: Add stream generator (#17214) (af97644)
ui: Add ingest limits rings (#16978) (1df66cc)

Fixes

aggregated metrics: Hide __aggregated_metric__ in /series and /labels. This will alleviate confusion for people using a tool like logcli series --analyze-labels for cardinality analysis. (#14677) (4b0aaaa)
build: Udpate purgo package (#17807)
build: remove busybox from dockerfile (#19502)
build: remove UI from docker build (#19425)
build: rpm signature config (#19476)
build: Update ckit (#18997)
ci: Fix deprecation errors from staticcheck linter (#17210) (cfe3675)
ci: Fix lambda-promtail image build (#18443) (8f0ba2e)
ci: Fix workflow timeout added in wrong format (#18348) (53ba9c7)
ci: Read releaseLibRef from jsonnet.json lockfile (#18538) (26417b5)
chunkenc: avoid memory allocations when loading symbolizer from a flushed chunk (#17953)
compactor: Return request ID in response header (#19444)
compactor: Concurrent map access for processedSeries in delete requests manager (#17469) (32c5088)
compactor: Fix timeout and series progress marker for same requests with different shards (#17125) (288ec8c)
compactor: Move the check for duplicate series up the call stack to fix an issue when retention is enabled (#17663) (a5e95ba)
compactor: Wire up deletion series progress tracking (#17099) (db59d0e)
compactor: Do not try to merge the already consolidated delete requests while listing them (#18544) (8054076)
compactor: Ensure to return delete requests only for the requested tenant (#18589) (cdb190b)
compactor: Fix handling of duplicate delete requests (#18460) (255fce2)
compactor: Fix lint failure in retention.go (#17894)
compactor: Use the custom objectExists function to work around bug in Thanos object client (#18820)
compactor: Fix panic while applying storage updates when a whole chunk is deleted by line filters (#19262)
compactor: set delete request batch to empty when we load to fail requests (#17810)
config_wrapper: apply instance_enable_ipv6 from common to all components (#18254) (5bc5853)
deps: Patch mapstructure dependency to remove CVE (#19447)
distributor: Disable metadata topic writes (#17437) (46b2271)
distributor: Revert remove colons from level detection (#16999) (e678b61)
distributor: Short circuit level detection when already detected (#17028) (58aa00a)
distributor: Skip streams over limits in dry-run mode (#17114) (2cde9b1)
distributor: Prevent panic when ContentLength is negative in Distributor RequestBodyTooLarge metrics (#17054) (9e9f534)
distributor: detect "Information" log level as "info" (#18195) (82263d3)
distributor: correctly register allowed log level fields (#19261)
distributor: extended detected level for debug and critical level (#18370)
docs: Update configuration.md (#17269) (70de523)
docs: Added instructions for how to upgrade zone-aware ingesters (#18658) (aff2cb0)
engine: Don't attempt to release batch reference on read for merge node (#18913)
engine: Fix bug in SortMerge which caused rows to be skipped due to incorrect sorting (#18334) (4fbe7c1)
engine: Fix out-of-bounds panic in SortMerge implementation (#17967)
frontend: Allow resolution of v6 address

These notes run past the length kept in the archive. The rest is on the publisher’s page.