3.4.0

3.4.0 (2025-02-12)

⚠ BREAKING CHANGES

• Remove wget from Promtail docker image (#15101)

Features

• Add a metric ingestion time SM sanitization (#15222) (e9d0c3e)
• add kafka development environment (#15603) (226e9f1)
• add lines skipped metric to pattern ingesters (#14997) (dea5d78)
• Add objstore support for Swift using thanos.io/objstore (#11672) (44523e0)
• add opt-in support for ProxyFroomEnvironment in logcli (#11742) (#14950) (c56b95d)
• Add otlp attribute deployment.environment.name to list of default labels (#14747) (2d407bd)
• add per-tenant time sharding for long out-of-order ingestion (#14711) (0d6d68d)
• add phase to log lines in kafka_consumer.go (#15176) (0a12cab)
• Add Rule Name and Type to Query Tags (#15055) (b272573)
• Add TLS config to the analytics client (#15227) (2c5eabd)
• added support for overrides exporter (#15630) (db72164)
• api: Support Parquet as a query response format. (#15408) (d0c11a6)
• Block scheduler scaffolding (#15198) (a10140d)
• block-scheduler: adds service and basic planner support for scheduler (#15200) (ad322c0)
• block-scheduler: introduce job lease and requeue expired jobs (#15560) (558080c)
• block-scheduler: job tracking & offset commits (#15338) (f2bff77)
• block-scheduler: status page shows completed jobs (#15580) (10194f7)
• blockbuilder component (#14621) (cbdd36a)
• blockbuilder: consolidate on record counting planner (#15247) (532bdbc)
• blockbuilder: grpc transport (#15218) (339ba1a)
• blockbuilder: priority queue for job dispatching (#15245) (0981273)
• blooms: Add task timining and sizing metrics (#15032) (79cccfd)
• blooms: Apply task timeout in bloom builder (#14988) (f92dde0)
• blooms: disk-backed queue for the bloom-planner (#14874) (b646861)
• blooms: Prefetch bloom blocks as soon as they are built (#15050) (b406015)
• build the Docker Driver for arm64 (#9247) (e950251)
• Detect fields based on per-tenant configuration and put them into structured metadata at ingest time (#15188) (7033091)
• expose topologySpreadConstraints for admin-api pods (#14995) (1b93086)
• expose topologySpreadConstraints for distributed deployment (#14853) (d075107)
• helm: Compute ConfigMap/Secret checksum only over .data content (#15177) (990f71c)
• helm: Do not explicitly template managed-by, as it should be set at install time by the installation manager. (#14763) (10b7478)
• Introduce shardable probabilistic topk for instant queries. (#14243) (7b53f20)
• lambda-promtail: add relabeling support for log entries (#15600) (c41a8b4)
• lambda-promtail: Add terraform variable for s3 bucket notification filter prefix (#15381) (3dd8d7d)
• line_format bypass template execution if possible (#15411) (2150fbc)
• logcli: Include common labels (#15611) (639ac74)
• loki/docker compose: enable feature toggle (#14858) (8f243ee)
• operator: Add support for managed GCP WorkloadIdentity (#14752) (7635a5c)
• present DF bytes values in queryable format (#15272) (f5d62bd)
• remove target lag and keep just maximum lag (#15120) (12386a2)
• sanitize structured metadata during ingestion in the distributor (#15141) (be4f17e)
• scheduler: implement and register block builder rpc service (#15248) (c519ab6)
• Skip writeback for chunks fetched by queriers older than a duration (#15605) (3b8d993)
• Support config timeout for AlibabaCloud OSS requests (#14856) (ac2e21f)
• thanos: add new metric to track status codes (#14937) (a629212)
• thanos: add support for aliyun oss and baidu bos (#14891) (fb6789d)
• thanos: add support for named stores (#14638) (8958eb9)
• thanos: disable retries when congestion control is enabled (#14867) (947a66f)
• thanos: make use of the new function IterWithAttributes (#14793) (cfc3819)
• TSDB: allow tsdb index creation in memory only (#14732) (831c0d5)
• update blockbuilder to use scheduler for fetching jobs (#15224) (0d67831)
• Use context propagation to call the same ingester in GetChunksID as Query (#15186) (70d9587)

Bug Fixes

• Add flags for path & configure kafka for non-memberlist kv store (#14850) (f2da621)
• aggregated_metrics: Fix the IsError method causing retries (#15296) (7a7b3b1)
• allow comparison against zero bytes (#15217) (17f1972)
• azureblob: Return error if Azure returns no service principal token (#13195) (e98a86b)
• block-builder: return from Process call early if max offset is reached (#15073) (13ea254)
• block-scheduler: init record planner correctly (#15390) (117869f)
• block-scheduler: one job per partition (local branch copy) (#15579) (b2f46de)
• blockbuilder: copy entries returned by record decoder (#15549) (52d745f)
• blockbuilder: min job size (#15617) (c43aa56)
• blockbuilder: use index path prefix in objectclient for tsdb creation (#15614) (55f2dd8)
• blooms: Copy chunks from ForSeries (#14863) (bfc2890)
• blooms: Do not restart builders when planner disconnects (#14783) (7669385)
• blooms: Enable metas cache on backend when running in ssd mode (#15275) (4cce207)
• blooms: Fix check for skipping most recent data when filtering blooms (#15300) (78d3c44)
• blooms: Fix strategy logger and add task test (#14857) (ab2721d)
• blooms: Fix tenants slice on loadTenantTables (#14900) (a8f7851)
• blooms: Match series to newest block only (#15481) (5846ea2)
• blooms: Skip multi-tenant TSDBs during bloom planning (#14770) (76d35cc)
• bytes unit detection in detected fields (#15525) (8e260fe)
• ci: Fix test compile error (#15404) (db2b6db)
• ci: Remove submodule once and for all (#15495) (80e8e60)
• ci: Revert "fixed Publish Rendered Helm Chart Diff workflow" (#15506) (6c49cc0)
• ci: transform TestChunkSize into a benchmark (#15361) (fed43db)
• ci: Update Python version for Helm CI (#15420) (bdbb009)
• correct S3 bucket owner label key to prevent retrieval errors (#14913) (85aaf63)
• correct typo in architecture name (amr64 -> arm64) (#15707) (068f81d)
• Correctly propagate index stats to metrics.go log line (#14941) (ff111dc)
• data race / nil channel read in pattern aggregation push (#15410) (5d8220c)
• data race in bloombuild tests (#15360) (aa7b849)
• data race in chunk client hedging tests (#15466) (fad06ee)
• data race in distributor tests (#15423) (b8168a8)
• data race in ingester test (#15465) (04f621e)
• deps: Downgrade hyperloglog to 0.2.0 (#15424) (#15426) (3b0d815)
• deps: update aws-sdk-go-v2 monorepo (#14820) (a355840)
• deps: update module cloud.google.com/go/bigtable to v1.34.0 (#15581) (9f28f69)
• deps: update module cloud.google.com/go/pubsub to v1.45.2 (#15237) (8579565)
• deps: update module cloud.google.com/go/pubsub to v1.45.3 (#15294) (672fb08)
• deps: update module cloud.google.com/go/storage to v1.47.0 (#14940) (8e6647f)
• deps: update module cloud.google.com/go/storage to v1.48.0 (#15329) (e6efbf2)
• deps: update module cloud.google.com/go/storage to v1.49.0 (#15529) (90db5ad)
• deps: update module cloud.google.com/go/storage to v1.50.0 (#15690) (efd3ec3)
• deps: update module github.com/alecthomas/chroma to v2 (#15010) (0a199bd)
• deps: update module github.com/alecthomas/chroma/v2 to v2.15.0 (#15596) (a2d3057)
• deps: update module github.com/alicebob/miniredis/v2 to v2.34.0 (#15501) (61b4ddf)
• deps: update module github.com/aliyun/aliyun-oss-go-sdk to v3 (#14976) (64081c0)
• deps: update module github.com/aws/aws-sdk-go-v2 to v1.32.6 (#15199) (84e1204)
• deps: update module github.com/aws/aws-sdk-go-v2 to v1.32.8 (#15680) (42c43ec)
• deps: update module github.com/aws/aws-sdk-go-v2/config to v1.28.10 (#15694) (9278479)
• deps: update module github.com/aws/aws-sdk-go-v2/config to v1.28.3 (#14885) (ac4018e)
• deps: update module github.com/aws/aws-sdk-go-v2/config to v1.28.4 (#14952) (7f86211)
• deps: update module github.com/aws/aws-sdk-go-v2/config to v1.28.5 (#14998) (93ed409)
• deps: update module github.com/aws/aws-sdk-go-v2/config to v1.28.6 (#15202) (bc5687e)
• deps: update module github.com/aws/aws-sdk-go-v2/config to v1.28.7 (#15508) (8faaa95)
• deps: update module github.com/aws/aws-sdk-go-v2/config to v1.28.9 (#15663) (c5c9a2e)
• deps: update module github.com/aws/aws-sdk-go-v2/service/s3 to v1.67.1 (#14999) (55d9cbe)
• deps: update module github.com/aws/aws-sdk-go-v2/service/s3 to v1.68.0 (#15060) (0c24a70)
• deps: update module github.com/aws/aws-sdk-go-v2/service/s3 to v1.69.0 (#15110) (949bfb9)
• deps: update module github.com/aws/aws-sdk-go-v2/service/s3 to v1.70.0 (#15205) (ae8b29f)
• deps: update module github.com/aws/aws-sdk-go-v2/service/s3 to v1.71.0 (#15238) (3f5ee9f)
• deps: update module github.com/aws/aws-sdk-go-v2/service/s3 to v1.71.1 (#15509) (4874e2b)
• deps: update module github.com/aws/aws-sdk-go-v2/service/s3 to v1.72.0 (#15587) (6c3c25f)
• deps: update module github.com/aws/aws-sdk-go-v2/service/s3 to v1.72.1 (#15664) (e4543ed)
• deps: update module github.com/aws/aws-sdk-go-v2/service/s3 to v1.72.2 (#15685) (0e329e1)
• deps: update module github.com/axiomhq/hyperloglog to v0.2.1 (#15322) (e382cfe)
• deps: update module github.com/axiomhq/hyperloglog to v0.2.2 (#15524) (5f98214)
• deps: update module github.com/axiomhq/hyperloglog to v0.2.3 (#15641) (b6df82e)
• deps: update module github.com/azure/azure-storage-blob-go to v0.15.0 (#14746) (ad9bdcd)
• deps: update module github.com/baidubce/bce-sdk-go to v0.9.200 (#14886) (c95fc9d)
• deps: update module github.com/baidubce/bce-sdk-go to v0.9.201 (#15069) (6287a2f)
• deps: update module github.com/baidubce/bce-sdk-go to v0.9.202 (#15187) (9922814)
• deps: update module github.com/baidubce/bce-sdk-go to v0.9.203 (#15219) (a6ba3c0)
• deps: update module github.com/baidubce/bce-sdk-go to v0.9.205 (#15251) (a78faa6)
• deps: update module github.com/baidubce/bce-sdk-go to v0.9.206 (#15324) (98e7da0)
• deps: update module github.com/baidubce/bce-sdk-go to v0.9.208 (#15441) (ada86e2)
• deps: update module github.com/baidubce/bce-sdk-go to v0.9.209 (#15510) (3334873)
• deps: update module github.com/baidubce/bce-sdk-go to v0.9.211 (#15573) (124602a)
• deps: update module github.com/baidubce/bce-sdk-go to v0.9.212 (#15633) (5885aa5)
• deps: update module github.com/baidubce/bce-sdk-go to v0.9.213 (#15686) (95dac7c)
• deps: update module github.com/bmatcuk/doublestar to v4 (#14977) (a2b66d3)
• deps: update module github.com/docker/docker to v27.3.1+incompatible (#14753) (b4a926c)
• deps: update module github.com/fatih/color to v1.18.0 (#14754) (8fc9b28)
• deps: update module github.com/fsnotify/fsnotify to v1.8.0 (#14755) (0704f5d)
• deps: update module github.com/go-redis/redis/v8 to v9 (#14978) (33a2148)
• deps: update module github.com/gocql/gocql to v1 (#15016) (2a51081)
• deps: update module github.com/golang/snappy to v0.0.4 (#15415) (035f871)
• deps: update module github.com/grafana/loki/v3 to v3.2.1 (#14826) (b8509fc)
• deps: update module github.com/grpc-ecosystem/go-grpc-middleware to v1.4.0 (#14832) (1390f90)
• deps: update module github.com/grpc-ecosystem/go-grpc-middleware to v2 (#15045) (e0ac0d0)
• deps: update module github.com/grpc-ecosystem/go-grpc-middleware/v2 to v2.2.0 (#15392) (6b7c3fc)
• deps: update module github.com/hashicorp/consul/api to v1.30.0 (#14833) (b726833)
• deps: update module github.com/hashicorp/consul/api to v1.31.0 (#15540) (8207a9b)
• deps: update module github.com/hashicorp/golang-lru to v2 (#14979) (3abb3b1)
• deps: update module github.com/heroku/x to v0.4.0 (#14897) (7e22f81)
• deps: update module github.com/heroku/x to v0.4.1 (#15370) (20f5414)
• deps: update module github.com/ibm/go-sdk-core/v5 to v5.18.2 (#15396) (314bda8)
• deps: update module github.com/ibm/go-sdk-core/v5 to v5.18.3 (#15416) (2de6e16)
• deps: update module github.com/ibm/go-sdk-core/v5 to v5.18.5 (#15673) (b7ec8e3)
• deps: update module github.com/ibm/ibm-cos-sdk-go to v1.12.0 (#15228) (5689e2e)
• deps: update module github.com/ibm/sarama to v1.44.0 (#15552) (1c783bf)
• deps: update module github.com/ibm/sarama to v1.45.0 (#15636) (9e13abd)
• deps: update module github.com/imdario/mergo to v1 (#15035) (be24862)
• deps: update module github.com/influxdata/telegraf to v1.33.0 (#15456) (0ad17eb)
• deps: update module github.com/influxdata/telegraf to v1.33.1 (#15688) (d57492c)
• deps: update module github.com/klauspost/compress to v1.17.11 (#15451) (6e8bd9d)
• deps: update module github.com/masterminds/sprig/v3 to v3.3.0 (#14899) (8874878)
• deps: update module github.com/minio/minio-go/v7 to v7.0.81 (#15114) (