Update dependency grafana/promtail to v2.6.1 - autoclosed #6

Closed
kjuulh wants to merge 1 commits from renovate/grafana-promtail-2.x into main
Owner

This PR contains the following updates:

Package Update Change
grafana/promtail minor 2.4.2 -> 2.6.1

Release Notes

grafana/loki

v2.6.1

Compare Source

All Changes
  • 6658 Updated the versions of dskit and memberlist to allow configuring cluster labels for memberlist. Cluster labels prevent mixing the members between two consistent hash rings of separate applications that are run in the same Kubernetes cluster.
  • 6681 Fixed an HTTP connection leak between the querier and the compactor when the log entry deletion feature is enabled.
  • 6583 Fixed noisy error messages when the log entry deletion feature is disabled for a tenant.

v2.6.0

Compare Source

All Changes

Here is the list with the changes that were produced since the previous release.

Loki
Enhancements
  • 5662 ssncferreira chaudum Improve performance of instant queries by splitting range into multiple subqueries that are executed in parallel.
  • 5848 arcosx: Add Baidu AI Cloud as a storage backend choice.
  • 6410 MichelHollands: Add support for per tenant delete API access enabling.
  • 5879 MichelHollands: Remove lines matching delete request expression when using "filter-and-delete" deletion mode.
  • 5984 dannykopping and salvacorts: Improve query performance by preventing unnecessary querying of ingesters when the query data is old enough to be in object storage.
  • 5971 kavirajk: Extend the metrics.go recording of statistics about metadata queries to include labels and series queries.
  • 6136 periklis: Add support for alertmanager header authorization.
  • 6163 jburnham: LogQL: Add a default sprig template function in LogQL label/line formatter.
Fixes
  • 6152 slim-bean: Fixes unbounded ingester memory growth when live tailing under specific circumstances.
  • 5685 chaudum: Fix bug in push request parser that allowed users to send arbitrary non-string data as "log line".
  • 5799 cyriltovena Fix deduping issues when multiple entries with the same timestamp exist. !hide or not hide (bugfix Loki)
  • 5888 Papawy Fix common configuration block net interface name when overwritten by ring common configuration.
Changes
  • 6361 chaudum: Sum values in unwrapped rate aggregation instead of treating them as counter.
  • 6412 chaudum: Add new unwrapped range aggregation rate_counter() to LogQL
  • 6042 slim-bean: Add a new configuration to allow fudging of ingested timestamps to guarantee sort order of duplicate timestamps at query time.
  • 6120 KMiller-Grafana: Rename configuration parameter fudge_duplicate_timestamp to be increment_duplicate_timestamp.
  • 5777 tatchiuleung: storage: make Azure blobID chunk delimiter configurable
  • 5650 cyriltovena: Remove more chunkstore and schema version below v9
  • 5643 simonswine: Introduce a ChunkRef type as part of logproto
  • 6435 MichelHollands: Remove the whole-stream-deletion mode.
  • 5899 simonswine: Update go image to 1.17.9.
Promtail
Enhancements
  • 6105 rutgerke Export metrics for the Promtail journal target.
  • 5943 tpaschalis: Add configuration support for excluding configuration files when instantiating Promtail.
  • 5790 chaudum: Add UDP support for Promtail's syslog target.
  • 6102 timchenko-a: Add multi-tenancy support to lambda-promtail.
  • 6099 cstyan: Drop lines with malformed JSON in Promtail JSON pipeline stage.
  • 5715 chaudum: Allow promtail to push RFC5424 formatted syslog messages
  • 6395 DylanGuedes: Add encoding support
Fixes
  • 6034 DylanGuedes: Promtail: Fix symlink tailing behavior.
Changes
  • 5686 ssncferreira: Move promtail StreamLagLabels config to upper level config.Config
  • 5839 marctc: Add ActiveTargets method to promtail
  • 5661 masslessparticle: Invalidate caches on deletes
Fluent Bit
  • 5711 MichelHollands: Update fluent-bit output name
Loki Canary
  • 6310 chodges15: Add support for client-side TLS certs in loki-canary for Loki connection
Notes

This release was created from a branch starting at commit 1794a766134f07b54386b1a431b58e1d44e6d7f7 but it may also contain backported changes from main.

Check the history of the branch release-2.6.x.

Dependencies
  • Go Version: 1.17.9

v2.5.0

Compare Source

Release notes for 2.5.0 can be found on the release notes page

All Changes

Here is a list of all significant changes, in the past we have included all changes
but with over 500 PR's merged since the last release we decided to curate the list
to include only the most relevant.

Loki
Enhancements
  • 5542 bboreham: regexp filter: use modified package with optimisations
  • 5318 jeschkies: Speed up EntrySortIterator by 20%.
  • 5317 owen-d: Logql/parallel binop
  • 5315 bboreham: filters: use faster regexp package
  • 5311 vlad-diachenko: Removed redundant memory allocations in parsers
  • 5291 owen-d: less opaque chunk keys on fs with v12
  • 5275 SasSwart: Parse duration expressions in accordance with promql
  • 5249 3JIou-home: Push: add deflate compression in post requests
  • 5160 sandeepsukhani: add objects list caching for boltdb-shipper index store to reduce object storage list api calls
  • 5148 chaudum: Auto-expire old items from FIFO cache
  • 5093 liguozhong: [enhancement] querier : Add "query_memory_only" to make loki have option to rely only on memory availability.
  • 5078 ssncferreira: Loki: Implement custom /config handler (#​4785)
  • 5054 JordanRushing: new v12 schema optimized to better handle S3 prefix rate limits
  • 5013 liguozhong: [new feature] logql: extrapolate unwrapped rate function
  • 4947 siavashs: Support Redis Cluster Configuration Endpoint
  • 4938 DylanGuedes: Add distributor ring page
  • 4879 cyriltovena: LogQL: add line function to | line_format template
  • 4858 sandy2008: feat(): add ManagedIdentity in Azure Blob Storage

Main

  • 5789 bboreham: Production config: add dot to some DNS address to reduce lookups.
  • 5780 simonswine: Update alpine image to 3.15.4.
  • 5715 chaudum Add option to push RFC5424 syslog messages from Promtail in syslog scrape target.
  • 5696 paullryan don't block scraping of new logs from cloudflare within promtail if an error is received from cloudflare about too early logs.
  • 5685 chaudum Fix bug in push request parser that allowed users to send arbitrary non-string data as "log line".
  • 5707 franzwong Promtail: Rename config name limit_config to limits_config.
  • 5626 jeschkies Apply query limits to multi-tenant queries by choosing the most restrictive limit from the set of tenant limits.
  • 5622 chaudum: Fix bug in query splitter that caused interval query parameter to be ignored and therefore returning more logs than expected.
  • 5521 cstyan: Move stream lag configuration to top level clients config struct and refactor stream lag metric, this resolves a bug with duplicate metric collection when a single Promtail binary is running multiple Promtail clients.
  • 5568 afayngelerindbx: Fix canary panics due to concurrent execution of confirmMissing
  • 5552 jiachengxu: Loki mixin: add DiskSpaceUtilizationPanel
  • 5541 bboreham: Queries: reject very deeply nested regexps which could crash Loki.
  • 5536 jiachengxu: Loki mixin: make labelsSelector in loki chunks dashboards configurable
  • 5535 jiachengxu: Loki mixins: use labels selector for loki chunks dashboard
  • 5507 MichelHollands: Remove extra param in call for inflightRequests metric.
  • 5481 MichelHollands: Add a DeletionMode config variable to specify the delete mode and validate match parameters.
  • 5356 jbschami: Enhance lambda-promtail to support adding extra labels from an environment variable value
  • 5409 ldb: Enable best effort parsing for Syslog messages
  • 5392 MichelHollands: Etcd credentials are parsed as secrets instead of plain text now.
  • 5361 ctovena: Add usage report to grafana.com.
  • 5354 tlinhart: Add support for ARM64 to lambda-promtail drone build job.
  • 5289 ctovena: Fix deduplication bug in queries when mutating labels.
  • 5302 MasslessParticle Update azure blobstore client to use new sdk.
  • 5243 ssncferreira: Update Promtail to support duration string formats.
  • 5266 jeschkies: Write Promtail position file atomically on Unix.
  • 5280 jeschkies: Fix Docker target connection loss.
  • 5243 owen-d: moves querier.split-queries-by-interval to limits code only.
  • 5139 DylanGuedes: Drop support for legacy configuration rules format.
  • 5262 MichelHollands: Remove the labelFilter field
  • 4911 jeschkies: Support Docker service discovery in Promtail.
  • 5107 chaudum Fix bug in fluentd plugin that caused log lines containing non UTF-8 characters to be dropped.
  • 5148 chaudum Add periodic task to prune old expired items from the FIFO cache to free up memory.
  • 5187 aknuds1 Rename metric cortex_experimental_features_in_use_total to loki_experimental_features_in_use_total and metric log_messages_total to loki_log_messages_total.
  • 5170 chaudum Fix deadlock in Promtail caused when targets got removed from a target group by the discovery manager.
  • 5163 chaudum Fix regression in fluentd plugin introduced with #​5107 that caused NoMethodError when parsing non-string values of log lines.
  • 5144 dannykopping Ruler: fix remote write basic auth credentials.
  • 5091 owen-d: Changes ingester.concurrent-flushes default to 32
  • 5031 liguozhong: Promtail: Add global read rate limiting.
  • 4879 cyriltovena: LogQL: add line function to | line_format template.
  • 5081 SasSwart: Add the option to configure memory ballast for Loki
  • 5085 aknuds1: Upgrade Cortex to e0807c4eb487 and Prometheus to 692a54649ed7
  • 5067 cstyan: Add a metric to Azure Blob Storage client to track total egress bytes
  • 5065 AndreZiviani: lambda-promtail: Add ability to ingest logs from S3
  • 4950 DylanGuedes: Implement common instance addr/net interface
  • 4949 ssncferreira: Add query queueTime metric to statistics and metrics.go
  • 4938 DylanGuedes: Implement ring status page for the distributor
  • 5023 ssncferreira: Move querier.split-queries-by-interval to a per-tenant configuration
  • 4993 thejosephstevens: Fix parent of wal and wal_cleaner in loki ruler config docs
  • 4933 jeschkies: Support matchers in series label values query.
  • 4926 thejosephstevens: Fix comment in Loki module loading for accuracy
  • 4920 chaudum: Add -list-targets command line flag to list all available run targets
  • 4860 cyriltovena: Add rate limiting and metrics to hedging
  • 4865 taisho6339: Fix duplicate registry.MustRegister call in Promtail Kafka
  • 4845 chaudum Return error responses consistently as JSON
  • 4826 cyriltovena: Adds the ability to hedge storage requests.
  • 4785 DylanGuedes: Loki: Print current config by calling /config
  • 4775 jeschkies: Make * and + non-greedy to double regex filter speed.
  • 4769 cyriltovena: Improve LogQL format stages requireLabel
  • 4731 cyriltovena: Improve heap iterators.
  • 4394 cyriltovena: Improve case insensitive search to avoid allocations.
Fixes
  • 5768 slim-bean: Loki: Increase flush_op_timeout default from 10s to 10m
  • 5761 slim-bean: Promtil: Fix a panic when using the loki push api target.
  • 5622 chaudum: Preserve interval parameter when splitting queries by time
  • 5541 bboreham: Queries: update package to reject very deeply nested regexps which could crash Loki
  • 5527 liguozhong: [bugfix] fix nil pointer
  • 5474 cyriltovena: Disable sharding of count/avg when labels are mutated
  • 5472 MasslessParticle: Fix potential deadlock in the table manager
  • 5444 cyriltovena: Do not insert missing point when sharding
  • 5425 cyriltovena: Do not use WaitGroup context for StepEvaluator
  • 5423 cyriltovena: Correctly sets hash value for headblock iterator
  • 5418 RangerCD: Fix two remote_timeout configs in ingester_client block
  • 5413 MasslessParticle: Fix a deadlock in the Azure Blob client
  • 5399 MasslessParticle: Fix Azure issue where 404 not recognized
  • 5362 gotjosh: Ruler: Rule group not found API message
  • 5342 sandeepsukhani: Fix apply retention issue
  • 5334 kavirajk: Makes tailer.droppedStreams slice bounded.
  • 5324 owen-d: Release entryBufferPool once
  • 5303 owen-d: Better logic for when to shard wrt disabled lookback
  • 5298 sandeepsukhani: fix a panic in index-gateway caused by double closing of a channel
  • 5297 vlad-diachenko: Changed logic of handling RPC error with code Cancelled
  • 5289 cyriltovena: Fixes log deduplication when mutating Labels using LogQL
  • 5261 sandeepsukhani: use default retention period to check user index may have expired chunks when user does not have custom retention
  • 5234 RangerCD: Ignore missing stream while querying from ingester
  • 5168 kavirajk: Add nil check for Ruler BasicAuth config.
  • 5144 dannykopping: Ruler: Fix remote write basic auth credentials
  • 5113 kavirajk: Fix cancel issue between Query Frontend and Query Schdeduler
  • 5080 kavirajk: Handle context cancellation in some of the querier downstream requests
  • 5075 cyriltovena: Fixes a possible cancellation issue in the frontend
  • 5063 cyriltovena: Fix deadlock in disconnecting querier
  • 5060 cyriltovena: Fix race conditions in frontend_scheduler_worker.
  • 5006 sandeepsukhani: fix splitting of queries when step is larger than split interval
  • 4904 bboreham: ingester: use consistent set of instances to avoid panic
  • 4902 cyriltovena: Fixes 500 when query is outside of max_query_lookback
  • 4828 chaudum: Set correct Content-Type header in query response
  • 4761 slim-bean: Loki: Set querier worker max concurrent regardless of run configuration.
  • 4741 sandeepsukhani: index cleanup fixes while applying retention
Changes
  • 5544 ssncferreira: Update vectorAggEvaluator to fail for expressions without grouping
  • 5543 cyriltovena: update loki go version to 1.17.8
  • 5450 BenoitKnecht: pkg/ruler/base: Add external_labels option
  • 5484 sandeepsukhani: Add support for per user index query readiness with limits overrides
  • 5719 kovaxur: Loki can use both basic-auth and tenant-id
  • 5358 DylanGuedes: Add RingMode support to IndexGateway
  • 5435 slim-bean: set match_max_concurrent true by default
  • 5361 cyriltovena: Add usage report into Loki.
  • 5243 owen-d: Refactor/remove global splitby
  • 5229 chaudum: Return early if push payload does not contain data
  • 5217 sandeepsukhani: step align start and end time of the original query while splitting it
  • 5204 trevorwhitney: Default max_outstanding_per_tenant to 2048
  • 5181 sandeepsukhani: align metric queries by step and other queries by split interval
  • 5178 liguozhong: Handle context cancellation in some of the querier store.index-cache-read.
  • 5172 cyriltovena: Avoid splitting large range vector aggregation.
  • 5125 sasagarw: Remove split-queries-by-interval validation
  • 5091 owen-d: better defaults for flush queue parallelism
  • 5083 liguozhong: [enhancement] querier cache: WriteBackCache should be off query path
  • 5081 SasSwart: Add the option to configure memory ballast for Loki
  • 5077 trevorwhitney: improve default config values
  • 5067 cstyan: Add an egress bytes total metric to the azure client.
  • 5026 sandeepsukhani: compactor changes for building per user index files in boltdb shipper
  • 5023 ssncferreira: Move querier.split-queries-by-interval to a per-tenant configuration
  • 5022 owen-d: adds instrumentation to azure object client
  • 4942 cyriltovena: Allow to disable http2 for GCS.
  • 4891 liguozhong: [optimization] cache prometheus : fix "loki_cache_request_duration_seconds_bucket" ‘status_code’ label always equals "200"
  • 4737 owen-d: ensures components with required SRV lookups use the correct port
  • 4736 sandeepsukhani: allow applying retention at different interval than compaction with a config
  • 4656 ssncferreira: Fix dskit/ring metric with 'cortex_' prefix
Promtail
Enhancements
  • 5359 JBSchami: Lambda-promtail: Enhance lambda-promtail to support adding extra labels from an environment variable value
  • 5290 ssncferreira: Update promtail to support duration string formats
  • 5051 liguozhong: [new] promtail pipeline: Promtail Rate Limit stage #​5048
  • 5031 liguozhong: [new] promtail: add readline rate limit
  • 4911 jeschkies: Provide Docker target and discovery in Promtail.
  • 4813 cyriltovena: Promtail pull cloudflare logs
  • 4744 cyriltovena: Add GELF support for Promtail.
  • 4663 taisho6339: Add SASL&mTLS authentication support for Kafka in Promtail
Fixes
  • 5497 MasslessParticle: Fix orphaned metrics in the file tailer
  • 5409 ldb: promtail/targets/syslog: Enable best effort parsing for Syslog messages
  • 5246 rsteneteg: Promtail: skip glob search if filetarget path is an existing file and not a directory
  • 5238 littlepangdi: Promtail: fix TargetManager.run() not exit after stop is called
  • 4874 Alan01252: Promtail: Fix replace missing adjacent capture groups
  • 4832 taisho6339: Use http prefix path correctly in promtail
  • 4716 cyriltovena: Fixes Promtail User-Agent.
  • 5698 paullryan: Promtail: Fix retry/stop when erroring for out of cloudflare retention range (e.g. over 168 hours old)
Changes
  • 5377 slim-bean: Promtail: Remove promtail_log_entries_bytes_bucket histogram
  • 5266 jeschkies: Write Promtail position file atomically.
  • 4794 taisho6339: Aggregate inotify watcher to file target manager
  • 4745 taisho6339: Expose Kafka message key in labels
Logcli
  • 5477 atomic77: logcli: Remove port from TLS server name when provided in --addr
  • 4667 jeschkies: Package logcli as rpm and deb.
  • 4606 kavirajk: Execute Loki queries on raw log data piped to stdin
Lambda-Promtail
  • 5065 AndreZiviani: lambda-promtail: Add ability to ingest logs from S3
Fluent Bit
  • 5223 cyriltovena: fluent-bit: Attempt to unmarshal nested json.
FluentD
  • 6240 taharah: Add the feature flag include_thread_label to allow the fluentd_thread label included when using multiple threads for flushing to be configurable
  • 5107 chaudum: fluentd: Fix bug that caused lines to be dropped when containing non utf-8 characters
  • 5163 chaudum: Fix encoding error in fluentd client
Notes

This release was created from a branch starting at commit 6149121 but it may also contain backported changes from main.

Check the history of the branch release-2.5.x.

Dependencies
  • Go Version: 1.17.8

Configuration

📅 Schedule: At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, click this checkbox.

This PR has been generated by Renovate Bot.

This PR contains the following updates: | Package | Update | Change | |---|---|---| | [grafana/promtail](https://github.com/grafana/loki) | minor | `2.4.2` -> `2.6.1` | --- ### Release Notes <details> <summary>grafana/loki</summary> ### [`v2.6.1`](https://github.com/grafana/loki/blob/HEAD/CHANGELOG.md#&#8203;261-20220718) [Compare Source](https://github.com/grafana/loki/compare/v2.6.0...v2.6.1) ##### All Changes - [6658](https://github.com/grafana/loki/pull/6658) Updated the versions of [dskit](https://github.com/grafana/dskit) and [memberlist](https://github.com/grafana/memberlist) to allow configuring cluster labels for memberlist. Cluster labels prevent mixing the members between two consistent hash rings of separate applications that are run in the same Kubernetes cluster. - [6681](https://github.com/grafana/loki/pull/6681) Fixed an HTTP connection leak between the querier and the compactor when the log entry deletion feature is enabled. - [6583](https://github.com/grafana/loki/pull/6583) Fixed noisy error messages when the log entry deletion feature is disabled for a tenant. ### [`v2.6.0`](https://github.com/grafana/loki/blob/HEAD/CHANGELOG.md#&#8203;260-20220708) [Compare Source](https://github.com/grafana/loki/compare/v2.5.0...v2.6.0) ##### All Changes Here is the list with the changes that were produced since the previous release. ##### Loki ##### Enhancements - [5662](https://github.com/grafana/loki/pull/5662) **ssncferreira** **chaudum** Improve performance of instant queries by splitting range into multiple subqueries that are executed in parallel. - [5848](https://github.com/grafana/loki/pull/5848) **arcosx**: Add Baidu AI Cloud as a storage backend choice. - [6410](https://github.com/grafana/loki/pull/6410) **MichelHollands**: Add support for per tenant delete API access enabling. - [5879](https://github.com/grafana/loki/pull/5879) **MichelHollands**: Remove lines matching delete request expression when using "filter-and-delete" deletion mode. - [5984](https://github.com/grafana/loki/pull/5984) **dannykopping** and **salvacorts**: Improve query performance by preventing unnecessary querying of ingesters when the query data is old enough to be in object storage. - [5971](https://github.com/grafana/loki/pull/5971) **kavirajk**: Extend the `metrics.go` recording of statistics about metadata queries to include labels and series queries. - [6136](https://github.com/grafana/loki/pull/6136) **periklis**: Add support for alertmanager header authorization. - [6163](https://github.com/grafana/loki/pull/6163) **jburnham**: LogQL: Add a `default` sprig template function in LogQL label/line formatter. ##### Fixes - [6152](https://github.com/grafana/loki/pull/6152) **slim-bean**: Fixes unbounded ingester memory growth when live tailing under specific circumstances. - [5685](https://github.com/grafana/loki/pull/5685) **chaudum**: Fix bug in push request parser that allowed users to send arbitrary non-string data as "log line". - [5799](https://github.com/grafana/loki/pull/5799) **cyriltovena** Fix deduping issues when multiple entries with the same timestamp exist. !hide or not hide (bugfix Loki) - [5888](https://github.com/grafana/loki/pull/5888) **Papawy** Fix common configuration block net interface name when overwritten by ring common configuration. ##### Changes - [6361](https://github.com/grafana/loki/pull/6361) **chaudum**: Sum values in unwrapped rate aggregation instead of treating them as counter. - [6412](https://github.com/grafana/loki/pull/6412) **chaudum**: Add new unwrapped range aggregation `rate_counter()` to LogQL - [6042](https://github.com/grafana/loki/pull/6042) **slim-bean**: Add a new configuration to allow fudging of ingested timestamps to guarantee sort order of duplicate timestamps at query time. - [6120](https://github.com/grafana/loki/pull/6120) **KMiller-Grafana**: Rename configuration parameter fudge_duplicate_timestamp to be increment_duplicate_timestamp. - [5777](https://github.com/grafana/loki/pull/5777) **tatchiuleung**: storage: make Azure blobID chunk delimiter configurable - [5650](https://github.com/grafana/loki/pull/5650) **cyriltovena**: Remove more chunkstore and schema version below v9 - [5643](https://github.com/grafana/loki/pull/5643) **simonswine**: Introduce a ChunkRef type as part of logproto - [6435](https://github.com/grafana/loki/pull/6435) **MichelHollands**: Remove the `whole-stream-deletion` mode. - [5899](https://github.com/grafana/loki/pull/5899) **simonswine**: Update go image to 1.17.9. ##### Promtail ##### Enhancements - [6105](https://github.com/grafana/loki/pull/6105) **rutgerke** Export metrics for the Promtail journal target. - [5943](https://github.com/grafana/loki/pull/5943) **tpaschalis**: Add configuration support for excluding configuration files when instantiating Promtail. - [5790](https://github.com/grafana/loki/pull/5790) **chaudum**: Add UDP support for Promtail's syslog target. - [6102](https://github.com/grafana/loki/pull/6102) **timchenko-a**: Add multi-tenancy support to lambda-promtail. - [6099](https://github.com/grafana/loki/pull/6099) **cstyan**: Drop lines with malformed JSON in Promtail JSON pipeline stage. - [5715](https://github.com/grafana/loki/pull/5715) **chaudum**: Allow promtail to push RFC5424 formatted syslog messages - [6395](https://github.com/grafana/loki/pull/6395) **DylanGuedes**: Add encoding support ##### Fixes - [6034](https://github.com/grafana/loki/pull/6034) **DylanGuedes**: Promtail: Fix symlink tailing behavior. ##### Changes - [5686](https://github.com/grafana/loki/pull/5686) **ssncferreira**: Move promtail StreamLagLabels config to upper level config.Config - [5839](https://github.com/grafana/loki/pull/5839) **marctc**: Add ActiveTargets method to promtail - [5661](https://github.com/grafana/loki/pull/5661) **masslessparticle**: Invalidate caches on deletes ##### Fluent Bit - [5711](https://github.com/grafana/loki/pull/5711) **MichelHollands**: Update fluent-bit output name ##### Loki Canary - [6310](https://github.com/grafana/loki/pull/6310) **chodges15**: Add support for client-side TLS certs in loki-canary for Loki connection ##### Notes This release was created from a branch starting at commit `1794a766134f07b54386b1a431b58e1d44e6d7f7` but it may also contain backported changes from main. Check the history of the branch `release-2.6.x`. ##### Dependencies - Go Version: 1.17.9 ### [`v2.5.0`](https://github.com/grafana/loki/blob/HEAD/CHANGELOG.md#&#8203;250-20220407) [Compare Source](https://github.com/grafana/loki/compare/v2.4.2...v2.5.0) Release notes for 2.5.0 can be found on the [release notes page](https://grafana.com/docs/loki/latest/release-notes/v2-5/) ##### All Changes Here is a list of all significant changes, in the past we have included all changes but with over 500 PR's merged since the last release we decided to curate the list to include only the most relevant. ##### Loki ##### Enhancements - [5542](https://github.com/grafana/loki/pull/5542) **bboreham**: regexp filter: use modified package with optimisations - [5318](https://github.com/grafana/loki/pull/5318) **jeschkies**: Speed up `EntrySortIterator` by 20%. - [5317](https://github.com/grafana/loki/pull/5317) **owen-d**: Logql/parallel binop - [5315](https://github.com/grafana/loki/pull/5315) **bboreham**: filters: use faster regexp package - [5311](https://github.com/grafana/loki/pull/5311) **vlad-diachenko**: Removed redundant memory allocations in parsers - [5291](https://github.com/grafana/loki/pull/5291) **owen-d**: less opaque chunk keys on fs with v12 - [5275](https://github.com/grafana/loki/pull/5275) **SasSwart**: Parse duration expressions in accordance with promql - [5249](https://github.com/grafana/loki/pull/5249) **3JIou-home**: Push: add deflate compression in post requests - [5160](https://github.com/grafana/loki/pull/5160) **sandeepsukhani**: add objects list caching for boltdb-shipper index store to reduce object storage list api calls - [5148](https://github.com/grafana/loki/pull/5148) **chaudum**: Auto-expire old items from FIFO cache - [5093](https://github.com/grafana/loki/pull/5093) **liguozhong**: \[enhancement] querier : Add "query_memory_only" to make loki have option to rely only on memory availability. - [5078](https://github.com/grafana/loki/pull/5078) **ssncferreira**: Loki: Implement custom /config handler ([#&#8203;4785](https://github.com/grafana/loki/issues/4785)) - [5054](https://github.com/grafana/loki/pull/5054) **JordanRushing**: new v12 schema optimized to better handle S3 prefix rate limits - [5013](https://github.com/grafana/loki/pull/5013) **liguozhong**: \[new feature] logql: extrapolate unwrapped rate function - [4947](https://github.com/grafana/loki/pull/4947) **siavashs**: Support Redis Cluster Configuration Endpoint - [4938](https://github.com/grafana/loki/pull/4938) **DylanGuedes**: Add distributor ring page - [4879](https://github.com/grafana/loki/pull/4879) **cyriltovena**: LogQL: add **line** function to | line_format template - [4858](https://github.com/grafana/loki/pull/4858) **sandy2008**: feat(): add ManagedIdentity in Azure Blob Storage #### Main - [5789](https://github.com/grafana/loki/pull/5789) **bboreham**: Production config: add dot to some DNS address to reduce lookups. - [5780](https://github.com/grafana/loki/pull/5780) **simonswine**: Update alpine image to 3.15.4. - [5715](https://github.com/grafana/loki/pull/5715) **chaudum** Add option to push RFC5424 syslog messages from Promtail in syslog scrape target. - [5696](https://github.com/grafana/loki/pull/5696) **paullryan** don't block scraping of new logs from cloudflare within promtail if an error is received from cloudflare about too early logs. - [5685](https://github.com/grafana/loki/pull/5625) **chaudum** Fix bug in push request parser that allowed users to send arbitrary non-string data as "log line". - [5707](https://github.com/grafana/loki/pull/5707) **franzwong** Promtail: Rename config name limit_config to limits_config. - [5626](https://github.com/grafana/loki/pull/5626) **jeschkies** Apply query limits to multi-tenant queries by choosing the most restrictive limit from the set of tenant limits. - [5622](https://github.com/grafana/loki/pull/5622) **chaudum**: Fix bug in query splitter that caused `interval` query parameter to be ignored and therefore returning more logs than expected. - [5521](https://github.com/grafana/loki/pull/5521) **cstyan**: Move stream lag configuration to top level clients config struct and refactor stream lag metric, this resolves a bug with duplicate metric collection when a single Promtail binary is running multiple Promtail clients. - [5568](https://github.com/grafana/loki/pull/5568) **afayngelerindbx**: Fix canary panics due to concurrent execution of `confirmMissing` - [5552](https://github.com/grafana/loki/pull/5552) **jiachengxu**: Loki mixin: add `DiskSpaceUtilizationPanel` - [5541](https://github.com/grafana/loki/pull/5541) **bboreham**: Queries: reject very deeply nested regexps which could crash Loki. - [5536](https://github.com/grafana/loki/pull/5536) **jiachengxu**: Loki mixin: make labelsSelector in loki chunks dashboards configurable - [5535](https://github.com/grafana/loki/pull/5535) **jiachengxu**: Loki mixins: use labels selector for loki chunks dashboard - [5507](https://github.com/grafana/loki/pull/5507) **MichelHollands**: Remove extra param in call for inflightRequests metric. - [5481](https://github.com/grafana/loki/pull/5481) **MichelHollands**: Add a DeletionMode config variable to specify the delete mode and validate match parameters. - [5356](https://github.com/grafana/loki/pull/5356) **jbschami**: Enhance lambda-promtail to support adding extra labels from an environment variable value - [5409](https://github.com/grafana/loki/pull/5409) **ldb**: Enable best effort parsing for Syslog messages - [5392](https://github.com/grafana/loki/pull/5392) **MichelHollands**: Etcd credentials are parsed as secrets instead of plain text now. - [5361](https://github.com/grafana/loki/pull/5361) **ctovena**: Add usage report to grafana.com. - [5354](https://github.com/grafana/loki/pull/5354) **tlinhart**: Add support for ARM64 to lambda-promtail drone build job. - [5289](https://github.com/grafana/loki/pull/5289) **ctovena**: Fix deduplication bug in queries when mutating labels. - [5302](https://github.com/grafana/loki/pull/5302) **MasslessParticle** Update azure blobstore client to use new sdk. - [5243](https://github.com/grafana/loki/pull/5290) **ssncferreira**: Update Promtail to support duration string formats. - [5266](https://github.com/grafana/loki/pull/5266) **jeschkies**: Write Promtail position file atomically on Unix. - [5280](https://github.com/grafana/loki/pull/5280) **jeschkies**: Fix Docker target connection loss. - [5243](https://github.com/grafana/loki/pull/5243) **owen-d**: moves `querier.split-queries-by-interval` to limits code only. - [5139](https://github.com/grafana/loki/pull/5139) **DylanGuedes**: Drop support for legacy configuration rules format. - [5262](https://github.com/grafana/loki/pull/5262) **MichelHollands**: Remove the labelFilter field - [4911](https://github.com/grafana/loki/pull/4911) **jeschkies**: Support Docker service discovery in Promtail. - [5107](https://github.com/grafana/loki/pull/5107) **chaudum** Fix bug in fluentd plugin that caused log lines containing non UTF-8 characters to be dropped. - [5148](https://github.com/grafana/loki/pull/5148) **chaudum** Add periodic task to prune old expired items from the FIFO cache to free up memory. - [5187](https://github.com/grafana/loki/pull/5187) **aknuds1** Rename metric `cortex_experimental_features_in_use_total` to `loki_experimental_features_in_use_total` and metric `log_messages_total` to `loki_log_messages_total`. - [5170](https://github.com/grafana/loki/pull/5170) **chaudum** Fix deadlock in Promtail caused when targets got removed from a target group by the discovery manager. - [5163](https://github.com/grafana/loki/pull/5163) **chaudum** Fix regression in fluentd plugin introduced with [#&#8203;5107](https://github.com/grafana/loki/issues/5107) that caused `NoMethodError` when parsing non-string values of log lines. - [5144](https://github.com/grafana/loki/pull/5144) **dannykopping** Ruler: fix remote write basic auth credentials. - [5091](https://github.com/grafana/loki/pull/5091) **owen-d**: Changes `ingester.concurrent-flushes` default to 32 - [5031](https://github.com/grafana/loki/pull/5031) **liguozhong**: Promtail: Add global read rate limiting. - [4879](https://github.com/grafana/loki/pull/4879) **cyriltovena**: LogQL: add **line** function to | line_format template. - [5081](https://github.com/grafana/loki/pull/5081) **SasSwart**: Add the option to configure memory ballast for Loki - [5085](https://github.com/grafana/loki/pull/5085) **aknuds1**: Upgrade Cortex to [e0807c4eb487](https://github.com/cortexproject/cortex/compare/4e9fc3a2b5ab..e0807c4eb487) and Prometheus to [692a54649ed7](https://github.com/prometheus/prometheus/compare/2a3d62ac8456..692a54649ed7) - [5067](https://github.com/grafana/loki/pull/5057) **cstyan**: Add a metric to Azure Blob Storage client to track total egress bytes - [5065](https://github.com/grafana/loki/pull/5065) **AndreZiviani**: lambda-promtail: Add ability to ingest logs from S3 - [4950](https://github.com/grafana/loki/pull/4950) **DylanGuedes**: Implement common instance addr/net interface - [4949](https://github.com/grafana/loki/pull/4949) **ssncferreira**: Add query `queueTime` metric to statistics and metrics.go - [4938](https://github.com/grafana/loki/pull/4938) **DylanGuedes**: Implement ring status page for the distributor - [5023](https://github.com/grafana/loki/pull/5023) **ssncferreira**: Move `querier.split-queries-by-interval` to a per-tenant configuration - [4993](https://github.com/grafana/loki/pull/4926) **thejosephstevens**: Fix parent of wal and wal_cleaner in loki ruler config docs - [4933](https://github.com/grafana/loki/pull/4933) **jeschkies**: Support matchers in series label values query. - [4926](https://github.com/grafana/loki/pull/4926) **thejosephstevens**: Fix comment in Loki module loading for accuracy - [4920](https://github.com/grafana/loki/pull/4920) **chaudum**: Add `-list-targets` command line flag to list all available run targets - [4860](https://github.com/grafana/loki/pull/4860) **cyriltovena**: Add rate limiting and metrics to hedging - [4865](https://github.com/grafana/loki/pull/4865) **taisho6339**: Fix duplicate registry.MustRegister call in Promtail Kafka - [4845](https://github.com/grafana/loki/pull/4845) **chaudum** Return error responses consistently as JSON - [4826](https://github.com/grafana/loki/pull/4826) **cyriltovena**: Adds the ability to hedge storage requests. - [4785](https://github.com/grafana/loki/pull/4785) **DylanGuedes**: Loki: Print current config by calling /config - [4775](https://github.com/grafana/loki/pull/4775) **jeschkies**: Make `*` and `+` non-greedy to double regex filter speed. - [4769](https://github.com/grafana/loki/pull/4769) **cyriltovena**: Improve LogQL format stages requireLabel - [4731](https://github.com/grafana/loki/pull/4731) **cyriltovena**: Improve heap iterators. - [4394](https://github.com/grafana/loki/pull/4394) **cyriltovena**: Improve case insensitive search to avoid allocations. ##### Fixes - [5768](https://github.com/grafana/loki/pull/5768) **slim-bean**: Loki: Increase flush_op_timeout default from 10s to 10m - [5761](https://github.com/grafana/loki/pull/5761) **slim-bean**: Promtil: Fix a panic when using the loki push api target. - [5622](https://github.com/grafana/loki/pull/5622) **chaudum**: Preserve interval parameter when splitting queries by time - [5541](https://github.com/grafana/loki/pull/5541) **bboreham**: Queries: update package to reject very deeply nested regexps which could crash Loki - [5527](https://github.com/grafana/loki/pull/5527) **liguozhong**: \[bugfix] fix nil pointer - [5474](https://github.com/grafana/loki/pull/5474) **cyriltovena**: Disable sharding of count/avg when labels are mutated - [5472](https://github.com/grafana/loki/pull/5472) **MasslessParticle**: Fix potential deadlock in the table manager - [5444](https://github.com/grafana/loki/pull/5444) **cyriltovena**: Do not insert missing point when sharding - [5425](https://github.com/grafana/loki/pull/5425) **cyriltovena**: Do not use WaitGroup context for StepEvaluator - [5423](https://github.com/grafana/loki/pull/5423) **cyriltovena**: Correctly sets hash value for headblock iterator - [5418](https://github.com/grafana/loki/pull/5418) **RangerCD**: Fix two remote_timeout configs in ingester_client block - [5413](https://github.com/grafana/loki/pull/5413) **MasslessParticle**: Fix a deadlock in the Azure Blob client - [5399](https://github.com/grafana/loki/pull/5399) **MasslessParticle**: Fix Azure issue where 404 not recognized - [5362](https://github.com/grafana/loki/pull/5362) **gotjosh**: Ruler: Rule group not found API message - [5342](https://github.com/grafana/loki/pull/5342) **sandeepsukhani**: Fix apply retention issue - [5334](https://github.com/grafana/loki/pull/5334) **kavirajk**: Makes `tailer.droppedStreams` slice bounded. - [5324](https://github.com/grafana/loki/pull/5324) **owen-d**: Release entryBufferPool once - [5303](https://github.com/grafana/loki/pull/5303) **owen-d**: Better logic for when to shard wrt disabled lookback - [5298](https://github.com/grafana/loki/pull/5298) **sandeepsukhani**: fix a panic in index-gateway caused by double closing of a channel - [5297](https://github.com/grafana/loki/pull/5297) **vlad-diachenko**: Changed logic of handling RPC error with code Cancelled - [5289](https://github.com/grafana/loki/pull/5289) **cyriltovena**: Fixes log deduplication when mutating Labels using LogQL - [5261](https://github.com/grafana/loki/pull/5261) **sandeepsukhani**: use default retention period to check user index may have expired chunks when user does not have custom retention - [5234](https://github.com/grafana/loki/pull/5234) **RangerCD**: Ignore missing stream while querying from ingester - [5168](https://github.com/grafana/loki/pull/5168) **kavirajk**: Add `nil` check for Ruler BasicAuth config. - [5144](https://github.com/grafana/loki/pull/5144) **dannykopping**: Ruler: Fix remote write basic auth credentials - [5113](https://github.com/grafana/loki/pull/5113) **kavirajk**: Fix cancel issue between Query Frontend and Query Schdeduler - [5080](https://github.com/grafana/loki/pull/5080) **kavirajk**: Handle `context` cancellation in some of the `querier` downstream requests - [5075](https://github.com/grafana/loki/pull/5075) **cyriltovena**: Fixes a possible cancellation issue in the frontend - [5063](https://github.com/grafana/loki/pull/5063) **cyriltovena**: Fix deadlock in disconnecting querier - [5060](https://github.com/grafana/loki/pull/5060) **cyriltovena**: Fix race conditions in frontend_scheduler_worker. - [5006](https://github.com/grafana/loki/pull/5006) **sandeepsukhani**: fix splitting of queries when step is larger than split interval - [4904](https://github.com/grafana/loki/pull/4904) **bboreham**: ingester: use consistent set of instances to avoid panic - [4902](https://github.com/grafana/loki/pull/4902) **cyriltovena**: Fixes 500 when query is outside of max_query_lookback - [4828](https://github.com/grafana/loki/pull/4828) **chaudum**: Set correct `Content-Type` header in query response - [4761](https://github.com/grafana/loki/pull/4761) **slim-bean**: Loki: Set querier worker max concurrent regardless of run configuration. - [4741](https://github.com/grafana/loki/pull/4741) **sandeepsukhani**: index cleanup fixes while applying retention ##### Changes - [5544](https://github.com/grafana/loki/pull/5544) **ssncferreira**: Update vectorAggEvaluator to fail for expressions without grouping - [5543](https://github.com/grafana/loki/pull/5543) **cyriltovena**: update loki go version to 1.17.8 - [5450](https://github.com/grafana/loki/pull/5450) **BenoitKnecht**: pkg/ruler/base: Add external_labels option - [5484](https://github.com/grafana/loki/pull/5484) **sandeepsukhani**: Add support for per user index query readiness with limits overrides - [5719](https://github.com/grafana/loki/pull/5719) **kovaxur**: Loki can use both basic-auth and tenant-id - [5358](https://github.com/grafana/loki/pull/5358) **DylanGuedes**: Add `RingMode` support to `IndexGateway` - [5435](https://github.com/grafana/loki/pull/5435) **slim-bean**: set match_max_concurrent true by default - [5361](https://github.com/grafana/loki/pull/5361) **cyriltovena**: Add usage report into Loki. - [5243](https://github.com/grafana/loki/pull/5243) **owen-d**: Refactor/remove global splitby - [5229](https://github.com/grafana/loki/pull/5229) **chaudum**: Return early if push payload does not contain data - [5217](https://github.com/grafana/loki/pull/5217) **sandeepsukhani**: step align start and end time of the original query while splitting it - [5204](https://github.com/grafana/loki/pull/5204) **trevorwhitney**: Default max_outstanding_per_tenant to 2048 - [5181](https://github.com/grafana/loki/pull/5181) **sandeepsukhani**: align metric queries by step and other queries by split interval - [5178](https://github.com/grafana/loki/pull/5178) **liguozhong**: Handle `context` cancellation in some of the `querier` store.index-cache-read. - [5172](https://github.com/grafana/loki/pull/5172) **cyriltovena**: Avoid splitting large range vector aggregation. - [5125](https://github.com/grafana/loki/pull/5125) **sasagarw**: Remove split-queries-by-interval validation - [5091](https://github.com/grafana/loki/pull/5091) **owen-d**: better defaults for flush queue parallelism - [5083](https://github.com/grafana/loki/pull/5083) **liguozhong**: \[enhancement] querier cache: WriteBackCache should be off query path - [5081](https://github.com/grafana/loki/pull/5081) **SasSwart**: Add the option to configure memory ballast for Loki - [5077](https://github.com/grafana/loki/pull/5077) **trevorwhitney**: improve default config values - [5067](https://github.com/grafana/loki/pull/5067) **cstyan**: Add an egress bytes total metric to the azure client. - [5026](https://github.com/grafana/loki/pull/5026) **sandeepsukhani**: compactor changes for building per user index files in boltdb shipper - [5023](https://github.com/grafana/loki/pull/5023) **ssncferreira**: Move querier.split-queries-by-interval to a per-tenant configuration - [5022](https://github.com/grafana/loki/pull/5022) **owen-d**: adds instrumentation to azure object client - [4942](https://github.com/grafana/loki/pull/4942) **cyriltovena**: Allow to disable http2 for GCS. - [4891](https://github.com/grafana/loki/pull/4891) **liguozhong**: \[optimization] cache prometheus : fix "loki_cache_request_duration_seconds_bucket" ‘status_code’ label always equals "200" - [4737](https://github.com/grafana/loki/pull/4737) **owen-d**: ensures components with required SRV lookups use the correct port - [4736](https://github.com/grafana/loki/pull/4736) **sandeepsukhani**: allow applying retention at different interval than compaction with a config - [4656](https://github.com/grafana/loki/pull/4656) **ssncferreira**: Fix dskit/ring metric with 'cortex\_' prefix ##### Promtail ##### Enhancements - [5359](https://github.com/grafana/loki/pull/5359) **JBSchami**: Lambda-promtail: Enhance lambda-promtail to support adding extra labels from an environment variable value - [5290](https://github.com/grafana/loki/pull/5290) **ssncferreira**: Update promtail to support duration string formats - [5051](https://github.com/grafana/loki/pull/5051) **liguozhong**: \[new] promtail pipeline: Promtail Rate Limit stage [#&#8203;5048](https://github.com/grafana/loki/issues/5048) - [5031](https://github.com/grafana/loki/pull/5031) **liguozhong**: \[new] promtail: add readline rate limit - [4911](https://github.com/grafana/loki/pull/4911) **jeschkies**: Provide Docker target and discovery in Promtail. - [4813](https://github.com/grafana/loki/pull/4813) **cyriltovena**: Promtail pull cloudflare logs - [4744](https://github.com/grafana/loki/pull/4744) **cyriltovena**: Add GELF support for Promtail. - [4663](https://github.com/grafana/loki/pull/4663) **taisho6339**: Add SASL\&mTLS authentication support for Kafka in Promtail ##### Fixes - [5497](https://github.com/grafana/loki/pull/5497) **MasslessParticle**: Fix orphaned metrics in the file tailer - [5409](https://github.com/grafana/loki/pull/5409) **ldb**: promtail/targets/syslog: Enable best effort parsing for Syslog messages - [5246](https://github.com/grafana/loki/pull/5246) **rsteneteg**: Promtail: skip glob search if filetarget path is an existing file and not a directory - [5238](https://github.com/grafana/loki/pull/5238) **littlepangdi**: Promtail: fix TargetManager.run() not exit after stop is called - [4874](https://github.com/grafana/loki/pull/4874) **Alan01252**: Promtail: Fix replace missing adjacent capture groups - [4832](https://github.com/grafana/loki/pull/4832) **taisho6339**: Use http prefix path correctly in promtail - [4716](https://github.com/grafana/loki/pull/4716) **cyriltovena**: Fixes Promtail User-Agent. - [5698](https://github.com/grafana/loki/pull/5698) **paullryan**: Promtail: Fix retry/stop when erroring for out of cloudflare retention range (e.g. over 168 hours old) ##### Changes - [5377](https://github.com/grafana/loki/pull/5377) **slim-bean**: Promtail: Remove promtail_log_entries_bytes_bucket histogram - [5266](https://github.com/grafana/loki/pull/5266) **jeschkies**: Write Promtail position file atomically. - [4794](https://github.com/grafana/loki/pull/4794) **taisho6339**: Aggregate inotify watcher to file target manager - [4745](https://github.com/grafana/loki/pull/4745) **taisho6339**: Expose Kafka message key in labels ##### Logcli - [5477](https://github.com/grafana/loki/pull/5477) **atomic77**: logcli: Remove port from TLS server name when provided in --addr - [4667](https://github.com/grafana/loki/pull/4667) **jeschkies**: Package logcli as rpm and deb. - [4606](https://github.com/grafana/loki/pull/4606) **kavirajk**: Execute Loki queries on raw log data piped to stdin ##### Lambda-Promtail - [5065](https://github.com/grafana/loki/pull/5065) **AndreZiviani**: lambda-promtail: Add ability to ingest logs from S3 ##### Fluent Bit - [5223](https://github.com/grafana/loki/pull/5223) **cyriltovena**: fluent-bit: Attempt to unmarshal nested json. ##### FluentD - [6240](https://github.com/grafana/loki/pull/6240) **taharah**: Add the feature flag `include_thread_label` to allow the `fluentd_thread` label included when using multiple threads for flushing to be configurable - [5107](https://github.com/grafana/loki/pull/5107) **chaudum**: fluentd: Fix bug that caused lines to be dropped when containing non utf-8 characters - [5163](https://github.com/grafana/loki/pull/5163) **chaudum**: Fix encoding error in fluentd client ##### Notes This release was created from a branch starting at commit [`6149121`](https://github.com/grafana/loki/commit/614912181e6f3988b2b22791053278cfb64e169c) but it may also contain backported changes from main. Check the history of the branch `release-2.5.x`. ##### Dependencies - Go Version: 1.17.8 </details> --- ### Configuration 📅 **Schedule**: At any time (no schedule defined). 🚦 **Automerge**: Enabled. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, click this checkbox. --- This PR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate).
kjuulh added 1 commit 2022-10-26 09:18:46 +02:00
kjuulh changed title from Update dependency grafana/promtail to v2.6.1 to Update dependency grafana/promtail to v2.6.1 - autoclosed 2022-10-27 08:31:41 +02:00
kjuulh closed this pull request 2022-10-27 08:31:41 +02:00

Pull request closed

Sign in to join this conversation.
No reviewers
No Label
No Milestone
No project
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: kjuulh/serverctl#6
No description provided.