Sink options have been refactored
We’ve simplified and organized our sink options
In our preparation for 1.0 we took time to organize and cleanup our request-based sink options. The specific changes include:
request_*options have been moved under arequesttable.retry_backoff_secsmust also be replaced with two new fieldsretry_initial_backoff_secsandretry_max_duration_secs.batch_*options have been moved under abatchtable.batch_sizehas been replaced with eitherbatch.max_eventsorbatch.max_sizein order to clarify its purpose (capping discrete events or bytes respectively).basic_authfields have been moved to a general purposeauthtable complemented with astrategyfield.
These changes effect the following sinks:
aws_cloudwatch_logsaws_kinesis_firehoseaws_kinesis_streamsaws_s3clickhousedatadog_metricselasticsearchgcp_pubsubhttpnew_relic_logssplunk_hec
Upgrade Guide
[sinks.my_sink_id]
type = "http"
inputs = ["my-source-id"]
uri = "https://10.22.212.22:9000/endpoint"
- batch_size = 1049000
+ [sinks.my_sink_id.batch]
+ max_size = 1049000
- [sinks.my_sink_id.basic_auth]
+ [sinks.my_sink_id.auth]
+ strategy = "basic"
user = "${USERNAME_ENV_VAR}"
password = "${PASSWORD_ENV_VAR}"
- request_in_flight_limit = 5
- request_retry_backoff_secs = 1
+ [sinks.my_sink_id.request]
+ in_flight_limit = 5
+ retry_initial_backoff_secs = 1
+ retry_max_duration_secs = 10