fix: increase federate scrape timeout - #347
Conversation
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Central YAML (base), Organization UI (inherited) Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (2)
📝 WalkthroughSummary by CodeRabbit
WalkthroughPrometheus federation configurations now use a 90-second scrape timeout instead of 60 seconds. ChangesPrometheus federation timing
Estimated code review effort: 1 (Trivial) | ~2 minutes 🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✨ Finishing Touches🧪 Generate unit tests (beta)
Warning There were issues while running some tools. Please review the errors and either fix the tool's configuration or disable the tool if it's a critical failure. 🔧 Checkov (3.3.8)resources/prometheus/federation-config-base.yamlTraceback (most recent call last): resources/prometheus/federation-config.yamlTraceback (most recent call last): Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
| - openshift-monitoring | ||
| scrape_interval: 120s | ||
| scrape_timeout: 60s | ||
| scrape_interval: 170s |
There was a problem hiding this comment.
Is there a reason to use the "magic" number 170s over a "round" number like 3 minutes? Seeing something like "170s" always makes me think there's some reason for that specific value, but then I'd expect a comment explaining why that value was chosen. (Similar though not exactly the point: https://isocpp.github.io/CppCoreGuidelines/CppCoreGuidelines#res-magic)
There was a problem hiding this comment.
I was not sure about the behavior if the interval is smaller / equal to the timeout. I wanted 150 for the timeout because my local curl against that endpoint took 2m15s during that incident so that 150s/2.5m should be covered. Then I just added a little bit for the interval.
There was a problem hiding this comment.
As discussed in slack I changed it to be 120s for the interval and 90s for the timeout.
ebensh
left a comment
There was a problem hiding this comment.
I had no problem with making it longer, I just wanted it to be 180s instead of 170s :) Up to you.
Increasing the timeout and scrape interval for federation due to: https://redhat.pagerduty.com/incidents/Q1SDD3SR0UAG71