-
Notifications
You must be signed in to change notification settings - Fork 39
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add support for ExponentialHistogram #279
Conversation
WalkthroughThe recent changes introduce enhanced support for exponential histograms in the ClickHouse metrics exporter. Key updates include the ability to process and write complex exponential histogram data to new tables, improved handling of metric types, and the addition of specific SQL migrations for managing the necessary database schema changes. This update aims at better data representation and processing efficiency for exponential histograms within the metrics system. Changes
Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media? TipsChatThere are 3 ways to chat with CodeRabbit:
Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments. CodeRabbit Commands (invoked as PR comments)
Additionally, you can add CodeRabbit Configration File (
|
Once this is merged, I will add the instrumentation for |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Review Status
Actionable comments generated: 0
Configuration used: CodeRabbit UI
Files ignored due to path filters (2)
go.mod
is excluded by:!**/*.mod
go.sum
is excluded by:!**/*.sum
Files selected for processing (5)
- exporter/clickhousemetricsexporter/clickhouse.go (3 hunks)
- exporter/clickhousemetricsexporter/exporter.go (2 hunks)
- exporter/clickhousemetricsexporter/helper.go (1 hunks)
- migrationmanager/migrators/metrics/migrations/000007_exp_hist.down.sql (1 hunks)
- migrationmanager/migrators/metrics/migrations/000007_exp_hist.up.sql (1 hunks)
Additional comments: 8
migrationmanager/migrators/metrics/migrations/000007_exp_hist.down.sql (1)
- 1-3: LGTM.
migrationmanager/migrators/metrics/migrations/000007_exp_hist.up.sql (1)
- 1-19: LGTM.
exporter/clickhousemetricsexporter/exporter.go (2)
- 189-190: LGTM.
- 261-276: LGTM.
exporter/clickhousemetricsexporter/clickhouse.go (2)
- 55-55: LGTM.
- 496-576: LGTM.
exporter/clickhousemetricsexporter/helper.go (2)
- 489-510: LGTM.
- 512-553: LGTM.
I am going to merge this since there is less context known to the reviewer. The tl;dr version is that the sketch maintains a maximum of 1024 buckets with bins/buckets laid out in such a way that relative error is honoured. The buckets are multiples of powers of 2, and that makes it possible to merge the sketches by reducing the scale of high precision sketch to low precision sketch. I will be happy to answer questions anytime https://www.vldb.org/pvldb/vol12/p2195-masson.pdf |
So there can be at least some non-trivial stuff in launch week.
It is built on top of SigNoz/ch-go#1 and SigNoz/clickhouse-go#1. The detail of the sketch is too broad to put into the PR description. If you want to test it out, please run https://gist.github.com/srikanthccv/d046e2b677a5c03c29782cc9f8e179f1.
Summary by CodeRabbit