Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add documentation for query insights - query metrics feature #7846

Merged

Conversation

deshsidd
Copy link
Contributor

@deshsidd deshsidd commented Jul 26, 2024

Description

Add documentation for query insights - query metrics feature : opensearch-project/OpenSearch#11596

Issues Resolved

resolves: #7798

Version

2.16

Checklist

  • By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and subject to the Developers Certificate of Origin.
    For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Copy link

Thank you for submitting your PR. The PR states are In progress (or Draft) -> Tech review -> Doc review -> Editorial review -> Merged.

Before you submit your PR for doc review, make sure the content is technically accurate. If you need help finding a tech reviewer, tag a maintainer.

When you're ready for doc review, tag the assignee of this PR. The doc reviewer may push edits to the PR directly or leave comments and editorial suggestions for you to address (let us know in a comment if you have a preference). The doc reviewer will arrange for an editorial review.

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>
Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>
Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>
@deshsidd deshsidd force-pushed the sid/query-categorization-docs branch from d597701 to 4c795f9 Compare July 26, 2024 20:49
@deshsidd
Copy link
Contributor Author

@hdhalter Please review

@hdhalter
Copy link
Contributor

Thanks so much, @deshsidd ! I'll assign it to @kolchfa-aws for a doc review. In the meantime, can you please review the Vale errors to see if you can address them? Thanks!

@hdhalter hdhalter added 4 - Doc review PR: Doc review in progress release-notes PR: Include this PR in the automated release notes labels Jul 26, 2024
@hdhalter hdhalter assigned kolchfa-aws and unassigned hdhalter Jul 26, 2024
Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>
@deshsidd
Copy link
Contributor Author

Thanks so much, @deshsidd ! I'll assign it to @kolchfa-aws for a doc review. In the meantime, can you please review the Vale errors to see if you can address them? Thanks!

Done!

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
@kolchfa-aws
Copy link
Collaborator

kolchfa-aws commented Jul 29, 2024

@deshsidd I rewrote and pushed to this PR. Could you make sure I preserved technical accuracy of the content? Also, one question:

  • Is grpc the actual setting name for a gRPC exporter? And how does the user configure this exporter?

Copy link
Collaborator

@natebower natebower left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@deshsidd @kolchfa-aws Please see my comments and changes and tag me for approval once addressed. Thanks!

_observing-your-data/query-insights/query-metrics.md Outdated Show resolved Hide resolved

# Query metrics

Query metrics involves comprehensive instrumentation along the search path to capture key [metrics](#metrics), such as aggregation types, query types, latency, and resource usage per query type. Open Telemetry (oTel) is the instrumentation framework. The telemetry data can be consumed using oTel metrics [exporters]({{site.url}}{{site.baseurl}}/observing-your-data/trace/distributed-tracing/#exporters).
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The first phrase of the first sentence is too vague and doesn't entirely work. How/in what way does "query metrics" involve something? What comprehensive instrumentation (is this information necessary?)? I would just combine the first two sentences.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@natebower "Instrumentations" refers to the tools and processes used to collect, measure, and report data about the performance and behavior of a system. How about "Query metrics uses comprehensive instrumentation along the search path to capture key metrics, such as aggregation types, query types, latency, and resource usage per query type."

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If "query metrics" are a generic noun, then it should be "Query metrics use", but that still reads oddly because we have metrics capturing other metrics. As written, we seem to be treating "Query Metrics" as a proper noun syntactically.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK, let's ask @deshsidd: Could you please address this comment? Thanks.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think what we mean is "Key query metrics, such as aggregation types, query types, latency, and resource usage per query type, are captured along the search path by using the OpenTelemetry (OTel) instrumentation framework. The telemetry data can be consumed using OTel metrics exporters."

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Agree with @natebower last comment. @kolchfa-aws you can go forward with this change and we can merge this.

_observing-your-data/query-insights/index.md Outdated Show resolved Hide resolved
_observing-your-data/query-insights/query-metrics.md Outdated Show resolved Hide resolved
_observing-your-data/query-insights/query-metrics.md Outdated Show resolved Hide resolved
_observing-your-data/query-insights/query-metrics.md Outdated Show resolved Hide resolved
_observing-your-data/query-insights/query-metrics.md Outdated Show resolved Hide resolved
_observing-your-data/query-insights/query-metrics.md Outdated Show resolved Hide resolved
_observing-your-data/query-insights/query-metrics.md Outdated Show resolved Hide resolved
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Copy link
Collaborator

@natebower natebower left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@deshsidd @kolchfa-aws LGTM with one pending suggestion. Thanks!

_observing-your-data/query-insights/query-metrics.md Outdated Show resolved Hide resolved
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
@kolchfa-aws kolchfa-aws merged commit d4bbdd9 into opensearch-project:main Jul 31, 2024
5 checks passed
@hdhalter hdhalter added 3 - Done Issue is done/complete and removed 4 - Doc review PR: Doc review in progress labels Aug 1, 2024
mingshl pushed a commit to mingshl/documentation-website that referenced this pull request Aug 2, 2024
…rch-project#7846)

* Add documentation for query insigts - query metrics feature

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Address auto comments

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Fix dead link

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Address auto comments

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Doc review

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Apply suggestions from code review

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Update _observing-your-data/query-insights/query-metrics.md

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Update _observing-your-data/query-insights/query-metrics.md

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

---------

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Fanit Kolchina <kolchfa@amazon.com>
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - Done Issue is done/complete release-notes PR: Include this PR in the automated release notes v2.16.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[DOC] Query categorization for query insights plugin
5 participants