Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

APM telemetry for aggregated transactions #71593

Closed
smith opened this issue Jul 14, 2020 · 1 comment · Fixed by #71594
Closed

APM telemetry for aggregated transactions #71593

smith opened this issue Jul 14, 2020 · 1 comment · Fixed by #71594
Assignees
Labels
Team:APM All issues that need APM UI Team support v7.9.0

Comments

@smith
Copy link
Contributor

smith commented Jul 14, 2020

Add telemetry for aggregated transactions. I'd like to record the number of metric documents we can expect with the current implementation. We can simulate this by requesting data for 1m, adding a composite aggregation on a number of fields and counting the number of buckets. The resulting count will be an approximation of the amount of metric documents that will be created. We should record both the expected metric document count plus the transaction count for that time range.

I'd like to record several combinations:

  • current_implementation: observer.name, transaction.name, transaction.result, transaction.type, agent.name, service.environment, service.version, host.hostname, container.id, kubernetes.pod.name, user_agent.name
  • no_observer_name: transaction.name, transaction.result, transaction.type, agent.name, service.environment, service.version, host.hostname, container.id, kubernetes.pod.name, user_agent.name
  • no_rum: observer.name, transaction.name, transaction.result, transaction.type, agent.name, service.environment, service.version, host.hostname, container.id, kubernetes.pod.name (add a filter to exclude RUM data)
  • no_rum_no_observer_name: observer.name, transaction.name, transaction.result, transaction.type, agent.name, service.environment, service.version, host.hostname, container.id, kubernetes.pod.name (add a filter to exclude RUM data)
  • only_rum: observer.name, transaction.name, transaction.result, transaction.type, agent.name, service.environment, service.version, host.hostname, container.id, kubernetes.pod.name, user_agent.name (add a filter to exclude all non-RUM data)
  • only_rum_no_observer_name: transaction.name, transaction.result, transaction.type, agent.name, service.environment, service.version, host.hostname, container.id, kubernetes.pod.name, user_agent.name (add a filter to exclude all non-RUM data)

I'd also like to record the cardinality of client.geo.country_iso_code separately. (This is done in #71112.)

For an example of how to create the composite aggregation and paginate through the buckets, see scripts/aggregate-latency-metrics/index.ts.

(this description is copied from what @dgieselaar wrote on #71112. Making a separate issue so it can be done in a separate PR.)

@smith smith added Team:APM All issues that need APM UI Team support v7.9.0 labels Jul 14, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/apm-ui (Team:apm)

@zube zube bot assigned smith Jul 14, 2020
smith added a commit to smith/kibana that referenced this issue Jul 16, 2020
Add a task to gather transasctions telemetry as described in elastic#71593.

Also:

* Fix typo in mapping for country code mapping
* Add back `mergeTelemetryMapping` function to fix broken `upload-telemetry-data` script.
smith added a commit that referenced this issue Jul 16, 2020
Add a task to gather transasctions telemetry as described in #71593.

Also:

* Fix typo in mapping for country code mapping
* Add back `mergeTelemetryMapping` function to fix broken `upload-telemetry-data` script.
smith added a commit to smith/kibana that referenced this issue Jul 16, 2020
Add a task to gather transasctions telemetry as described in elastic#71593.

Also:

* Fix typo in mapping for country code mapping
* Add back `mergeTelemetryMapping` function to fix broken `upload-telemetry-data` script.
smith added a commit to smith/kibana that referenced this issue Jul 16, 2020
Add a task to gather transasctions telemetry as described in elastic#71593.

Also:

* Fix typo in mapping for country code mapping
* Add back `mergeTelemetryMapping` function to fix broken `upload-telemetry-data` script.
smith added a commit that referenced this issue Jul 16, 2020
Add a task to gather transasctions telemetry as described in #71593.

Also:

* Fix typo in mapping for country code mapping
* Add back `mergeTelemetryMapping` function to fix broken `upload-telemetry-data` script.

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
smith added a commit that referenced this issue Jul 17, 2020
Add a task to gather transasctions telemetry as described in #71593.

Also:

* Fix typo in mapping for country code mapping
* Add back `mergeTelemetryMapping` function to fix broken `upload-telemetry-data` script.

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Team:APM All issues that need APM UI Team support v7.9.0
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants