Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Store: Panic in github.com/improbable-eng/thanos/pkg/store.(*lazyPostings).Next #462

Closed
jdfalk opened this issue Aug 6, 2018 · 4 comments

Comments

@jdfalk
Copy link
Contributor

jdfalk commented Aug 6, 2018

Thanos, Prometheus and Golang version used
thanos, version 0.1.0-rc.2 (branch: HEAD, revision: ecfce89)
build user: jenkins@build
build date: 20180727-15:58:10
go version: go1.10.3

What happened
Thanos store crashes with panic: runtime error: invalid memory address or nil pointer dereference

What you expected to happen
Thanos store to not crash

How to reproduce it (as minimally and precisely as possible):

Full logs to relevant components
thanos-store-panic.log

Anything else we need to know:

Environment:

  • OS (e.g. from /etc/os-release): CentOS Linux 7 (Core)
  • Kernel (e.g. uname -a): 3.10.0-862.3.3.el7.x86_64
  • Others:
@wleese
Copy link
Contributor

wleese commented Aug 16, 2018

I was able to reproduce this only briefly. At the time I was querying 7 days of non-compacted data (that is, the compactor wasn't enabled). The crashes only seemed to happen in the early lifetime of a thanos store process - once thanos store was running and failed to crash, it'd be solid. Most times it crashed within minutes of startup+querying.
Sorry for the vague information. If there's anything I can add I will.

@bwplotka
Copy link
Member

Dup of #335

@bwplotka
Copy link
Member

But still, more info = better (:

@bwplotka
Copy link
Member

(closing because of duplication)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants