Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Session crashes when loading RerankingParser.from_unified_model_dir() #70

Open
pythonista0801 opened this issue Jul 14, 2022 · 1 comment

Comments

@pythonista0801
Copy link

I have installed NegBio, bllipparser with pip and imported the required modules including NegBioParser and RerankingParser.
However, when I try to load parser = NegBioParser() the session crashes on the line rrp = RerankingParser.from_unified_model_dir(self.model_dir), the reason in logs was first NO CUDA detected. I fixed it and switched to GPU runtime. After loading all dependencies and parsers, the session crashed again... it gives no message what's wrong, I can just see some logs such as :
gzip: stdout: Broken pipe.
OR
2022-07-13 17:54:43.937715: W tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:39] Overriding allow_growth setting because the TF_FORCE_GPU_ALLOW_GROWTH environment variable is set. Original config value was 0.
and then
Kernel restarted

@dmcc
Copy link
Member

dmcc commented Jul 14, 2022

Interesting! (I wasn't aware NegBio was using BLLIP Parser, but that's cool to hear)

Looks like this is the same bug as ncbi-nlp/NegBio#52 -- my guess is that it's due to some interaction between the two projects and unfortunately I don't know much about the internals of NegBio. (BLLIP Parser was built way before there were GPU accelerators so there could easily be some issues with that? That could also be a red herring.)

Unless BLLIP Parser is busted (I just did a fresh install and it seems to work?) I suspect this issue is more on the NegBio side, I'm afraid, but either way more investigation will be needed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants