Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hi, I find: there maybe are some redundancy in the questions. Is it right ? #3

Open
simba0626 opened this issue May 30, 2019 · 3 comments

Comments

@simba0626
Copy link

For example: Who produced the film 12 Angry Men, which was scripted by Reginald Rose, starred Henry Fonda and was directed by Sidney Lumet?

Annotation information:
"TopicEntityName": "12 angry men",
"TopicEntityMid": "m.0m_tj",
"InferentialChain": "film.film.produced_by",

the text "which was scripted by Reginald Rose, starred Henry Fonda and was directed by Sidney Lumet?" is redundancy, is it all right ?

Thank you for your help.

@kelvin-jiang
Copy link
Owner

Hi there,

These questions were pulled from trivia datasets and sites; trivia questions are sometimes designed to have multiple clues to make it easier for contestants to answer. That is the case here, but our Freebase triples can only represent one of these clues, which in this case was the "Who produced the film" part of the question.

Kelvin

@simba0626
Copy link
Author

Hi, thank you for your reply.
On this data, I have two confusions, which need your help:
Firstly, I think machine maybe hardly understands which clue is useful, unless try every clue based on the schema of freebase.
Secondly, even though machine does not understand the whole question, it can solve partial questions. For example, random one clue in multiple clues.
I do not know whether these I understand are right or not.

yawei

@kelvin-jiang
Copy link
Owner

I'm not sure if I understand your questions, but I will try to answer them as best as I can:
Regarding your first point, if you train a KBQA pipeline, you will likely have to train a relation detection model at some point in order to choose a clue.
Regarding your second point, it is possible that what you said is correct: since the questions of FreebaseQA are more complicated and sometimes have multiple clues, there may be multiple "ways" to get to the correct answer.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants