Skip to content

Commit

Permalink
fix hidden states and scores not being returned
Browse files Browse the repository at this point in the history
  • Loading branch information
nightingal3 committed Jul 9, 2023
1 parent fcc523d commit ccded32
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion llm_client/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,7 @@ def prompt(
Returns:
"""
if isinstance(text, str):
return self.prompt([text], max_new_tokens, **kwargs)
return self.prompt([text], max_new_tokens, output_scores, output_hidden_states, **kwargs)

# TODO: Check for max length limit to avoid OOMs

Expand Down

0 comments on commit ccded32

Please sign in to comment.