Skip to content

Commit

Permalink
fix the bug of tokenizer
Browse files Browse the repository at this point in the history
  • Loading branch information
hitoshizuku7 committed Nov 29, 2023
1 parent 53c12d7 commit fd20c5a
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion llm_judge/gen_model_answer.py
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ def generate_response(
generation_config (Optional[dict]): Generation config.
special_token_map (Optional[dict]): Special token map used to replace special tokens.
"""
inputs = tokenizer(input_text, return_tensors="pt", add_special_tokens=False, return_token_type_ids=False )
inputs = tokenizer(input_text, return_tensors="pt", add_special_tokens=False, return_token_type_ids=False)
inputs = inputs.to(model.device)

input_token_ids = inputs["input_ids"]
Expand Down

0 comments on commit fd20c5a

Please sign in to comment.