Skip to content

Commit

Permalink
fix: remove argument that does not exist (#23)
Browse files Browse the repository at this point in the history
  • Loading branch information
andre-mostly authored Feb 4, 2025
1 parent a225b66 commit 55611ba
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion mostlyai/engine/_language/engine/vllm_engine.py
Original file line number Diff line number Diff line change
Expand Up @@ -108,7 +108,6 @@ def __init__(
# enforce_eager=True, # results in big slowdown, but is needed when running pytest locally
swap_space=0,
disable_log_stats=True,
disable_log_requests=True,
)
self._base_logits_processors = [MaskInvalidIndicesLogitsProcessor(self.llm.get_tokenizer())]
self.tokenizer = AutoTokenizer.from_pretrained(
Expand Down

0 comments on commit 55611ba

Please sign in to comment.