Skip to content

Commit 269f965

Browse files
committed
[misc] remove deprecated call to end_forward in flashinfer backend
Signed-off-by: Bowen Wang <[email protected]>
1 parent 24a3d12 commit 269f965

File tree

1 file changed

+0
-2
lines changed

1 file changed

+0
-2
lines changed

vllm/attention/backends/flashinfer.py

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -356,7 +356,6 @@ def begin_forward(self):
356356
self.block_table_bound = self.block_table_bound.to(self.device)
357357
self.seq_lens_tensor = self.seq_lens_tensor.to(self.device)
358358
self.paged_kv_indices = self.paged_kv_indices.to(self.device)
359-
self.prefill_wrapper.end_forward()
360359
self.prefill_wrapper.begin_forward(
361360
self.query_start_loc,
362361
self.paged_kv_indptr[:self.num_prefills + 1],
@@ -379,7 +378,6 @@ def begin_forward(self):
379378
self.seq_lens_tensor = self.seq_lens_tensor.to(self.device)
380379

381380
assert self.decode_wrapper is not None
382-
self.decode_wrapper.end_forward()
383381
self.decode_wrapper.begin_forward(
384382
self.paged_kv_indptr[self.num_prefills:],
385383
self.paged_kv_indices,

0 commit comments

Comments
 (0)