Code

Add Whisper language detection#1097

Code

Open

ae9is wants to merge 7 commits intohuggingface:mainhuggingface/transformers.js:mainfrom ae9is:add-whisper-language-detectionae9is/transformers.js:add-whisper-language-detectionCopy head branch name to clipboard

+252-30

Commits

Commits on Dec 16, 2024

• Add language detection support with Whisper tasks

  ae9is

  committed
  242d33c

  Copy full SHA for 242d33c

• Add tests for Whisper language detection

  ae9is

  committed
  467851a

  Copy full SHA for 467851a

• Add test utility to compare string similarity

  ae9is

  committed
  88bba08

  Copy full SHA for 88bba08

• Quality check output for some Whisper pipeline tests

  ae9is

  committed
  fc56bdc

  Copy full SHA for fc56bdc

• Add a new logits processor to only generate allowed token IDs

  ae9is

  committed
  7cd642c

  Copy full SHA for 7cd642c

• Improve Whisper language detection performance

  ae9is

  committed
  ecdd598

  Copy full SHA for ecdd598

• Fix Whisper language detection pipeline test

  ae9is

  committed
  db84540

  Copy full SHA for db84540