Skip to content
View bginies's full-sized avatar

Highlights

  • Pro

Organizations

@RandRVQ @Soft-Disentangled-Codec @Harmonic-Percussive-Bandwidth-Extension @Multi-Rate-BWE-by-Token-Completion

Block or report bginies

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
bginies/README.md

Hi, I'm Benoît Giniès 👋

I work on neural audio codecs at LTCI, Télécom Paris, Institut polytechnique de Paris, with Xiaoyu Bie, Olivier Fercoq and Gaël Richard. My research focuses on discrete audio representations: how to quantize them, how to make their tokens interpretable (disentangled along frequency or signal components), and how to use them for tasks such as bandwidth extension.

The code of each paper lives in its own GitHub organization, which I created and own. Each one holds the code and a website with audio examples.

Organization Paper Code Audio examples
Multi-Rate-BWE-by-Token-Completion Multi-rate bandwidth extension by token completion in neural audio codecs. Submitted to ICASSP 2027 Multi-rate-BWE website
Harmonic-Percussive-Bandwidth-Extension Harmonic-Percussive Disentangled Neural Audio Codec for Bandwidth Extension. Under review HP-codecX website
Soft-Disentangled-Codec Soft Disentanglement in Frequency Bands for Neural Audio Codecs. EUSIPCO 2025 Soft-Disentangled-Codec website
RandRVQ Using Random Codebooks for Audio Neural AutoEncoders. EUSIPCO 2024 RandRVQ website

In a few words

  • Multi-rate BWE: bandwidth extension cast as token completion inside a frozen neural audio codec. A single transformer completes the high-band tokens for 8, 16, 24 and 32 kHz inputs, applied to both a spectral-domain codec (SpectroStream) and a waveform-domain codec (DAC).
  • HP-codecX: a neural audio codec disentangled both across frequency (a low-rate branch and a high-rate branch coding the residual) and between harmonic and percussive components, whose tokens are used for bandwidth extension.
  • Soft-Disentangled-Codec: a multi-branch codec where each branch runs at its own sampling rate and encodes the residual of the lower-rate branches, so that its tokens mainly carry the content of one frequency band.
  • RandRVQ: a residual vector quantizer whose last stages use random, untrained codebooks drawn anew at every pass.

These projects reuse code from the Descript Audio Codec implementation.

Popular repositories Loading

  1. bginies bginies Public