ArXiv

PHAST-Net: Attention-Guided, Physics-Informed Network for Unified Estimation of Ideal Time-Frequency Representations

Authors
James M. Cozens, Simon J. Godsill
Categories
eess.AS, cs.CV
arXiv
https://arxiv.org/abs/2606.23665v1
PDF
https://arxiv.org/pdf/2606.23665v1

Brief

PHAST-Net presents an attention-guided, physics-informed network that maps a selected constellation of Continuous Log-frequency Adaptive Wavelet Transforms (CLAWT) to unified Ideal Time-Frequency Representations (ITFRs). It uses Cohen's-class kernel analysis to choose CLAWTs, a reprojection loss to enforce transform consistency and energy conservation, and attention for cross-term suppression. Variants include Harmonic PHAST-Net and Spline-PHAST-Net; the abstract reports improved accuracy versus prior methods. Summary based on the paper abstract; full text was not reviewed.

Why it matters

PHAST-Net (Cozens & Godsill; arXiv 2026-06-22) learns an application-general mapping from a constellation of Continuous Log-frequency Adaptive Wavelet Transforms (CLAWT) to high-resolution, cross-term-suppressed Ideal Time-Frequency Representations (ITFRs) including Spectrograms, Tempograms, and Metrograms.

Key details

  • Training includes a physics-informed auxiliary reprojection loss that reconstructs the observed CLAWT constellation from the predicted ITFR and the corresponding Cohen's-class kernels, enforcing transform consistency, energy conservation, and more stable optimization; attention layers further improve cross-term suppression.
  • Two extensions are introduced: Harmonic PHAST-Net for fundamental-only (harmonic) ITFRs and Spline-PHAST-Net which parameterizes detected time–frequency ridges as continuous spline trajectories for arbitrary-grid re-rendering and reconstruction; the model was trained on an effectively unbounded procedurally generated dataset and 'demonstrates improved accuracy over established approaches' (no numeric metrics in abstract).
Source evidence

Abstract

We introduce PHAST-Net, an attention-guided, physics-informed network for unified estimation of Ideal Time-Frequency Representations (ITFRs), spanning spectral, tempo-based, metrical, and harmonic representations such as Spectrograms, Tempograms, and Metrograms. PHAST-Net learns an application-general mapping from a constellation of wavelet transforms, the proposed Continuous Log-frequency Adaptive Wavelet Transform (CLAWT), to high-resolution, cross-term-suppressed time-frequency (T-F) representations. The proposed constellation of CLAWTs is selected through Cohen's class kernel analysis to maximise curvature coverage in a logarithmic-frequency T-F plane tailored to harmonic signal structure. PHAST-Net further incorporates a proposed physics-informed auxiliary reprojection loss designed to reconstruct the idealised observed CLAWT constellation from the predicted ITFR and the corresponding Cohen's class kernels during training. This auxiliary objective promotes transform consistency and energy conservation, mitigates pathological target sparsity, and enhances optimisation stability. Attention layers further promote effective cross-term suppression across the input constellation. The log-frequency formulation also enables Harmonic PHAST-Net, which estimates a Harmonic ITFR that isolates fundamental structure, supporting robust fundamental-only representations for speech and music, such as derived fundamental Tempograms and Metrograms. We further introduce Spline-PHAST-Net, which parameterises detected and associated T-F ridges as continuous spline trajectories, enabling arbitrary-grid re-rendering and signal reconstruction. Trained on an effectively unbounded procedurally generated dataset, PHAST-Net demonstrates improved accuracy over established approaches, providing a unified framework for high-resolution, cross-term-robust analysis of speech, music, and broader nonstationary signals.