Skip to content

r8: IPA auxiliary-task experiment (phonological-layer claim, controlled) - #57

Open
ronaldtse wants to merge 4 commits into
sota-sprint-arabicfrom
exp/r8-ipa-aux-clean
Open

r8: IPA auxiliary-task experiment (phonological-layer claim, controlled)#57
ronaldtse wants to merge 4 commits into
sota-sprint-arabicfrom
exp/r8-ipa-aux-clean

Conversation

@ronaldtse

@ronaldtse ronaldtse commented Aug 26, 2026

Copy link
Copy Markdown
Contributor

Summary

Replaces #56 (accidentally targeted main while carrying sprint-branch commits; that one is closed).

  • arabic_to_ipa.py — deterministic diacritized-Arabic → broad-phonemic IPA converter (rule-based; sun-letter assimilation, shadda gemination, long vowels, tanwin carriers, dagger-alaf lengthening; approximations documented). Verified on canonical phrases (ʔasːalaːmu ʕalajkum, kitaːbun mufiːdun, marħaban, ʔaʃːamsu tˤaːliʕatun, …), 20K units/s
  • train_arabic_r8.py — the phonological-layer claim made controlled: r6's two-format multitask recipe with ONLY the auxiliary content changed (qalsadi morph tags → IPA of the same r5-units text, seeded ~25% aux share, init from r5, batch 2/accum 15, 1 epoch, A100-80GB). Same harness, hyperparams, and init as r6 — isolates the phonemic representation as the single variable
  • Baselines: r5 2.6775 / r6 (morph aux) 2.5793 windowed DER; r8 additionally reports an IPA-stream CER/EM probe (second-projection capability)
  • Run live on Modal (r8-ipa-aux, app ap-ONuWKBrB7zfHUerMCM8Rx7)

CI note: based on sota-sprint-arabic (where the experiment lives) rather than mainmain's lint/build jobs are red on the legacy python/arabic / python/hebrew trees independent of this change; the sprint branch carries the green tree. Rebase to main together with the sprint branch when it merges.

Test plan

  • converter smoke test + throughput
  • launch confirmed, data loading
  • results land in rababa_checkpoints:/rababa_arabic_byt5/run-008-ipa (windowed DER + IPA probe printed at completion, EVAL_DONE marker)

@ronaldtse
ronaldtse changed the base branch from main to sota-sprint-arabic August 26, 2026 09:06
@ronaldtse
ronaldtse force-pushed the exp/r8-ipa-aux-clean branch from 0683edb to 3ace31b Compare August 27, 2026 02:22
@ronaldtse

Copy link
Copy Markdown
Contributor Author

CI note: all six failing jobs fail identically on the base branch itself (sota-sprint-arabic @ bef1538: python/ruby/codeql all red; lint's 22 errors are all in legacy python/arabic/… and python/hebrew/… files this PR does not touch). This PR adds three new standalone scripts (arabic_to_ipa.py, train_arabic_r8.py, label_arabic_news.py spawn patch). It will merge once the base branch CI is repaired — not before.

…al); r7 entrypoint spawn

r8 differs from r6 in exactly one variable (aux stream renders the same
r5-units as broad-phonemic IPA instead of morphology). Result on the full
1,200-paragraph windowed zero-skip harness: r8 2.6588/1.5783 vs r6
2.5793/1.5317 vs r5 2.6775/1.5965. IPA-stream probe CER 0.0230 (EM
62/200) proves the second projection was learned — the comparison is not
confounded by a failed aux task. Phonemic supervision is not the active
ingredient; lexical-morphological knowledge is. r6 stays the teacher.

r7 (news-domain) launched init from run-006-morph; entrypoint switched to
spawn() (the r8 disconnect lesson). 19,716 steps ETA ~15.7h.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant