nash/corpus/DIVERGENCES.md

nash ↔ bash divergence log

Live record of behavioral divergences found by the replay harness (replay.py, corpus in corpus.jsonl). Per docs/NASH.md §10.3/§11, each entry stays open until fixed in the fork (or upstream) and re-verified by the corpus.

Open

D2 — non-ASCII bytes re-encoded through read/echo under C/empty locale

• Found: narOS N0 rootfs validation (first real-world install run under the divert): with /bin/sh → nash, ca-certificates' postinst (update-ca-certificates, a while read-over-conf loop) mangled the UTF-8 filename NetLock_Arany_=Class_Gold=_Főtanúsítvány.crt and failed the whole image build. Worked around structurally in os/mkimage/build-rootfs.sh (the divert is now always the image's last configure step), but any runtime apt install inside narOS still runs postinsts under nash, so this blocks narOS/M3 forcing gates until fixed.
• Repro (nash 0.4.0 musl arm64, empty locale): echo 'Főtanúsítvány' | nash -c 'while read x; do echo "$x"; done' — bash emits the input bytes unchanged (F \305\221 t a n \303\272 …); nash emits each byte Latin-1→UTF-8 double-encoded (F \303\205 \302\221 …).
• Suspected root cause: brush decodes input bytes to String with a lossy/ Latin-1 assumption on the read path (or at word-splitting) instead of keeping raw bytes; on output the char sequence is re-encoded as UTF-8. POSIX shells treat variable values as byte strings.
• Severity: silent data corruption (not a parse failure, so the §4.1 bash-fallback cannot catch it). Needs a corpus case (utf8-bytes-passthru) and a byte-preservation sweep of read/expansion/heredoc paths.

Closed

D1 — IFS word-splitting applied to literal words (fixed in fork)

• Found: M0 corpus run (ifs-split), brush-shell-v0.4.0.
• Repro: IFS=,; set -- a,b,c; echo $1 → bash a b c, nash a.
• Root cause: brush applied IFS splitting to literal words, not just expansion results: under IFS=,, echo a,b,c printed a b c (bash: a,b,c) and set -- a,b,c received 3 args (bash: 1). POSIX/bash split only the results of parameter/command/arithmetic expansion. Mechanically, brush-core/src/expansion.rs had a two-state ExpansionPiece (Splittable/Unsplittable) conflating "field-splittable" with "glob-active", and literal text was marked Splittable.
• Fix: added a third piece state LiteralText (never field-split, glob chars active) and produce it for unquoted literal text, the no-expansion-chars fast path, and retained-backslash escapes (// nash: markers in expansion.rs). Corpus back to 100% (94/94); candidate for upstreaming.
• Regression tests: corpus ifs-split (+ glob-all, glob-txt, cond-pattern, case guard the glob/pattern side); brush compat suite.
• Fix fallout (caught by the brush compat suite, both fixed): (a) text substituted by ${v:-word}/${v:+word}/${v:=word} is an expansion result and must split — restored via a boundary conversion in the ParameterExpansion arm; (b) compgen -W splits its word-list string as data — restored via ExpanderOptions.field_split_literal_text. Final suite: 1684 succeeded / 6 failed, failure set identical to the pristine-brush baseline in this container (environmental only); 3 upstream known-fail IFS tests now pass (markers flipped in ifs.yaml).