fangorn/ex_git_objectstore
public
feat(lfs): raise FastCDC minimum chunk size 2 KiB → 4 KiB #71
Links
No links yet.
LFS targets large files; chunks smaller than the common 4 KiB disk-allocation block add manifest overhead and waste an allocation unit without buying dedup granularity. Raise MinSize from 2 KiB to 4 KiB (avg 8 KiB / max 64 KiB unchanged) in both the Elixir server chunker and the git-lfs Go client, regenerate the shared golden vector + cross-impl corpus from a single source, and re-verify Go↔Elixir agreement. Refines #67/#68.
cole.christensen@gmail.com
commented 2026-06-19 04:37
Delivered on feat/lfs-chunking (PR #43).
- Server:
132cf11—@default_min2 KiB → 4 KiB; regenerated golden vector (1 MiB 115→110 chunks) and cross-impl corpus from the live generator; added 4095/4097 boundary cases; regenerated perf metrics. - Client (fork):
f1576f0d—MinSize4 KiB; same golden/corpus regen; docs updated.
Verification: Go tools/fastcdc + tq green; Elixir LFS suite green incl. golden + 25-case fixture-sync; real-binary chunked interop/compat E2E 5/5 (forked client ↔ Elixir server at 4 KiB); full Elixir suite 1080 passed. Go↔Elixir boundary agreement re-verified byte-for-byte.