38-EFT.WP.EDX.EMI v1.0 | Appendix C. Dataset Cards & Pipeline Cards

Home ／ Docs-Technical WhitePaper ／ 38-EFT.WP.EDX.EMI v1.0

Appendix C. Dataset Cards & Pipeline Cards

I. Purpose & Coverage (Mandatory)

1. Define the EDX.EMI Dataset Card (v1.0) and Pipeline Card (v1.0) fields, templates, and checks, covering acquisition/simulation/field-site → port/mixed-mode normalization → S↔Z → phase/path correction → radiation equivalence (ΔZ_rad / P_rad) → field conversion (E/H) → common-mode currents → KPIs → export/release.
2. Unified arrival dialect (two equivalent forms; path/measure explicit; record delta_form):
   • Constant-factored: T_arr = ( 1 / c_ref ) * ( ∫ n_eff d ell )
   • General: T_arr = ( ∫ ( n_eff / c_ref ) d ell )
3. SI units; hard gates: check_dim = pass, Re{Z_eft} ≥ 0, KK_consistency = pass, Re{ΔZ_rad} ≥ 0, two-dialect T_arr agreement, corr(P_rad,E/H) ≥ ρ_gate (suggest ρ_gate ≥ 0.8).

II. Naming & Versioning

• dataset_id / pipeline_id: EDXEMI-[topic]-[index] (e.g., EDXEMI-001, EDXEMI-PIPE-001).
• Versioning: semver (e.g., 1.0.0); each artifact & major input file carries a sha256.
• Fingerprints: created_at (ISO 8601), toolchain, env_lock.

III. Dataset Card (v1.0, EMI field set)

Minimal template (copy-ready)

dataset_card:

dataset_id: "EDXEMI-001"

version: "1.0.0"

source: "field-site"

instruments:

- {type:"VNA", model:"—", cal:"2025-08-01"}

- {type:"EMI_receiver", detector:"qpk", if_bw_kHz:120, time_const_ms:1.0}

- {type:"antenna", AF_file:"/cal/AF_3m.yaml", version:"2025.1"}

- {type:"LISN", spec:"5µH CM", version:"v2.0"}

deemb: {method:"TRL", version:"1.2", artifact:"/artifacts/deemb.json", baseline_id:"BLSN-EMI-001"}

sync: {ref:"10MHz", scheme:"shared_ref+trigger", dt_sync_s: 2.0e-12}

binding_ref: "LAY2PATH-EMI-0001"

arrival:

form: "n_over_c" # or "one_over_c_times_n"

gamma: "explicit"

measure: "d_ell"

c_ref: 299792458.0

Tarr_s: 1.234e-09

u_Tarr_s: 6.0e-12

delta_form: "n_over_c"

Znorm_ohm: [50.0, 50.0]

sparams: "/artifacts/S.s2p"

mixed_mode:

enabled: true

T_mm: "/cfg/T_mm.yaml"

Z0_mm_ohm: [100.0, 25.0]

impedance:

Z_eft: {real:[...], imag:[...]}

deltaZ_rad: {Re_ohm:[...], Im_ohm:[...]} # Re ≥ 0

I_port_A: [ ... ]

P_rad_W: [ ... ]

fields:

site: {distance_m: 3.0, coords:"...", AF_file:"/cal/AF_3m.yaml", PF_file:"/cal/PF.yaml"}

E_rad_peak_dBuV_m: [ ... ]

H_rad_peak_dBA_m: [ ... ]

currents:

I_CM_A: [ ... ]

HF_KPI:

E_phase_rad: 0.043

GDR_s: 1.8e-10

ΔW: 0.17

qa_gates: {check_dim:"pass", passivity:"pass", KK:"pass"}

hashes:

files:

- {path:"/artifacts/S.s2p", sha256:"..."}

- {path:"/artifacts/deemb.json", sha256:"..."}

created_at: "2025-09-16T10:00:00Z"

toolchain: {simstack_emi:"1.0.0", kernels:"0.9.3"}

IV. Pipeline Card (v1.0) & Env Lock (v1.0)

• Standard stages: ingest → align(I30-EMI) → deembed/renorm → s2z(I40-EMI) → sync_corr → path_correct → rad_equiv(P_rad) → field_conv(E/H) → kpi_eval(Ω) → export(cards).
• Env-lock: record OS/interpreter/dependencies/container digest & hardware; unified units; provide RNG seeds.

pipeline_card:

pipeline_id: "EDXEMI-PIPE-001"

version: "1.0.0"

steps:

- {id:"ingest", cmd:"load_sparams --input /artifacts/S.s2p"}

- {id:"align", cmd:"map_ports --binding LAY2PATH-EMI-0001"}

- {id:"deembed", cmd:"deembed --fixture /artifacts/deemb.json --baseline BLSN-EMI-001"}

- {id:"renorm", cmd:"renorm --znorm Znorm.yaml --tmm /cfg/T_mm.yaml --z0mm Z0_mm.yaml"}

- {id:"s2z", cmd:"map_S_to_Z --mode mixed"}

- {id:"sync_corr", cmd:"phase_corr --dt_sync_s 2.0e-12"}

- {id:"path_correct", cmd:"pathfix --binding LAY2PATH-EMI-0001"}

- {id:"rad_equiv", cmd:"z2prad --zbase Z_base.npy"}

- {id:"field_conv", cmd:"prad2field --af /cal/AF_3m.yaml --pf /cal/PF.yaml --dist 3.0"}

- {id:"kpi_eval", cmd:"kpi --omega ω1,ω2 --gates gates.yaml"}

- {id:"export", cmd:"export_cards --out /release"}

env_lock:

os: {name:"Ubuntu", version:"22.04"}

interpreter: {name:"Python", version:"3.11.6"}

packages:

- {name:"numpy", version:"1.26.4", hash:"sha256:..."}

- {name:"scipy", version:"1.13.1", hash:"sha256:..."}

- {name:"pandas", version:"2.2.2", hash:"sha256:..."}

container: {image:"registry/edxemi:1.0.0", digest:"sha256:..."}

hardware: {cpu:"x86_64", gpu:"none", ram_GB:32}

seeds: {global: 20250916}

V. QA Gates & Consistency Checks (unified)

qa_gates:

check_dim: "pass"

passivity: "pass" # min(Re{Z_eft}) ≥ 0

KK: "pass"

Tarr_dual:

diff_s: 3.0e-12 # |T_arr (two dialects) difference|

u_Tarr_s:6.0e-12

pass: true

power_field:

rho_E: 0.90

rho_H: 0.88

rho_gate: 0.80

pass: true

VI. Audit Trail & Release Manifest (templates)

audit_manifest:

run_id: "RUN-2025-09-16-001"

toolchain: {simstack_emi:"1.0.0", kernels:"0.9.3"}

diffs: {params_changed:["Ks_tau"], reason:"tuning within prior"}

seeds: {global: 20250916}

qa:

check_dim: "pass"

passivity: "pass"

KK: "pass"

logs: "/logs/run_001.txt"

release_manifest:

normative_refs: ["EFT.WP.Core.DataSpec v1.0","Methods.Repro v1.0"]

artifacts:

- "/release/dataset_card.yaml"

- "/release/pipeline_card.yaml"

- "/release/env_lock.yaml"

- "/release/audit_manifest.yaml"

hashes:

dataset_card: "sha256:..."

pipeline_card: "sha256:..."

env_lock: "sha256:..."

audit: "sha256:..."

VII. Equivalence & Repro Metrics (thresholds & pseudocode)

equivalence_gates:

eps_Z_gate: 0.05

eps_phi_gate: 0.05 # rad

eps_PrE_gate: 0.20 # 1 − corr(P_rad,E)

eps_PrH_gate: 0.20 # 1 − corr(P_rad,H)

eps_ICM_gate: 0.20 # 1 − corr(I_CM, Re{ΔZ_rad})

eps_ΔW_gate: 0.10

rho_gate: 0.80

# 1) Two-dialect T_arr agreement

T1 = (1/c_ref) * sum(n_eff[i]*Δell[i])

T2 = sum((n_eff[i]/c_ref) * Δell[i])

assert abs(T1 - T2) <= u_Tarr

# 2) Port/field consistency

Z = map_S_to_Z(S_ren, Znorm(ω))

ΔZ_rad = Z - Z_base

assert min(Re(ΔZ_rad)) >= 0.0 and KK_consistency(Z)

P_rad = 0.5 * Re(ΔZ_rad) * abs(I_port)**2

ρE, ρH = corr(P_rad, E_env), corr(P_rad, H_env)

assert ρE >= ρ_gate and ρH >= ρ_gate

# 3) KPIs & ΔW

phi = unwrap(argZ - ω*Δt_sync)

E_phase = max_abs(phi - (ω*Tarr + φ0_opt))

eps_dW = max_over_ω(abs(ΔW_rep - ΔW_pub))

# 4) Equivalence thresholds

eps_Z = max_abs(Z_rep - Z_pub) / max_abs(Z_pub)

eps_phi = max_abs(phi_rep - phi_pub)

eps_PrE = 1 - corr(P_rad_rep, E_env_pub)

eps_PrH = 1 - corr(P_rad_rep, H_env_pub)

eps_Icm = 1 - corr(I_CM_rep, Re(ΔZ_rad)_pub)

assert all([eps_Z<=ε_Z_gate, eps_phi<=ε_φ_gate, eps_PrE<=ε_PrE_gate,

eps_PrH<=ε_PrH_gate, eps_Icm<=ε_ICM_gate, eps_dW<=ε_ΔW_gate])

VIII. Suggested Release Directory Layout

/release/

dataset_card.yaml

pipeline_card.yaml

env_lock.yaml

audit_manifest.yaml

qa_report.json

artifacts/

deemb.json

S.s2p

Z_eft.npy

deltaZ_rad.npy

P_rad.npy

E_env.npy

H_env.npy

aligned.parquet

IX. Error Codes (Unified Returns)

errors:

E_BAD_UNITS: "Unit or dimensional mismatch"

E_KK_FAIL: "K–K consistency failed"

E_PASSIVITY: "Passivity failed (Re{Z}<0)"

E_BINDING_MISSING: "Missing binding_ref or path segments"

E_DELTA_FORM_MISSING: "Arrival delta_form not recorded"

E_TARR_MISMATCH: "Two-dialect T_arr mismatch"

E_EQUIV_FAIL: "Equivalence thresholds not met"

E_ENVLOCK_FAIL: "Env-lock reconstruction failed or fingerprint mismatch"

E_QA_FAIL: "QA gate failed"

X. Compliance Bundle (one-shot, copy-ready)

dataset_card: { ... per §III template ... }

pipeline_card: { ... per §IV template ... }

env_lock: { ... per §IV template ... }

qa_gates: { ... per §V template ... }

audit_manifest: { ... per §VI template ... }

release_manifest:

normative_refs: ["EFT.WP.Core.DataSpec v1.0","Methods.Repro v1.0"]

artifacts: ["/release/dataset_card.yaml","/release/pipeline_card.yaml","/release/env_lock.yaml","/release/audit_manifest.yaml"]

hashes: {dataset_card:"sha256:...", pipeline_card:"sha256:...", env_lock:"sha256:...", audit:"sha256:..."}

equivalence_gates: {eps_Z_gate:0.05, eps_phi_gate:0.05, eps_PrE_gate:0.20, eps_PrH_gate:0.20, eps_ICM_gate:0.20, eps_ΔW_gate:0.10, rho_gate:0.80}

XI. Release Hard Gates (Summary)