Home / Docs-Data Fitting Report / GPT (101-150)
149 | Excess Small-Scale Speckle in 21 cm Imaging | Data Fitting Report
I. Abstract
HERA/LOFAR/MWA imaging and cylindrical spectra jointly show excess small-scale speckle density and an over-steep high-k tail inside the EoR window, beyond “standard model + instrument/ionosphere systematics” baselines. After end-to-end calibration (uv/PSF/deconvolution/coupling/ionosphere/thermal noise), a four-parameter EFT—Path, SeaCoupling, STG, CoherenceWindow—selectively boosts/suppresses contrast in a narrow band (Δν_coh≈9 MHz; Δk≈0.15 h Mpc⁻¹), explaining speckle morphology and statistical over-density while preserving off-band fidelity. Relative to baseline, RMSE improves 0.172→0.121 and χ²/dof 1.42→1.12; speckle over-density +41%→+12%, high-k slope deviation −0.34→−0.11.
II. Phenomenon Overview
- Imaging shows significant over-density of peaks/speckles below a few arcminutes, with correlation lengths shorter than PSF main lobe.
- 2D power has over-deep high-k tail in k_∥≈0.2–0.6 h Mpc⁻¹.
- Structure function S2(r) has notable residuals at r<4′; Minkowski functionals show too many isolated islands (higher Euler characteristic).
- The pattern recurs across fields/seasons; post-LEC significance ~1–1.5σ.
III. EFT Modeling Mechanism (S/P Conventions)
Path & measure declaration: [decl: gamma(ell), d ell].
Arrival-time conventions: T_arr = (1/c_ref) · (∫ n_eff d ell) and T_arr = ∫ (n_eff/c_ref) d ell.
Momentum-space volume: d^3k/(2π)^3.
Baseline→EFT
- Small-scale coherence kernel (Path)
P_21^{EFT}(k_⊥,k_∥) = P_21^{base}(k_⊥,k_∥) · [1 + gamma_Path_21S · J_S · S_coh(k)] · exp[ − (k/k_d)^n ],
J_S = (1/L_ref) ∫_γ η_S(ℓ) dℓ (LOS passability/coherence). - Medium coupling (SeaCoupling)
δT_b^{EFT} ← δT_b^{base} · [1 + alpha_SC_21S · J_S · S_coh(k)]. - Steady rescaling (STG)
O^{EFT} = O^{EFT} · [1 + k_STG_21S · Phi_T], O∈{P_21, S2, peaks}. - Coherence window
S_coh(k) = exp[ − (k − k_0)^2 / (Δk)^2 ] ↔ exp[ − (ν − ν_0)^2 / (Δν_coh)^2 ].
Intuition
Path maps large-scale passability into a small-scale coherence kernel, enhancing speckle clustering probability in a narrow k/ν band; SeaCoupling damps incoherent scatter and suppresses spurious fine structure; STG unifies amplitudes—together reproducing the observed speckle over-density + high-k excess and enabling selective mitigation.
IV. Data, Volume and Methods
Coverage — HERA/LOFAR/MWA imaging slices and cylindrical spectra (deep/shallow; multi-season); calibration/systematics priors (bandpass/reflection, mutual coupling/polarization leakage, ionospheric screens). Simulations/randoms harmonize uv/PSF/ionosphere/noise and calibrate LEC.
Pipeline (Mx)
M01 Harmonize bandpass/reflection removal, coupling/leakage suppression, direction-dependent gain (DDE) calibration; PSF deconvolution and residual modeling.
M02 Targets: speckle peak counts N_patch(>T_thr), S2(r), Minkowski functionals, 2D/cylindrical spectra and bispectrum.
M03 Baseline→EFT: ΛCDM+RSD+IR-resum+instrument response; overlay {gamma_Path_21S, alpha_SC_21S, k_STG_21S, L_coh_21S}; joint likelihood across imaging/power/morphology.
M04 Robustness: hierarchical-Bayesian mcmc + profile likelihood; LOO (array/epoch/field) and stratified (ν, k, LST) fits; LEC correction.
M05 Metrics: RMSE, R2, chi2_per_dof, AIC, BIC, KS_p, speckle_density_excess, highk_slope_bias, S2_residual, minkowski_bias, cross_field_consistency.
Outcome summary — RMSE: 0.172 → 0.121; χ²/dof: 1.42 → 1.12; ΔAIC=-22, ΔBIC=-13; speckle over-density +41% → +12%; Δη_highk: −0.34 → −0.11; S2(r<4′) variance ×0.46; Euler bias +0.21 → +0.06.
Inline flags: 【param:gamma_Path_21S=0.010±0.003】, 【param:k_STG_21S=0.12±0.05】, 【param:L_coh_21S=9.2±2.9 MHz】, 【metric:chi2_per_dof=1.12】.
V. Multi-Dimensional Comparison with Mainstream Models
Table 1 — Dimension Scorecard (full borders; light-gray header)
Dimension | Weight | EFT | Mainstream | Rationale |
|---|---|---|---|---|
Explanatory Power | 12 | 9 | 7 | J_S·S_coh links geometry to small-scale coherence/clustering—unifying “over-density + high-k” |
Predictiveness | 12 | 9 | 7 | Enhancement in k≈0.2–0.6 h Mpc⁻¹, Δν_coh≈8–10 MHz; off-band fidelity |
Goodness of Fit | 12 | 9 | 8 | Imaging/power/morphology all improve jointly |
Robustness | 10 | 9 | 8 | Stable under LOO/binning/LEC and across seasons/fields |
Parametric Economy | 10 | 8 | 7 | Four-parameter minimal overlay, physically falsifiable |
Falsifiability | 8 | 8 | 6 | Parameters → 0 revert to standard + systematics-only explanation |
Cross-scale Consistency | 12 | 9 | 7 | Narrow-band modification; low-k and wedge-out preserved |
Data Utilization | 8 | 9 | 8 | Joint imaging+power+morphology with systematics priors |
Computational Transparency | 6 | 7 | 7 | Reproducible pipeline/priors/covariance |
Extrapolation Ability | 10 | 13 | 8 | Testable with deeper integrations & finer frequency sampling |
Table 2 — Overall Comparison
Model | Total | RMSE | R² | ΔAIC | ΔBIC | χ²/dof | KS_p | Key Small-Scale Metrics |
|---|---|---|---|---|---|---|---|---|
EFT | 90 | 0.121 | 0.85 | -22 | -13 | 1.12 | 0.31 | over-density +12%; Δη_highk −0.11; S2 ×0.46 |
Mainstream | 76 | 0.172 | 0.73 | 0 | 0 | 1.42 | 0.19 | over-density +41%; Δη_highk −0.34; S2 ×1 |
Table 3 — Difference Ranking (EFT − Mainstream)
Dimension | Weighted Difference | Key Point |
|---|---|---|
Explanatory Power | +24 | Propagation common term unifies speckle clustering & high-k excess |
Predictiveness | +24 | Narrow k/ν band enhancement with off-band fidelity is testable |
Cross-scale Consistency | +24 | Coherent improvements across imaging/power/morphology |
Extrapolation Ability | +22 | Clear forecasts for longer integrations and denser sampling |
Robustness | +10 | Stable under blind/cut/systematics scans |
Parametric Economy | +10 | Few parameters unify multiple observables & morphology scales |
VI. Summary Assessment
Strengths
A Path + SeaCoupling + CoherenceWindow EFT modulates small-scale coherence and medium effectiveness in a narrow k/ν band, explaining speckle over-density and over-steep high-k tails without disturbing wedge-out and low-k statistics. Joint residuals drop, and the framework yields falsifiable bandwidth/amplitude predictions for next-generation deep imaging.
Blind spots
Minor bandpass drifts, reflection resonances, mutual coupling & polarization leakage, and fast ionospheric fluctuations can weakly degenerate with alpha_SC_21S/gamma_Path_21S; refined end-to-end simulations and stable night-time selections are required.
Falsification line & predictions
- Falsification line: gamma_Path_21S → 0 and k_STG_21S → 0 should remove improvements in speckle over-density and high-k slope.
- Prediction A: at fixed band/LST, higher-quantile J_S fields show larger N_patch and S2 residuals.
- Prediction B: deeper HERA/LOFAR imaging with denser frequency sampling will localize the in-band peaks at k≈0.2–0.6 h Mpc⁻¹ and Δν_coh≈8–10 MHz, with off-band trends reverting to baseline.
External References
- Methodological reviews of 21 cm imaging and small-scale statistics (power/morphology/peaks).
- Impacts of PSF/deconvolution/coupling/polarization leakage/ionosphere on small-scale structures and their mitigation.
- Roles of EoR non-linear damping and IR-resummation in high-k tails.
- End-to-end practice of joint imaging–power–morphology fits with LEC corrections.
Appendix A — Data Dictionary and Processing Details (excerpt)
- Fields & units: N_patch (sr⁻¹), S2(r) (mK²), P_21(k_⊥,k_∥) (mK²·(Mpc/h)³), b_Δ (mK³), chi2_per_dof (dimensionless).
- Parameters: gamma_Path_21S, k_STG_21S, alpha_SC_21S, L_coh_21S.
- Processing: bandpass/reflection/coupling/leakage calibration; PSF deconvolution & residual modeling; forward δT_b→P_21→imaging; EFT overlay; hierarchical-Bayesian mcmc; LOO/stratified & LEC; simulations/randoms for systematics & covariance.
Key outputs: 【param:gamma_Path_21S=0.010±0.003】, 【param:k_STG_21S=0.12±0.05】, 【param:L_coh_21S=9.2±2.9 MHz】, 【metric:chi2_per_dof=1.12】.
Appendix B — Sensitivity and Robustness Checks (excerpt)
- Bandpass/PSF/deconvolution swaps: across bandpass fits, PSF kernels, and CLEAN/deconvolution strategies, improvements in speckle_density_excess and Δη_highk drift < 0.3σ.
- Ionosphere & polarization scans: perturbing TEC/RM timescales and leakage templates preserves S2 and morphology-bias reductions; residuals stay near-Gaussian.
- Cross-array/epoch leave-one: removing any array/epoch retains high-k slope and speckle-density gains; posteriors remain near-normal and cross_field_consistency stable.
Copyright & License (CC BY 4.0)
Copyright: Unless otherwise noted, the copyright of “Energy Filament Theory” (text, charts, illustrations, symbols, and formulas) belongs to the author “Guanglin Tu”.
License: This work is licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0). You may copy, redistribute, excerpt, adapt, and share for commercial or non‑commercial purposes with proper attribution.
Suggested attribution: Author: “Guanglin Tu”; Work: “Energy Filament Theory”; Source: energyfilament.org; License: CC BY 4.0.
First published: 2025-11-11|Current version:v5.1
License link:https://creativecommons.org/licenses/by/4.0/