Showing 1–50 of 646 results for author: Ross, A

Unprecedented Enhancement of Piezoelectricity in Wurtzite Nitride Semiconductors via Thermal Annealing

Authors: Shubham Mondal, Md Mehedi Hasan Tanim, Garrett Baucom, Shaurya S. Dabas, Jinghan Gao, Venkateswarlu Gaddam, Jiangnan Liu, Aiden Ross, Long-Qing Chen, Honggyu Kim, Roozbeh Tabrizian, Zetian Mi

Abstract: The incorporation of rare-earth elements in wurtzite nitride semiconductors, e.g., scandium alloyed aluminum nitride (ScAlN), promises dramatically enhanced piezoelectric responses, critical to a broad range of acoustic, electronic, photonic, and quantum devices and applications. Experimentally, however, the measured piezoelectric responses of nitride semiconductors are far below what theory has p… ▽ More The incorporation of rare-earth elements in wurtzite nitride semiconductors, e.g., scandium alloyed aluminum nitride (ScAlN), promises dramatically enhanced piezoelectric responses, critical to a broad range of acoustic, electronic, photonic, and quantum devices and applications. Experimentally, however, the measured piezoelectric responses of nitride semiconductors are far below what theory has predicted. Here, we show that the use of a simple, scalable, post-growth thermal annealing process can dramatically boost the piezoelectric response of ScAlN thin films. We achieve a remarkable 3.5-fold increase in the piezoelectric modulus, d33 for 30% Sc content ScAlN, from 12.3 pC/N in the as-grown state to 45.5 pC/N, which is eight times larger than that of AlN. The enhancement in piezoelectricity has been unambiguously confirmed by three separate measurement techniques. Such a dramatic enhancement of d33 has been shown to impact the effective electromechanical coupling coefficient kt2 : increasing it from 13.8% to 76.2%, which matches the highest reported values in millimeter thick lithium niobate films but is achieved in a 100 nm ScAlN with a 10,000 fold reduction in thickness, thus promising extreme frequency scaling opportunities for bulk acoustic wave resonators for beyond 5G applications. By utilizing a range of material characterization techniques, we have elucidated the underlying mechanisms for the dramatically enhanced piezoelectric responses, including improved structural quality at the macroscopic scale, more homogeneous and ordered distribution of domain structures at the mesoscopic scale, and the reduction of lattice parameter ratio (c/a) for the wurtzite crystal structure at the atomic scale. Overall, the findings present a simple yet highly effective pathway that can be extended to other material families to further enhance their piezo responses. △ Less

Submitted 28 August, 2024; originally announced August 2024.

On Missing Scores in Evolving Multibiometric Systems

Authors: Melissa R Dale, Anil Jain, Arun Ross

Abstract: The use of multiple modalities (e.g., face and fingerprint) or multiple algorithms (e.g., three face comparators) has shown to improve the recognition accuracy of an operational biometric system. Over time a biometric system may evolve to add new modalities, retire old modalities, or be merged with other biometric systems. This can lead to scenarios where there are missing scores corresponding to… ▽ More The use of multiple modalities (e.g., face and fingerprint) or multiple algorithms (e.g., three face comparators) has shown to improve the recognition accuracy of an operational biometric system. Over time a biometric system may evolve to add new modalities, retire old modalities, or be merged with other biometric systems. This can lead to scenarios where there are missing scores corresponding to the input probe set. Previous work on this topic has focused on either the verification or identification tasks, but not both. Further, the proportion of missing data considered has been less than 50%. In this work, we study the impact of missing score data for both the verification and identification tasks. We show that the application of various score imputation methods along with simple sum fusion can improve recognition accuracy, even when the proportion of missing scores increases to 90%. Experiments show that fusion after score imputation outperforms fusion with no imputation. Specifically, iterative imputation with K nearest neighbors consistently surpasses other imputation methods in both the verification and identification tasks, regardless of the amount of scores missing, and provides imputed values that are consistent with the ground truth complete dataset. △ Less

Submitted 20 August, 2024; originally announced August 2024.

Comments: 2022 26th International Conference on Pattern Recognition (ICPR)

Detection of the large-scale tidal field with galaxy multiplet alignment in the DESI Y1 spectroscopic survey

Authors: Claire Lamman, Daniel Eisenstein, Jaime E. Forero-Romero, Jessica Nicole Aguilar, Steven Ahlen, Stephen Bailey, Davide Bianchi, David Brooks, Todd Claybaugh, Axel de la Macorra, Peter Doel, Simone Ferraro, Andreu Font-Ribera, Enrique Gaztañaga, Satya Gontcho A Gontcho, Gaston Gutierrez, Klaus Honscheid, Cullan Howlett, Anthony Kremin, Andrew Lambert, Martin Landriau, Laurent Le Guillou, Michael E. Levi, Aaron Meisner, Ramon Miquel , et al. (14 additional authors not shown)

Abstract: We explore correlations between the orientations of small galaxy groups, or "multiplets", and the large-scale gravitational tidal field. Using data from the Dark Energy Spectroscopic Instrument (DESI) Y1 survey, we detect the intrinsic alignment (IA) of multiplets to the galaxy-traced matter field out to separations of 100 Mpc/h. Unlike traditional IA measurements of individual galaxies, this esti… ▽ More We explore correlations between the orientations of small galaxy groups, or "multiplets", and the large-scale gravitational tidal field. Using data from the Dark Energy Spectroscopic Instrument (DESI) Y1 survey, we detect the intrinsic alignment (IA) of multiplets to the galaxy-traced matter field out to separations of 100 Mpc/h. Unlike traditional IA measurements of individual galaxies, this estimator is not limited by imaging of galaxy shapes and allows for direct IA detection beyond redshift z = 1. Multiplet alignment is a form of higher-order clustering, for which the scale-dependence traces the underlying tidal field and amplitude is a result of small-scale (< 1 Mpc/h) dynamics. Within samples of bright galaxies (BGS), luminous red galaxies (LRG) and emission-line galaxies (ELG), we find similar scale-dependence regardless of intrinsic luminosity or colour. This is promising for measuring tidal alignment in galaxy samples that typically display no intrinsic alignment. DESI's LRG mock galaxy catalogues created from the AbacusSummit N-body simulations produce a similar alignment signal, though with a 33% lower amplitude at all scales. An analytic model using a non-linear power spectrum (NLA) only matches the signal down to 20 Mpc/h. Our detection demonstrates that galaxy clustering in the non-linear regime of structure formation preserves an interpretable memory of the large-scale tidal field. Multiplet alignment complements traditional two-point measurements by retaining directional information imprinted by tidal forces, and contains additional line-of-sight information compared to weak lensing. This is a more effective estimator than the alignment of individual galaxies in dense, blue, or faint galaxy samples. △ Less

Submitted 20 August, 2024; originally announced August 2024.

Comments: For an accessible summary of this paper, see https://cmlamman.github.io/doc/multipletIA_summary.pdf

Facial Demorphing via Identity Preserving Image Decomposition

Authors: Nitish Shukla, Arun Ross

Abstract: A face morph is created by combining the face images usually pertaining to two distinct identities. The goal is to generate an image that can be matched with two identities thereby undermining the security of a face recognition system. To deal with this problem, several morph attack detection techniques have been developed. But these methods do not extract any information about the underlying bona… ▽ More A face morph is created by combining the face images usually pertaining to two distinct identities. The goal is to generate an image that can be matched with two identities thereby undermining the security of a face recognition system. To deal with this problem, several morph attack detection techniques have been developed. But these methods do not extract any information about the underlying bonafides used to create them. Demorphing addresses this limitation. However, current demorphing techniques are mostly reference-based, i.e, they need an image of one of the identities to recover the other. In this work, we treat demorphing as an ill-posed decomposition problem. We propose a novel method that is reference-free and recovers the bonafides with high accuracy. Our method decomposes the morph into several identity-preserving feature components. A merger network then weighs and combines these components to recover the bonafides. Our method is observed to reconstruct high-quality bonafides in terms of definition and fidelity. Experiments on the CASIA-WebFace, SMDD and AMSL datasets demonstrate the effectiveness of our method. △ Less

Submitted 20 August, 2024; originally announced August 2024.

To Impute or Not: Recommendations for Multibiometric Fusion

Authors: Melissa R Dale, Elliot Singer, Bengt J. Borgström, Arun Ross

Abstract: Combining match scores from different biometric systems via fusion is a well-established approach to improving recognition accuracy. However, missing scores can degrade performance as well as limit the possible fusion techniques that can be applied. Imputation is a promising technique in multibiometric systems for replacing missing data. In this paper, we evaluate various score imputation approach… ▽ More Combining match scores from different biometric systems via fusion is a well-established approach to improving recognition accuracy. However, missing scores can degrade performance as well as limit the possible fusion techniques that can be applied. Imputation is a promising technique in multibiometric systems for replacing missing data. In this paper, we evaluate various score imputation approaches on three multimodal biometric score datasets, viz. NIST BSSR1, BIOCOP2008, and MIT LL Trimodal, and investigate the factors which might influence the effectiveness of imputation. Our studies reveal three key observations: (1) Imputation is preferable over not imputing missing scores, even when the fusion rule does not require complete score data. (2) Balancing the classes in the training data is crucial to mitigate negative biases in the imputation technique towards the under-represented class, even if it involves dropping a substantial number of score vectors. (3) Multivariate imputation approaches seem to be beneficial when scores between modalities are correlated, while univariate approaches seem to benefit scenarios where scores between modalities are less correlated. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Comments: Proc. of IEEE International Workshop on Information Forensics and Security (WIFS), (Nuremberg, Germany), December 2023

Detecting Near-Duplicate Face Images

Authors: Sudipta Banerjee, Arun Ross

Abstract: Near-duplicate images are often generated when applying repeated photometric and geometric transformations that produce imperceptible variants of the original image. Consequently, a deluge of near-duplicates can be circulated online posing copyright infringement concerns. The concerns are more severe when biometric data is altered through such nuanced transformations. In this work, we address the… ▽ More Near-duplicate images are often generated when applying repeated photometric and geometric transformations that produce imperceptible variants of the original image. Consequently, a deluge of near-duplicates can be circulated online posing copyright infringement concerns. The concerns are more severe when biometric data is altered through such nuanced transformations. In this work, we address the challenge of near-duplicate detection in face images by, firstly, identifying the original image from a set of near-duplicates and, secondly, deducing the relationship between the original image and the near-duplicates. We construct a tree-like structure, called an Image Phylogeny Tree (IPT) using a graph-theoretic approach to estimate the relationship, i.e., determine the sequence in which they have been generated. We further extend our method to create an ensemble of IPTs known as Image Phylogeny Forests (IPFs). We rigorously evaluate our method to demonstrate robustness across other modalities, unseen transformations by latest generative models and IPT configurations, thereby significantly advancing the state-of-the-art performance by 42% on IPF reconstruction accuracy. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Comments: Under review

ChatGPT Meets Iris Biometrics

Authors: Parisa Farmanifard, Arun Ross

Abstract: This study utilizes the advanced capabilities of the GPT-4 multimodal Large Language Model (LLM) to explore its potential in iris recognition - a field less common and more specialized than face recognition. By focusing on this niche yet crucial area, we investigate how well AI tools like ChatGPT can understand and analyze iris images. Through a series of meticulously designed experiments employin… ▽ More This study utilizes the advanced capabilities of the GPT-4 multimodal Large Language Model (LLM) to explore its potential in iris recognition - a field less common and more specialized than face recognition. By focusing on this niche yet crucial area, we investigate how well AI tools like ChatGPT can understand and analyze iris images. Through a series of meticulously designed experiments employing a zero-shot learning approach, the capabilities of ChatGPT-4 was assessed across various challenging conditions including diverse datasets, presentation attacks, occlusions such as glasses, and other real-world variations. The findings convey ChatGPT-4's remarkable adaptability and precision, revealing its proficiency in identifying distinctive iris features, while also detecting subtle effects like makeup on iris recognition. A comparative analysis with Gemini Advanced - Google's AI model - highlighted ChatGPT-4's better performance and user experience in complex iris analysis tasks. This research not only validates the use of LLMs for specialized biometric applications but also emphasizes the importance of nuanced query framing and interaction design in extracting significant insights from biometric data. Our findings suggest a promising path for future research and the development of more adaptable, efficient, robust and interactive biometric security solutions. △ Less

Submitted 9 August, 2024; originally announced August 2024.

Comments: Published at IJCB 2024

Enhancing weak lensing redshift distribution characterization by optimizing the Dark Energy Survey Self-Organizing Map Photo-z method

Authors: A. Campos, B. Yin, S. Dodelson, A. Amon, A. Alarcon, C. Sánchez, G. M. Bernstein, G. Giannini, J. Myles, S. Samuroff, O. Alves, F. Andrade-Oliveira, K. Bechtol, M. R. Becker, J. Blazek, H. Camacho, A. Carnero Rosell, M. Carrasco Kind, R. Cawthon, C. Chang, R. Chen, A. Choi, J. Cordero, C. Davis, J. DeRose , et al. (89 additional authors not shown)

Abstract: Characterization of the redshift distribution of ensembles of galaxies is pivotal for large scale structure cosmological studies. In this work, we focus on improving the Self-Organizing Map (SOM) methodology for photometric redshift estimation (SOMPZ), specifically in anticipation of the Dark Energy Survey Year 6 (DES Y6) data. This data set, featuring deeper and fainter galaxies than DES Year 3 (… ▽ More Characterization of the redshift distribution of ensembles of galaxies is pivotal for large scale structure cosmological studies. In this work, we focus on improving the Self-Organizing Map (SOM) methodology for photometric redshift estimation (SOMPZ), specifically in anticipation of the Dark Energy Survey Year 6 (DES Y6) data. This data set, featuring deeper and fainter galaxies than DES Year 3 (DES Y3), demands adapted techniques to ensure accurate recovery of the underlying redshift distribution. We investigate three strategies for enhancing the existing SOM-based approach used in DES Y3: 1) Replacing the Y3 SOM algorithm with one tailored for redshift estimation challenges; 2) Incorporating $\textit{g}$-band flux information to refine redshift estimates (i.e. using $\textit{griz}$ fluxes as opposed to only $\textit{riz}$); 3) Augmenting redshift data for galaxies where available. These methods are applied to DES Y3 data, and results are compared to the Y3 fiducial ones. Our analysis indicates significant improvements with the first two strategies, notably reducing the overlap between redshift bins. By combining strategies 1 and 2, we have successfully managed to reduce redshift bin overlap in DES Y3 by up to 66$\%$. Conversely, the third strategy, involving the addition of redshift data for selected galaxies as an additional feature in the method, yields inferior results and is abandoned. Our findings contribute to the advancement of weak lensing redshift characterization and lay the groundwork for better redshift characterization in DES Year 6 and future stage IV surveys, like the Rubin Observatory. △ Less

Submitted 1 August, 2024; originally announced August 2024.

Weak Gravitational Lensing around Low Surface Brightness Galaxies in the DES Year 3 Data

Authors: N. Chicoine, J. Prat, G. Zacharegkas, C. Chang, D. Tanoglidis, A. Drlica-Wagner, D. Anbajagane, S. Adhikari, A. Amon, R. H. Wechsler, A. Alarcon, K. Bechtol, M. R. Becker, G. M. Bernstein, A. Campos, A. Carnero Rosell, M. Carrasco Kind, R. Cawthon, R. Chen, A. Choi, J. Cordero, C. Davis, J. DeRose, S. Dodelson, C. Doux , et al. (80 additional authors not shown)

Abstract: We present galaxy-galaxy lensing measurements using a sample of low surface brightness galaxies (LSBGs) drawn from the Dark Energy Survey Year 3 (Y3) data as lenses. LSBGs are diffuse galaxies with a surface brightness dimmer than the ambient night sky. These dark-matter-dominated objects are intriguing due to potentially unusual formation channels that lead to their diffuse stellar component. Giv… ▽ More We present galaxy-galaxy lensing measurements using a sample of low surface brightness galaxies (LSBGs) drawn from the Dark Energy Survey Year 3 (Y3) data as lenses. LSBGs are diffuse galaxies with a surface brightness dimmer than the ambient night sky. These dark-matter-dominated objects are intriguing due to potentially unusual formation channels that lead to their diffuse stellar component. Given the faintness of LSBGs, using standard observational techniques to characterize their total masses proves challenging. Weak gravitational lensing, which is less sensitive to the stellar component of galaxies, could be a promising avenue to estimate the masses of LSBGs. Our LSBG sample consists of 23,790 galaxies separated into red and blue color types at $g-i\ge 0.60$ and $g-i< 0.60$, respectively. Combined with the DES Y3 shear catalog, we measure the tangential shear around these LSBGs and find signal-to-noise ratios of 6.67 for the red sample, 2.17 for the blue sample, and 5.30 for the full sample. We use the clustering redshifts method to obtain redshift distributions for the red and blue LSBG samples. Assuming all red LSBGs are satellites, we fit a simple model to the measurements and estimate the host halo mass of these LSBGs to be $\log(M_{\rm host}/M_{\odot}) = 12.98 ^{+0.10}_{-0.11}$. We place a 95% upper bound on the subhalo mass at $\log(M_{\rm sub}/M_{\odot})<11.51$. By contrast, we assume the blue LSBGs are centrals, and place a 95% upper bound on the halo mass at $\log(M_\mathrm{host}/M_\odot) < 11.84$. We find that the stellar-to-halo mass ratio of the LSBG samples is consistent with that of the general galaxy population. This work illustrates the viability of using weak gravitational lensing to constrain the halo masses of LSBGs. △ Less

Submitted 26 July, 2024; originally announced July 2024.

Comments: 16 pages, 15 figures

Report number: FERMILAB-PUB-23-380-PPD

Imaging interstitial atoms with multislice electron ptychography

Authors: Zhen Chen, Yu-Tsun Shao, Steven E. Zeltmann, Harikrishnan K. P., Ethan R. Rosenberg, Caroline A. Ross, Yi Jiang, David A. Muller

Abstract: Doping impurity atoms is a strategy commonly used to tune the functionality of materials including catalysts, semiconductors, and quantum emitters. The location of dopants and their interaction with surrounding atoms could significantly modulate the transport, optical, or magnetic properties of materials. However, directly imaging individual impurity atoms inside materials remains a generally unad… ▽ More Doping impurity atoms is a strategy commonly used to tune the functionality of materials including catalysts, semiconductors, and quantum emitters. The location of dopants and their interaction with surrounding atoms could significantly modulate the transport, optical, or magnetic properties of materials. However, directly imaging individual impurity atoms inside materials remains a generally unaddressed need. Here, we demonstrate how single atoms can be detected and located in three dimensions via multislice electron ptychography.Interstitial atoms in a complex garnet oxide heterostructure are resolved with a depth resolution better than 2.7 nm, together with a deep-sub-Ångstrom lateral resolution. Single-scan atomic-layer depth resolution should be possible using strongly divergent electron probe illumination. Our results provide a new approach to detecting individual atomic defects and open doors to characterize the local environments and spatial distributions that underlie a broad range of systems such as single-atom catalysts, nitrogen-vacancy centers, and other atomic-scale quantum sensors. △ Less

Submitted 25 July, 2024; originally announced July 2024.

Comments: 28 pages, 5 figures, 10 supplementary figures

Dark Energy Survey Year 3 Results: Cosmology from galaxy clustering and galaxy-galaxy lensing in harmonic space

Authors: L. Faga, F. Andrade-Oliveira, H. Camacho, R. Rosenfeld, M. Lima, C. Doux, X. Fang, J. Prat, A. Porredon, M. Aguena, A. Alarcon, S. Allam, O. Alves, A. Amon, S. Avila, D. Bacon, K. Bechtol, M. R. Becker, G. M. Bernstein, S. Bocquet, D. Brooks, E. Buckley-Geer, A. Campos, A. Carnero Rosell, M. Carrasco Kind , et al. (78 additional authors not shown)

Abstract: We present the joint tomographic analysis of galaxy-galaxy lensing and galaxy clustering in harmonic space, using galaxy catalogues from the first three years of observations by the Dark Energy Survey (DES Y3). We utilise the redMaGiC and MagLim catalogues as lens galaxies and the METACALIBRATION catalogue as source galaxies. The measurements of angular power spectra are performed using the pseudo… ▽ More We present the joint tomographic analysis of galaxy-galaxy lensing and galaxy clustering in harmonic space, using galaxy catalogues from the first three years of observations by the Dark Energy Survey (DES Y3). We utilise the redMaGiC and MagLim catalogues as lens galaxies and the METACALIBRATION catalogue as source galaxies. The measurements of angular power spectra are performed using the pseudo-$C_\ell$ method, and our theoretical modelling follows the fiducial analyses performed by DES Y3 in configuration space, accounting for galaxy bias, intrinsic alignments, magnification bias, shear magnification bias and photometric redshift uncertainties. We explore different approaches for scale cuts based on non-linear galaxy bias and baryonic effects contamination. Our fiducial covariance matrix is computed analytically, accounting for mask geometry in the Gaussian term, and including non-Gaussian contributions and super-sample covariance terms. To validate our harmonic space pipelines and covariance matrix, we used a suite of 1800 log-normal simulations. We also perform a series of stress tests to gauge the robustness of our harmonic space analysis. In the $Λ$CDM model, the clustering amplitude $S_8 =σ_8(Ω_m/0.3)^{0.5}$ is constrained to $S_8 = 0.704\pm 0.029$ and $S_8 = 0.753\pm 0.024$ ($68\%$ C.L.) for the redMaGiC and MagLim catalogues, respectively. For the $w$CDM, the dark energy equation of state is constrained to $w = -1.28 \pm 0.29$ and $w = -1.26^{+0.34}_{-0.27}$, for redMaGiC and MagLim catalogues, respectively. These results are compatible with the corresponding DES Y3 results in configuration space and pave the way for harmonic space analyses using the DES Y6 data. △ Less

Submitted 18 June, 2024; originally announced June 2024.

Comments: To be submitted to MNRAS

Report number: FERMILAB-PUB-24-0289-PPD

Language Modeling with Editable External Knowledge

Authors: Belinda Z. Li, Emmy Liu, Alexis Ross, Abbas Zeitoun, Graham Neubig, Jacob Andreas

Abstract: When the world changes, so does the text that humans write about it. How do we build language models that can be easily updated to reflect these changes? One popular approach is retrieval-augmented generation, in which new documents are inserted into a knowledge base and retrieved during prediction for downstream tasks. Most prior work on these systems have focused on improving behavior during pre… ▽ More When the world changes, so does the text that humans write about it. How do we build language models that can be easily updated to reflect these changes? One popular approach is retrieval-augmented generation, in which new documents are inserted into a knowledge base and retrieved during prediction for downstream tasks. Most prior work on these systems have focused on improving behavior during prediction through better retrieval or reasoning. This paper introduces ERASE, which instead improves model behavior when new documents are acquired, by incrementally deleting or rewriting other entries in the knowledge base each time a document is added. In two new benchmark datasets evaluating models' ability to answer questions about a stream of news articles or conversations, ERASE improves accuracy relative to conventional retrieval-augmented generation by 7-13% (Mixtral-8x7B) and 6-10% (Llama-3-8B) absolute. Code and data are available at https://github.com/belindal/ERASE △ Less

Submitted 17 June, 2024; originally announced June 2024.

Mitigation of DESI fiber assignment incompleteness effect on two-point clustering with small angular scale truncated estimators

Authors: M. Pinon, A. de Mattia, P. McDonald, E. Burtin, V. Ruhlmann-Kleider, M. White, D. Bianchi, A. J. Ross, J. Aguilar, S. Ahlen, D. Brooks, E. Chaussidon, T. Claybaugh, S. Cole, A. de la Macorra, B. Dey, P. Doel, K. Fanning, J. E. Forero-Romero, E. Gaztañaga, S. Gontcho A Gontcho, C. Howlett, D. Kirkby, T. Kisner, A. Kremin , et al. (27 additional authors not shown)

Abstract: We present a method to mitigate the effects of fiber assignment incompleteness in two-point power spectrum and correlation function measurements from galaxy spectroscopic surveys, by truncating small angular scales from estimators. We derive the corresponding modified correlation function and power spectrum windows to account for the small angular scale truncation in the theory prediction. We vali… ▽ More We present a method to mitigate the effects of fiber assignment incompleteness in two-point power spectrum and correlation function measurements from galaxy spectroscopic surveys, by truncating small angular scales from estimators. We derive the corresponding modified correlation function and power spectrum windows to account for the small angular scale truncation in the theory prediction. We validate this approach on simulations reproducing the Dark Energy Spectroscopic Instrument (DESI) Data Release 1 (DR1) with and without fiber assignment. We show that we recover unbiased cosmological constraints using small angular scale truncated estimators from simulations with fiber assignment incompleteness, with respect to standard estimators from complete simulations. Additionally, we present an approach to remove the sensitivity of the fits to high $k$ modes in the theoretical power spectrum, by applying a transformation to the data vector and window matrix. We find that our method efficiently mitigates the effect of fiber assignment incompleteness in two-point correlation function and power spectrum measurements, at low computational cost and with little statistical loss. △ Less

Submitted 7 June, 2024; originally announced June 2024.

Comments: 32 pages, 22 figures

Blinding scheme for the scale-dependence bias signature of local primordial non-Gaussianity for DESI 2024

Authors: E. Chaussidon, A. de Mattia, C. Yèche, J. Aguilar, S. Ahlen, D. Brooks, T. Claybaugh, S. Cole, A. de la Macorra, P. Doel, K. Fanning, E. Gaztañaga, S. Gontcho A Gontcho, C. Howlett, T. Kisner, A. Lambert, L. Le Guillou, M. Manera, A. Meisner, R. Miquel, G. Niz, N. Palanque-Delabrouille, W. J. Percival, F. Prada, A. J. Ross , et al. (10 additional authors not shown)

Abstract: The next generation of spectroscopic surveys is expected to achieve an unprecedented level of accuracy in the measurement of cosmological parameters. To avoid confirmation bias and thereby improve the reliability of these results, blinding procedures become a standard practice in the cosmological analyses of such surveys. Blinding is especially crucial when the impact of observational systematics… ▽ More The next generation of spectroscopic surveys is expected to achieve an unprecedented level of accuracy in the measurement of cosmological parameters. To avoid confirmation bias and thereby improve the reliability of these results, blinding procedures become a standard practice in the cosmological analyses of such surveys. Blinding is especially crucial when the impact of observational systematics is important relative to the cosmological signal, and a detection of that signal would have significant implications. This is the case for local primordial non-gaussianity, as probed by the scale-dependent bias of the galaxy power spectrum at large scales that are heavily sensitive to the dependence of the target selection on the imaging quality, known as imaging systematics. We propose a blinding method for the scale-dependent bias signature of local primordial non-gaussianity at the density field level which consists in generating a set of weights for the data that replicate the scale-dependent bias. The applied blinding is predictable, and can be straightforwardly combined with other catalog-level blinding procedures that have been designed for the baryon acoustic oscillation and redshift space distortion signals. The procedure is validated through simulations that replicate data from the first year of observation of the Dark Energy Spectroscopic Instrument, but may find applications to other upcoming spectroscopic surveys. △ Less

Submitted 31 May, 2024; originally announced June 2024.

Impact and mitigation of spectroscopic systematics on DESI DR1 clustering measurements

Authors: A. Krolewski, J. Yu, A. J. Ross, S. Penmetsa, W. J. Percival, R. Zhou, J. Hou, J. Aguilar, S. Ahlen, D. Brooks, E. Chaussidon, T. Claybaugh, A. de la Macorra, Biprateep Dey, J. E. Forero-Romero, S. Gontcho A Gontcho, J. Guy, K. Honscheid, S. Juneau, D. Kirkby, T. Kisner, A. Kremin, A. Lambert, L. Le-Guillou, M. E. Levi , et al. (18 additional authors not shown)

Abstract: The large scale structure catalogs within DESI Data Release 1 (DR1) use nearly 6 million galaxies and quasars as tracers of the large-scale structure of the universe to measure the expansion history with baryon acoustic oscillations and the growth of structure with redshift-space distortions. In order to take advantage of DESI's unprecedented statistical power, we must ensure that the galaxy clust… ▽ More The large scale structure catalogs within DESI Data Release 1 (DR1) use nearly 6 million galaxies and quasars as tracers of the large-scale structure of the universe to measure the expansion history with baryon acoustic oscillations and the growth of structure with redshift-space distortions. In order to take advantage of DESI's unprecedented statistical power, we must ensure that the galaxy clustering measurements are unaffected by non-cosmological density fluctuations. One source of spurious fluctuations comes from variation in galaxy density with spectroscopic observing conditions, lowering the redshift efficiency (and thus galaxy density) in certain areas of the sky. We measure the uniformity of the redshift success rate for DESI luminous red galaxies (LRG), bright galaxies (BGS) and quasars (QSO), complementing the detailed discussion of emission line galaxy (ELG) systematics in a companion paper (Yu et al., 2024). We find small but significant fluctuations of up to 3% in redshift success rate with the effective spectroscopic signal-to-noise, and create and describe weights that remove these fluctuations. We also describe the process to identify and remove data from certain poorly performing fibers from DESI DR1, and measure the stability of the redshift success rate with time. Finally, we find small but significant correlations of redshift success rate with position on the focal plane, survey speed, and number of exposures required, and show the impact of weights correcting these trends on the power spectrum multipoles and on cosmological parameters from BAO and RSD fits. These corrections change the best-fit parameters by $<15\%$ of their statistical errors, and thus contribute negligibly to the overall DESI error budget. △ Less

Submitted 27 May, 2024; originally announced May 2024.

Comments: 53 pages, 41 figures. Supporting paper for DESI DR1 cosmological measurements

ELG Spectroscopic Systematics Analysis of the DESI Data Release 1

Authors: Jiaxi Yu, Ashley J. Ross, Antoine Rocher, Otávio Alves, Arnaud de Mattia, Daniel Forero-Sánchez, Jean-Paul Kneib, Alex Krolewski, TingWen Lan, Michael Rashkovetskyi, Jessica Nicole Aguilar, Steven Ahlen, Stephen Bailey, David Brooks, Edmond Chaussidon, Todd Claybaugh, Axel de la Macorra, Arjun Dey, Biprateep Dey, Peter Doel, Kevin Fanning, Jaime E. Forero-Romero, Enrique Gaztañaga, Satya Gontcho A Gontcho, Klaus Honscheid , et al. (36 additional authors not shown)

Abstract: Dark Energy Spectroscopic Instrument (DESI) uses more than 2.4 million Emission Line Galaxies (ELGs) for 3D large-scale structure (LSS) analyses in its Data Release 1 (DR1). Such large statistics enable thorough research on systematic uncertainties. In this study, we focus on spectroscopic systematics of ELGs. The redshift success rate ($f_{\rm goodz}$) is the relative fraction of secure redshifts… ▽ More Dark Energy Spectroscopic Instrument (DESI) uses more than 2.4 million Emission Line Galaxies (ELGs) for 3D large-scale structure (LSS) analyses in its Data Release 1 (DR1). Such large statistics enable thorough research on systematic uncertainties. In this study, we focus on spectroscopic systematics of ELGs. The redshift success rate ($f_{\rm goodz}$) is the relative fraction of secure redshifts among all measurements. It depends on observing conditions, thus introduces non-cosmological variations to the LSS. We, therefore, develop the redshift failure weight ($w_{\rm zfail}$) and a per-fibre correction ($η_{\rm zfail}$) to mitigate these dependences. They have minor influences on the galaxy clustering. For ELGs with a secure redshift, there are two subtypes of systematics: 1) catastrophics (large) that only occur in a few samples; 2) redshift uncertainty (small) that exists for all samples. The catastrophics represent 0.26\% of the total DR1 ELGs, composed of the confusion between O\,\textsc{ii} and sky residuals, double objects, total catastrophics and others. We simulate the realistic 0.26\% catastrophics of DR1 ELGs, the hypothetical 1\% catastrophics, and the truncation of the contaminated $1.31<z<1.33$ in the \textsc{AbacusSummit} ELG mocks. Their $P_\ell$ show non-negligible bias from the uncontaminated mocks. But their influences on the redshift space distortions (RSD) parameters are smaller than $0.2σ$. The redshift uncertainty of \Yone ELGs is 8.5 km/s with a Lorentzian profile. The code for implementing the catastrophics and redshift uncertainty on mocks can be found in https://github.com/Jiaxi-Yu/modelling_spectro_sys. △ Less

Submitted 26 August, 2024; v1 submitted 26 May, 2024; originally announced May 2024.

The Construction of Large-scale Structure Catalogs for the Dark Energy Spectroscopic Instrument

Authors: A. J. Ross, J. Aguilar, S. Ahlen, S. Alam, A. Anand, S. Bailey, D. Bianchi, S. Brieden, D. Brooks, E. Burtin, A. Carnero Rosell, E. Chaussidon, T. Claybaugh, S. Cole, K. Dawson, A. de la Macorra, A. de Mattia, Arjun Dey, Biprateep Dey, P. Doel, K. Fanning, S. Ferraro, J. Ereza, A. Font-Ribera, J. E. Forero-Romero , et al. (61 additional authors not shown)

Abstract: We present the technical details on how large-scale structure (LSS) catalogs are constructed from redshifts measured from spectra observed by the Dark Energy Spectroscopic Instrument (DESI). The LSS catalogs provide the information needed to determine the relative number density of DESI tracers as a function of redshift and celestial coordinates and, e.g., determine clustering statistics. We produ… ▽ More We present the technical details on how large-scale structure (LSS) catalogs are constructed from redshifts measured from spectra observed by the Dark Energy Spectroscopic Instrument (DESI). The LSS catalogs provide the information needed to determine the relative number density of DESI tracers as a function of redshift and celestial coordinates and, e.g., determine clustering statistics. We produce catalogs that are weighted subsamples of the observed data, each matched to a weighted `random' catalog that forms an unclustered sampling of the probability density that DESI could have observed those data at each location. Precise knowledge of the DESI observing history and associated hardware performance allows for a determination of the DESI footprint and the number of times DESI has covered it at sub-arcsecond level precision. This enables the completeness of any DESI sample to be modeled at this same resolution. The pipeline developed to create LSS catalogs has been designed to easily allow robustness tests and enable future improvements. We describe how it allows ongoing work improving the match between galaxy and random catalogs, such as including further information when assigning redshifts to randoms, accounting for fluctuations in target density, accounting for variation in the redshift success rate, and accommodating blinding schemes. △ Less

Submitted 18 July, 2024; v1 submitted 26 May, 2024; originally announced May 2024.

Comments: Accepted (by JCAP) version of supporting publication of DESI 2024II: Sample definitions, characteristics, and two-point clustering statistics

Forward modeling fluctuations in the DESI LRGs target sample using image simulations

Authors: Hui Kong, Ashley J. Ross, Klaus Honscheid, Dustin Lang, Anna Porredon, Arnaud de Mattia, Mehdi Rezaie, Rongpu Zhou, Edward Schlafly, John Moustakas, Alberto Rosado-Marin, Jessica Nicole Aguilar, Steven Ahlen, David Brooks, Edmond Chaussidon, Todd Claybaugh, Shaun Cole, Axel de la Macorra, Arjun Dey, Biprateep Dey, Peter Doel, Kevin Fanning, Jaime E. Forero-Romero, Enrique Gaztanaga, Satya Gontcho A Gontcho , et al. (28 additional authors not shown)

Abstract: We use the forward modeling pipeline, Obiwan, to study the imaging systematics of the Luminous Red Galaxies (LRGs) targeted by the Dark Energy Spectroscopic Instrument (DESI). We update the Obiwan pipeline, which had previously been developed to simulate the optical images used to target DESI data, to further simulate WISE images in the infrared. This addition makes it possible to simulate the DES… ▽ More We use the forward modeling pipeline, Obiwan, to study the imaging systematics of the Luminous Red Galaxies (LRGs) targeted by the Dark Energy Spectroscopic Instrument (DESI). We update the Obiwan pipeline, which had previously been developed to simulate the optical images used to target DESI data, to further simulate WISE images in the infrared. This addition makes it possible to simulate the DESI LRGs sample, which utilizes WISE data in the target selection. Deep DESI imaging data combined with a method to account for biases in their shapes is used to define a truth sample of potential LRG targets. We simulate a total of 15 million galaxies to obtain a simulated LRG sample (Obiwan LRGs) that predicts the variations in target density due to imaging properties. We find that the simulations predict the trends with depth observed in the data, including how they depend on the intrinsic brightness of the galaxies. We observe that faint LRGs are the main contributing power of the imaging systematics trend induced by depth. We also find significant trends in the data against Galactic extinction that are not predicted by Obiwan. These trends depend strongly on the particular map of Galactic extinction chosen to test against, implying Large-Scale Structure systematic contamination (e.g. Cosmic-Infrared Background) in the Galactic extinction maps is a likely root cause. We additionally observe that the DESI LRGs sample exhibits a complex dependency on a combination of seeing, depth, and intrinsic galaxy brightness, which is not replicated by Obiwan, suggesting discrepancies between the current simulation settings and the actual observations. The detailed findings we present should be used to guide any observational systematics mitigation treatment for the clustering of the DESI LRG sample. △ Less

Submitted 25 May, 2024; originally announced May 2024.

Comments: 46 pages, 26 figures

CMB lensing and Lyα forest cross bispectrum from DESI's first-year quasar sample

Authors: N. G. Karaçaylı, P. Martini, D. H. Weinberg, S. Ferraro, R. de Belsunce, J. Aguilar, S. Ahlen, E. Armengaud, D. Brooks, T. Claybaugh, A. de la Macorra, B. Dey, P. Doel, K. Fanning, J. E. Forero-Romero, S. Gontcho A Gontcho, A. X. Gonzalez-Morales, G. Gutierrez, J. Guy, K. Honscheid, D. Kirkby, T. Kisner, A. Kremin, A. Lambert, M. Landriau , et al. (28 additional authors not shown)

Abstract: The squeezed cross-bispectrum \bispeconed\ between the gravitational lensing in the Cosmic Microwave Background and the 1D \lya\ forest power spectrum can constrain bias parameters and break degeneracies between $σ_8$ and other cosmological parameters. We detect \bispeconed\ with $4.8σ$ significance at an effective redshift $z_\mathrm{eff}=2.4$ using Planck PR3 lensing map and over 280,000 quasar… ▽ More The squeezed cross-bispectrum \bispeconed\ between the gravitational lensing in the Cosmic Microwave Background and the 1D \lya\ forest power spectrum can constrain bias parameters and break degeneracies between $σ_8$ and other cosmological parameters. We detect \bispeconed\ with $4.8σ$ significance at an effective redshift $z_\mathrm{eff}=2.4$ using Planck PR3 lensing map and over 280,000 quasar spectra from the Dark Energy Spectroscopic Instrument's first-year data. We test our measurement against metal contamination and foregrounds such as Galactic extinction and clusters of galaxies by deprojecting the thermal Sunyaev-Zeldovich effect. We compare our results to a tree-level perturbation theory calculation and find reasonable agreement between the model and measurement. △ Less

Submitted 23 May, 2024; originally announced May 2024.

Comments: 13 pages excluding references, 8 figures

Measurement of Coherent Vibrational Dynamics with X-ray Transient Absorption Spectroscopy Simultaneously at the Carbon K- and Chlorine L$_{2,3}$- Edges

Authors: Andrew D. Ross, Diptarka Hait, Valeriu Scutelnic, Daniel M. Neumark, Martin Head-Gordon, Stephen R. Leone

Abstract: X-ray Transient Absorption Spectroscopy near the carbon K-edge (1s, $\sim$ 285 eV) and chlorine L$_{2,3}$ edges (2p, $\sim$ 200 eV) is used to study the nuclear dynamics of CCl$_4$ vibrationally activated by impulsive stimulated Raman scattering with a few-cycle 800 nm pump pulse. The totally symmetric stretching mode leads to a strong response in the inner-shell spectra, with the concerted elonga… ▽ More X-ray Transient Absorption Spectroscopy near the carbon K-edge (1s, $\sim$ 285 eV) and chlorine L$_{2,3}$ edges (2p, $\sim$ 200 eV) is used to study the nuclear dynamics of CCl$_4$ vibrationally activated by impulsive stimulated Raman scattering with a few-cycle 800 nm pump pulse. The totally symmetric stretching mode leads to a strong response in the inner-shell spectra, with the concerted elongation (contraction) in bond lengths leading to a red (blue) shift in the X-ray absorption energies associated with core-to-antibonding excitations. The relative slopes of the potential energy surfaces associated with the relevant core-excited states along the symmetric stretching mode are experimentally measured and compared to results from restricted open-shell Kohn-Sham calculations. A combination of experiment and theory indicates that the slope of the core-excited potential energy surface vs totally symmetric bond elongation is $-11.1 \pm 0.8$ eV/Å for the Cl 2p$\to7a_1^*$ excitation, $-9.0\pm0.6$ eV/Å for the Cl 2p$\to8t_2^*$ excitation and $-5.2\pm 0.4$ eV/Å for the C 1s$\to8t_2^*$ excitation, to 95% confidence. The much larger slopes for the Cl 2p excitations compared to the C 1s state are attributed to greater contributions from Cl to the $7a_1^*$ or $8t_2^*$ antibonding orbitals to which the inner-shell electrons are being excited. No net displacement of the center of the vibrational wavefunction along the other vibrational modes is induced by the pump pulse, leading to absence of transient signal. The results highlight the ability of X-ray Transient Absorption Spectroscopy to reveal nuclear dynamics involving tiny ($<0.01$ Å) atomic displacements and also provide direct measurement of forces on core-excited potential energy surfaces. △ Less

Submitted 8 May, 2024; originally announced May 2024.

Comments: ADR and DH contributed equally to this work

Learning Phonotactics from Linguistic Informants

Authors: Canaan Breiss, Alexis Ross, Amani Maina-Kilaas, Roger Levy, Jacob Andreas

Abstract: We propose an interactive approach to language learning that utilizes linguistic acceptability judgments from an informant (a competent language user) to learn a grammar. Given a grammar formalism and a framework for synthesizing data, our model iteratively selects or synthesizes a data-point according to one of a range of information-theoretic policies, asks the informant for a binary judgment, a… ▽ More We propose an interactive approach to language learning that utilizes linguistic acceptability judgments from an informant (a competent language user) to learn a grammar. Given a grammar formalism and a framework for synthesizing data, our model iteratively selects or synthesizes a data-point according to one of a range of information-theoretic policies, asks the informant for a binary judgment, and updates its own parameters in preparation for the next query. We demonstrate the effectiveness of our model in the domain of phonotactics, the rules governing what kinds of sound-sequences are acceptable in a language, and carry out two experiments, one with typologically-natural linguistic data and another with a range of procedurally-generated languages. We find that the information-theoretic policies that our model uses to select items to query the informant achieve sample efficiency comparable to, and sometimes greater than, fully supervised approaches. △ Less

Submitted 7 May, 2024; originally announced May 2024.

Nonstandard arguments for results about infinite systems of equations in infinitely many variables

Authors: David A. Ross

Abstract: Short nonstandard proofs are given for some results about infinite systems of equations in infinitely many variables. Short nonstandard proofs are given for some results about infinite systems of equations in infinitely many variables. △ Less

Submitted 6 May, 2024; originally announced May 2024.

MSC Class: 26E35; 46S20; 15A06; 40H05; 46A45; 12E12

Toward In-Context Teaching: Adapting Examples to Students' Misconceptions

Authors: Alexis Ross, Jacob Andreas

Abstract: When a teacher provides examples for a student to study, these examples must be informative, enabling a student to progress from their current state toward a target concept or skill. Good teachers must therefore simultaneously infer what students already know and adapt their teaching to students' changing state of knowledge. There is increasing interest in using computational models, particularly… ▽ More When a teacher provides examples for a student to study, these examples must be informative, enabling a student to progress from their current state toward a target concept or skill. Good teachers must therefore simultaneously infer what students already know and adapt their teaching to students' changing state of knowledge. There is increasing interest in using computational models, particularly large language models, as pedagogical tools. As students, language models in particular have shown a remarkable ability to adapt to new tasks given small numbers of examples. But how effectively can these models adapt as teachers to students of different types? To study this question, we introduce a suite of models and evaluation methods we call AdapT. AdapT has two components: (1) a collection of simulated Bayesian student models that can be used for evaluation of automated teaching methods; (2) a platform for evaluation with human students, to characterize the real-world effectiveness of these methods. We additionally introduce (3) AToM, a new probabilistic model for adaptive teaching that jointly infers students' past beliefs and optimizes for the correctness of future beliefs. In evaluations of simulated students across three learning domains (fraction arithmetic, English morphology, function learning), AToM systematically outperforms LLM-based and standard Bayesian teaching models. In human experiments, both AToM and LLMs outperform non-adaptive random example selection. Our results highlight both the difficulty of the adaptive teaching task and the potential of learned adaptive models for solving it. △ Less

Submitted 7 May, 2024; originally announced May 2024.

Linear equations and multiplicative polynomial equations in infinitely many variables

Authors: Melvyn B. Nathanson, David A. Ross

Abstract: This paper describes infinite sets of polynomial equations in infinitely many variables with the property that the existence of a solution or even an approximate solution for every finite subset of the equations implies the existence of a solution for the infinite set of equations. This paper describes infinite sets of polynomial equations in infinitely many variables with the property that the existence of a solution or even an approximate solution for every finite subset of the equations implies the existence of a solution for the infinite set of equations. △ Less

Submitted 19 July, 2024; v1 submitted 2 May, 2024; originally announced May 2024.

Comments: 17 pages

MSC Class: 12D10; 12E12; 15A06; 40H05; 46A45; 54B10; 54C30

Theory of nonlinear terahertz susceptibility in ferroelectrics

Authors: Yujie Zhu, Taorui Chen, Aiden Ross, Bo Wang, Xiangwei Guo, Venkatraman Gopalan, Long-Qing Chen, Jia-Mian Hu

Abstract: An analytical theory is developed for predicting the nonlinear susceptibility of ionic polarization to continuous electromagnetic waves in both bulk and strained thin film ferroelectrics. Using a perturbation method for solving the nonlinear equation of motion for ionic polarization within the framework of Landau-Ginzburg-Devonshire theory, the full second-order nonlinear susceptibility tensor is… ▽ More An analytical theory is developed for predicting the nonlinear susceptibility of ionic polarization to continuous electromagnetic waves in both bulk and strained thin film ferroelectrics. Using a perturbation method for solving the nonlinear equation of motion for ionic polarization within the framework of Landau-Ginzburg-Devonshire theory, the full second-order nonlinear susceptibility tensor is derived as a function of frequency, temperature, and strain. The theory predicts the coexistence of a significantly enhanced second-order dielectric susceptibility and a relatively low dielectric loss in BaTiO3 films with a strain-stabilized monoclinic ferroelectric phase and in a strained SrTiO3 film near its temperature-driven second-order ferroelectric-to-paraelectric phase transition. This work establishes a theoretical framework for predicting and exploiting nonlinear interactions between THz waves and ferroelectric materials, and more generally, suggests exciting opportunities to strain-engineer nonlinear dynamical properties of ferroelectrics beyond the static and quasi-static limits. △ Less

Submitted 5 August, 2024; v1 submitted 2 May, 2024; originally announced May 2024.

The Gravitational Lensing Imprints of DES Y3 Superstructures on the CMB: A Matched Filtering Approach

Authors: Umut Demirbozan, Seshadri Nadathur, Ismael Ferrero, Pablo Fosalba, Andras Kovacs, Ramon Miquel, Christopher T. Davies, Shivam Pandey, Monika Adamow, Keith Bechtol, Alex Drlica-Wagner, Robert Gruendl, Will Hartley, Adriano Pieres, Ashley Ross, Eli Rykoff, Erin Sheldon, Brian Yanny, Tim Abbott, Michel Aguena, Sahar Allam, Otavio Alves, David Bacon, Emmanuel Bertin, Sebastian Bocquet , et al. (41 additional authors not shown)

Abstract: $ $Low density cosmic voids gravitationally lens the cosmic microwave background (CMB), leaving a negative imprint on the CMB convergence $κ… ▽ More $ $Low density cosmic voids gravitationally lens the cosmic microwave background (CMB), leaving a negative imprint on the CMB convergence $κ$. This effect provides insight into the distribution of matter within voids, and can also be used to study the growth of structure. We measure this lensing imprint by cross-correlating the Planck CMB lensing convergence map with voids identified in the Dark Energy Survey Year 3 data set, covering approximately 4,200 deg$^2$ of the sky. We use two distinct void-finding algorithms: a 2D void-finder which operates on the projected galaxy density field in thin redshift shells, and a new code, Voxel, which operates on the full 3D map of galaxy positions. We employ an optimal matched filtering method for cross-correlation, using the MICE N-body simulation both to establish the template for the matched filter and to calibrate detection significances. Using the DES Y3 photometric luminous red galaxy sample, we measure $A_κ$, the amplitude of the observed lensing signal relative to the simulation template, obtaining $A_κ= 1.03 \pm 0.22$ ($4.6σ$ significance) for Voxel and $A_κ= 1.02 \pm 0.17$ ($5.9σ$ significance) for 2D voids, both consistent with $Λ$CDM expectations. We additionally invert the 2D void-finding process to identify superclusters in the projected density field, for which we measure $A_κ= 0.87 \pm 0.15$ ($5.9σ$ significance). The leading source of noise in our measurements is Planck noise, implying that future data from the Atacama Cosmology Telescope (ACT), South Pole Telescope (SPT) and CMB-S4 will increase sensitivity and allow for more precise measurements. △ Less

Submitted 28 April, 2024; originally announced April 2024.

Synthesizing Iris Images using Generative Adversarial Networks: Survey and Comparative Analysis

Authors: Shivangi Yadav, Arun Ross

Abstract: Biometric systems based on iris recognition are currently being used in border control applications and mobile devices. However, research in iris recognition is stymied by various factors such as limited datasets of bonafide irides and presentation attack instruments; restricted intra-class variations; and privacy concerns. Some of these issues can be mitigated by the use of synthetic iris data. I… ▽ More Biometric systems based on iris recognition are currently being used in border control applications and mobile devices. However, research in iris recognition is stymied by various factors such as limited datasets of bonafide irides and presentation attack instruments; restricted intra-class variations; and privacy concerns. Some of these issues can be mitigated by the use of synthetic iris data. In this paper, we present a comprehensive review of state-of-the-art GAN-based synthetic iris image generation techniques, evaluating their strengths and limitations in producing realistic and useful iris images that can be used for both training and testing iris recognition systems and presentation attack detectors. In this regard, we first survey the various methods that have been used for synthetic iris generation and specifically consider generators based on StyleGAN, RaSGAN, CIT-GAN, iWarpGAN, StarGAN, etc. We then analyze the images generated by these models for realism, uniqueness, and biometric utility. This comprehensive analysis highlights the pros and cons of various GANs in the context of developing robust iris matchers and presentation attack detectors. △ Less

Submitted 11 May, 2024; v1 submitted 25 April, 2024; originally announced April 2024.

Enhancing Privacy in Face Analytics Using Fully Homomorphic Encryption

Authors: Bharat Yalavarthi, Arjun Ramesh Kaushik, Arun Ross, Vishnu Boddeti, Nalini Ratha

Abstract: Modern face recognition systems utilize deep neural networks to extract salient features from a face. These features denote embeddings in latent space and are often stored as templates in a face recognition system. These embeddings are susceptible to data leakage and, in some cases, can even be used to reconstruct the original face image. To prevent compromising identities, template protection sch… ▽ More Modern face recognition systems utilize deep neural networks to extract salient features from a face. These features denote embeddings in latent space and are often stored as templates in a face recognition system. These embeddings are susceptible to data leakage and, in some cases, can even be used to reconstruct the original face image. To prevent compromising identities, template protection schemes are commonly employed. However, these schemes may still not prevent the leakage of soft biometric information such as age, gender and race. To alleviate this issue, we propose a novel technique that combines Fully Homomorphic Encryption (FHE) with an existing template protection scheme known as PolyProtect. We show that the embeddings can be compressed and encrypted using FHE and transformed into a secure PolyProtect template using polynomial transformation, for additional protection. We demonstrate the efficacy of the proposed approach through extensive experiments on multiple datasets. Our proposed approach ensures irreversibility and unlinkability, effectively preventing the leakage of soft biometric attributes from face embeddings without compromising recognition accuracy. △ Less

Submitted 24 April, 2024; originally announced April 2024.

Validating the Galaxy and Quasar Catalog-Level Blinding Scheme for the DESI 2024 analysis

Authors: U. Andrade, J. Mena-Fernández, H. Awan, A. J. Ross, S. Brieden, J. Pan, A. de Mattia, J. Aguilar, S. Ahlen, O. Alves, D. Brooks, E. Buckley-Geer, E. Chaussidon, T. Claybaugh, S. Cole, A. de la Macorra, Arjun Dey, P. Doel, K. Fanning, J. E. Forero-Romero, E. Gaztañaga, H. Gil-Marín, S. Gontcho A Gontcho, J. Guy, C. Hahn , et al. (38 additional authors not shown)

Abstract: In the era of precision cosmology, ensuring the integrity of data analysis through blinding techniques is paramount -- a challenge particularly relevant for the Dark Energy Spectroscopic Instrument (DESI). DESI represents a monumental effort to map the cosmic web, with the goal to measure the redshifts of tens of millions of galaxies and quasars. Given the data volume and the impact of the finding… ▽ More In the era of precision cosmology, ensuring the integrity of data analysis through blinding techniques is paramount -- a challenge particularly relevant for the Dark Energy Spectroscopic Instrument (DESI). DESI represents a monumental effort to map the cosmic web, with the goal to measure the redshifts of tens of millions of galaxies and quasars. Given the data volume and the impact of the findings, the potential for confirmation bias poses a significant challenge. To address this, we implement and validate a comprehensive blind analysis strategy for DESI Data Release 1 (DR1), tailored to the specific observables DESI is most sensitive to: Baryonic Acoustic Oscillations (BAO), Redshift-Space Distortion (RSD) and primordial non-Gaussianities (PNG). We carry out the blinding at the catalog level, implementing shifts in the redshifts of the observed galaxies to blind for BAO and RSD signals and weights to blind for PNG through a scale-dependent bias. We validate the blinding technique on mocks, as well as on data by applying a second blinding layer to perform a battery of sanity checks. We find that the blinding strategy alters the data vector in a controlled way such that the BAO and RSD analysis choices do not need any modification before and after unblinding. The successful validation of the blinding strategy paves the way for the unblinded DESI DR1 analysis, alongside future blind analyses with DESI and other surveys. △ Less

Submitted 15 April, 2024; v1 submitted 10 April, 2024; originally announced April 2024.

Comments: Supporting publication of "DESI 2024 II: Sample definitions, characteristics, and two-point clustering statistics", "DESI 2024 III: Baryon Acoustic Oscillations from Galaxies and Quasars", and "DESI 2024 V: Analysis of the full shape of two-point clustering statistics from galaxies and quasars". (v2 - update DESI references)

Weak lensing combined with the kinetic Sunyaev Zel'dovich effect: A study of baryonic feedback

Authors: L. Bigwood, A. Amon, A. Schneider, J. Salcido, I. G. McCarthy, C. Preston, D. Sanchez, D. Sijacki, E. Schaan, S. Ferraro, N. Battaglia, A. Chen, S. Dodelson, A. Roodman, A. Pieres, A. Ferte, A. Alarcon, A. Drlica-Wagner, A. Choi, A. Navarro-Alsina, A. Campos, A. J. Ross, A. Carnero Rosell, B. Yin, B. Yanny , et al. (100 additional authors not shown)

Abstract: Extracting precise cosmology from weak lensing surveys requires modelling the non-linear matter power spectrum, which is suppressed at small scales due to baryonic feedback processes. However, hydrodynamical galaxy formation simulations make widely varying predictions for the amplitude and extent of this effect. We use measurements of Dark Energy Survey Year 3 weak lensing (WL) and Atacama Cosmolo… ▽ More Extracting precise cosmology from weak lensing surveys requires modelling the non-linear matter power spectrum, which is suppressed at small scales due to baryonic feedback processes. However, hydrodynamical galaxy formation simulations make widely varying predictions for the amplitude and extent of this effect. We use measurements of Dark Energy Survey Year 3 weak lensing (WL) and Atacama Cosmology Telescope DR5 kinematic Sunyaev-Zel'dovich (kSZ) to jointly constrain cosmological and astrophysical baryonic feedback parameters using a flexible analytical model, `baryonification'. First, using WL only, we compare the $S_8$ constraints using baryonification to a simulation-calibrated halo model, a simulation-based emulator model and the approach of discarding WL measurements on small angular scales. We find that model flexibility can shift the value of $S_8$ and degrade the uncertainty. The kSZ provides additional constraints on the astrophysical parameters and shifts $S_8$ to $S_8=0.823^{+0.019}_{-0.020}$, a higher value than attained using the WL-only analysis. We measure the suppression of the non-linear matter power spectrum using WL + kSZ and constrain a mean feedback scenario that is more extreme than the predictions from most hydrodynamical simulations. We constrain the baryon fractions and the gas mass fractions and find them to be generally lower than inferred from X-ray observations and simulation predictions. We conclude that the WL + kSZ measurements provide a new and complementary benchmark for building a coherent picture of the impact of gas around galaxies across observations. △ Less

Submitted 9 April, 2024; originally announced April 2024.

HOD-Dependent Systematics in Emission Line Galaxies for the DESI 2024 BAO analysis

Authors: C. Garcia-Quintero, J. Mena-Fernández, A. Rocher, S. Yuan, B. Hadzhiyska, O. Alves, M. Rashkovetskyi, H. Seo, N. Padmanabhan, S. Nadathur, C. Howlett, M. Ishak, L. Medina-Varela, P. McDonald, A. J. Ross, Y. Xie, X. Chen, A. Bera, J. Aguilar, S. Ahlen, U. Andrade, S. BenZvi, D. Brooks, E. Burtin, S. Chen , et al. (51 additional authors not shown)

Abstract: The Dark Energy Spectroscopic Instrument (DESI) will provide precise measurements of Baryon Acoustic Oscillations (BAO) to constrain the expansion history of the Universe and set stringent constraints on dark energy. Therefore, precise control of the global error budget due to various systematic effects is required for the DESI 2024 BAO analysis. In this work, we focus on the robustness of the BAO… ▽ More The Dark Energy Spectroscopic Instrument (DESI) will provide precise measurements of Baryon Acoustic Oscillations (BAO) to constrain the expansion history of the Universe and set stringent constraints on dark energy. Therefore, precise control of the global error budget due to various systematic effects is required for the DESI 2024 BAO analysis. In this work, we focus on the robustness of the BAO analysis against the Halo Occupation Distribution (HOD) modeling for the Emission Line Galaxy (ELG) tracer. Based on a common dark matter simulation, our analysis relies on HOD mocks tuned to early DESI data, namely the One-Percent survey data. To build the mocks, we use several HOD models for the ELG tracer as well as extensions to the baseline HOD models. Among these extensions, we consider distinct recipes for galactic conformity and assembly bias. We perform two independent analyses in the Fourier space and in the configuration space. We recover the BAO signal from two-point measurements after performing reconstruction on our mocks. Additionally, we also apply the control variates technique to reduce sample variance noise. Our BAO analysis can recover the isotropic BAO parameter $α_\text{iso}$ within 0.1\% and the Alcock Paczynski parameter $α_\text{AP}$ within 0.3\%. Overall, we find that our systematic error due to the HOD dependence is below 0.17\%, with the Fourier space analysis being more robust against the HOD systematics. We conclude that our analysis pipeline is robust enough against the HOD systematics for the ELG tracer in the DESI 2024 BAO analysis. △ Less

Submitted 12 April, 2024; v1 submitted 3 April, 2024; originally announced April 2024.

Comments: Supporting publication of DESI 2024 III: Baryon Acoustic Oscillations from Galaxies and Quasars

HOD-Dependent Systematics for Luminous Red Galaxies in the DESI 2024 BAO Analysis

Authors: J. Mena-Fernández, C. Garcia-Quintero, S. Yuan, B. Hadzhiyska, O. Alves, M. Rashkovetskyi, H. Seo, N. Padmanabhan, S. Nadathur, C. Howlett, S. Alam, A. Rocher, A. J. Ross, E. Sanchez, M. Ishak, J. Aguilar, S. Ahlen, U. Andrade, S. BenZvi, D. Brooks, E. Burtin, S. Chen, X. Chen, T. Claybaugh, S. Cole , et al. (50 additional authors not shown)

Abstract: In this paper, we present the estimation of systematics related to the halo occupation distribution (HOD) modeling in the baryon acoustic oscillations (BAO) distance measurement of the Dark Energy Spectroscopic Instrument (DESI) 2024 analysis. This paper focuses on the study of HOD systematics for luminous red galaxies (LRG). We consider three different HOD models for LRGs, including the base 5-pa… ▽ More In this paper, we present the estimation of systematics related to the halo occupation distribution (HOD) modeling in the baryon acoustic oscillations (BAO) distance measurement of the Dark Energy Spectroscopic Instrument (DESI) 2024 analysis. This paper focuses on the study of HOD systematics for luminous red galaxies (LRG). We consider three different HOD models for LRGs, including the base 5-parameter vanilla model and two extensions to it, that we refer to as baseline and extended models. The baseline model is described by the 5 vanilla HOD parameters, an incompleteness factor and a velocity bias parameter, whereas the extended one also includes a galaxy assembly bias and a satellite profile parameter. We utilize the 25 dark matter simulations available in the AbacusSummit simulation suite at $z=$ 0.8 and generate mock catalogs for our different HOD models. To test the impact of the HOD modeling in the position of the BAO peak, we run BAO fits for all these sets of simulations and compare the best-fit BAO-scaling parameters $α_{\rm iso}$ and $α_{\rm AP}$ between every pair of HOD models. We do this for both Fourier and configuration spaces independently, using post-reconstruction measurements. We find a 3.3$σ$ detection of HOD systematic for $α_{\rm AP}$ in configuration space with an amplitude of 0.19%. For the other cases, we did not find a 3$σ$ detection, and we decided to compute a conservative estimation of the systematic using the ensemble of shifts between all pairs of HOD models. By doing this, we quote a systematic with an amplitude of 0.07% in $α_{\rm iso}$ for both Fourier and configuration spaces; and of 0.09% in $α_{\rm AP}$ for Fourier space. △ Less

Submitted 5 April, 2024; v1 submitted 3 April, 2024; originally announced April 2024.

Comments: 36 pages, 9 figures. Supporting publication of DESI 2024 III: Baryon Acoustic Oscillations from Galaxies and Quasars

Semi-analytical covariance matrices for two-point correlation function for DESI 2024 data

Authors: M. Rashkovetskyi, D. Forero-Sánchez, A. de Mattia, D. J. Eisenstein, N. Padmanabhan, H. Seo, A. J. Ross, J. Aguilar, S. Ahlen, O. Alves, U. Andrade, D. Brooks, E. Burtin, T. Claybaugh, S. Cole, A. de la Macorra, Z. Ding, P. Doel, K. Fanning, S. Ferraro, A. Font-Ribera, J. E. Forero-Romero, C. Garcia-Quintero, H. Gil-Marín, S. Gontcho A Gontcho , et al. (34 additional authors not shown)

Abstract: We present an optimized way of producing the fast semi-analytical covariance matrices for the Legendre moments of the two-point correlation function, taking into account survey geometry and mimicking the non-Gaussian effects. We validate the approach on simulated (mock) catalogs for different galaxy types, representative of the Dark Energy Spectroscopic Instrument (DESI) Data Release 1, used in 20… ▽ More We present an optimized way of producing the fast semi-analytical covariance matrices for the Legendre moments of the two-point correlation function, taking into account survey geometry and mimicking the non-Gaussian effects. We validate the approach on simulated (mock) catalogs for different galaxy types, representative of the Dark Energy Spectroscopic Instrument (DESI) Data Release 1, used in 2024 analyses. We find only a few percent differences between the mock sample covariance matrix and our results, which can be expected given the approximate nature of the mocks, although we do identify discrepancies between the shot-noise properties of the DESI fiber assignment algorithm and the faster approximation used in the mocks. Importantly, we find a close agreement (<~ 5% relative differences) in the projected errorbars for distance scale parameters for the baryon acoustic oscillation measurements. This confirms our method as an attractive alternative to simulation-based covariance matrices, especially for non-standard models or galaxy sample selections, in particular, relevant to the broad current and future analyses of DESI data. △ Less

Submitted 5 April, 2024; v1 submitted 3 April, 2024; originally announced April 2024.

Comments: Supporting publication of DESI 2024 III: Baryon Acoustic Oscillations from Galaxies and Quasars (arXiv:2404.03000). 29 pages, 4 figures. Prepared for submission to JCAP. Code available at https://github.com/oliverphilcox/RascalC and https://github.com/misharash/RascalC-scripts/tree/DESI2024. Data points from the plots available at https://zenodo.org/doi/10.5281/zenodo.10895161

Production of Alternate Realizations of DESI Fiber Assignment for Unbiased Clustering Measurement in Data and Simulations

Authors: J. Lasker, A. Carnero Rosell, A. D. Myers, A. J. Ross, D. Bianchi, M. M. S Hanif, R. Kehoe, A. de Mattia, L. Napolitano, W. J. Percival, R. Staten, J. Aguilar, S. Ahlen, L. Bigwood, D. Brooks, T. Claybaugh, S. Cole, A. de la Macorra, Z. Ding, P. Doel, K. Fanning, J. E. Forero-Romero, E. Gaztañaga, S. Gontcho A Gontcho, G. Gutierrez , et al. (30 additional authors not shown)

Abstract: A critical requirement of spectroscopic large scale structure analyses is correcting for selection of which galaxies to observe from an isotropic target list. This selection is often limited by the hardware used to perform the survey which will impose angular constraints of simultaneously observable targets, requiring multiple passes to observe all of them. In SDSS this manifested solely as the co… ▽ More A critical requirement of spectroscopic large scale structure analyses is correcting for selection of which galaxies to observe from an isotropic target list. This selection is often limited by the hardware used to perform the survey which will impose angular constraints of simultaneously observable targets, requiring multiple passes to observe all of them. In SDSS this manifested solely as the collision of physical fibers and plugs placed in plates. In DESI, there is the additional constraint of the robotic positioner which controls each fiber being limited to a finite patrol radius. A number of approximate methods have previously been proposed to correct the galaxy clustering statistics for these effects, but these generally fail on small scales. To accurately correct the clustering we need to upweight pairs of galaxies based on the inverse probability that those pairs would be observed (Bianchi \& Percival 2017). This paper details an implementation of that method to correct the Dark Energy Spectroscopic Instrument (DESI) survey for incompleteness. To calculate the required probabilities, we need a set of alternate realizations of DESI where we vary the relative priority of otherwise identical targets. These realizations take the form of alternate Merged Target Ledgers (AMTL), the files that link DESI observations and targets. We present the method used to generate these alternate realizations and how they are tracked forward in time using the real observational record and hardware status, propagating the survey as though the alternate orderings had been adopted. We detail the first applications of this method to the DESI One-Percent Survey (SV3) and the DESI year 1 data. We include evaluations of the pipeline outputs, estimation of survey completeness from this and other methods, and validation of the method using mock galaxy catalogs. △ Less

Submitted 22 April, 2024; v1 submitted 3 April, 2024; originally announced April 2024.

Comments: 30 pages, 21 figures

Optimal Reconstruction of Baryon Acoustic Oscillations for DESI 2024

Authors: E. Paillas, Z. Ding, X. Chen, H. Seo, N. Padmanabhan, A. de Mattia, A. J. Ross, S. Nadathur, C. Howlett, J. Aguilar, S. Ahlen, O. Alves, U. Andrade, D. Brooks, E. Buckley-Geer, E. Burtin, S. Chen, T. Claybaugh, S. Cole, K. Dawson, A. de la Macorra, Arjun Dey, P. Doel, K. Fanning, S. Ferraro , et al. (51 additional authors not shown)

Abstract: Baryon acoustic oscillations (BAO) provide a robust standard ruler to measure the expansion history of the Universe through galaxy clustering. Density-field reconstruction is now a widely adopted procedure for increasing the precision and accuracy of the BAO detection. With the goal of finding the optimal reconstruction settings to be used in the DESI 2024 galaxy BAO analysis, we assess the sensit… ▽ More Baryon acoustic oscillations (BAO) provide a robust standard ruler to measure the expansion history of the Universe through galaxy clustering. Density-field reconstruction is now a widely adopted procedure for increasing the precision and accuracy of the BAO detection. With the goal of finding the optimal reconstruction settings to be used in the DESI 2024 galaxy BAO analysis, we assess the sensitivity of the post-reconstruction BAO constraints to different choices in our analysis configuration, performing tests on blinded data from the first year of DESI observations (DR1), as well as on mocks that mimic the expected clustering and selection properties of the DESI DR1 target samples. Overall, we find that BAO constraints remain robust against multiple aspects in the reconstruction process, including the choice of smoothing scale, treatment of redshift-space distortions, fiber assignment incompleteness, and parameterizations of the BAO model. We also present a series of tests that DESI followed in order to assess the maturity of the end-to-end galaxy BAO pipeline before the unblinding of the large-scale structure catalogs. △ Less

Submitted 14 April, 2024; v1 submitted 3 April, 2024; originally announced April 2024.

Comments: Supporting publication of DESI 2024 III: Baryon Acoustic Oscillations from Galaxies and Quasars

DESI 2024 VI: Cosmological Constraints from the Measurements of Baryon Acoustic Oscillations

Authors: DESI Collaboration, A. G. Adame, J. Aguilar, S. Ahlen, S. Alam, D. M. Alexander, M. Alvarez, O. Alves, A. Anand, U. Andrade, E. Armengaud, S. Avila, A. Aviles, H. Awan, B. Bahr-Kalus, S. Bailey, C. Baltay, A. Bault, J. Behera, S. BenZvi, A. Bera, F. Beutler, D. Bianchi, C. Blake, R. Blum , et al. (178 additional authors not shown)

Abstract: We present cosmological results from the measurement of baryon acoustic oscillations (BAO) in galaxy, quasar and Lyman-$α$ forest tracers from the first year of observations from the Dark Energy Spectroscopic Instrument (DESI), to be released in the DESI Data Release 1. DESI BAO provide robust measurements of the transverse comoving distance and Hubble rate, or their combination, relative to the s… ▽ More We present cosmological results from the measurement of baryon acoustic oscillations (BAO) in galaxy, quasar and Lyman-$α$ forest tracers from the first year of observations from the Dark Energy Spectroscopic Instrument (DESI), to be released in the DESI Data Release 1. DESI BAO provide robust measurements of the transverse comoving distance and Hubble rate, or their combination, relative to the sound horizon, in seven redshift bins from over 6 million extragalactic objects in the redshift range $0.1<z<4.2$. DESI BAO data alone are consistent with the standard flat $Λ$CDM cosmological model with a matter density $Ω_\mathrm{m}=0.295\pm 0.015$. Paired with a BBN prior and the robustly measured acoustic angular scale from the CMB, DESI requires $H_0=(68.52\pm0.62)$ km/s/Mpc. In conjunction with CMB anisotropies from Planck and CMB lensing data from Planck and ACT, we find $Ω_\mathrm{m}=0.307\pm 0.005$ and $H_0=(67.97\pm0.38)$ km/s/Mpc. Extending the baseline model with a constant dark energy equation of state parameter $w$, DESI BAO alone require $w=-0.99^{+0.15}_{-0.13}$. In models with a time-varying dark energy equation of state parametrized by $w_0$ and $w_a$, combinations of DESI with CMB or with SN~Ia individually prefer $w_0>-1$ and $w_a<0$. This preference is 2.6$σ$ for the DESI+CMB combination, and persists or grows when SN~Ia are added in, giving results discrepant with the $Λ$CDM model at the $2.5σ$, $3.5σ$ or $3.9σ$ levels for the addition of Pantheon+, Union3, or DES-SN5YR datasets respectively. For the flat $Λ$CDM model with the sum of neutrino mass $\sum m_ν$ free, combining the DESI and CMB data yields an upper limit $\sum m_ν< 0.072$ $(0.113)$ eV at 95% confidence for a $\sum m_ν>0$ $(\sum m_ν>0.059)$ eV prior. These neutrino-mass constraints are substantially relaxed in models beyond $Λ$CDM. [Abridged.] △ Less

Submitted 24 April, 2024; v1 submitted 3 April, 2024; originally announced April 2024.

Comments: This DESI Collaboration Key Publication is part of the 2024 publication series using the first year of observations (see https://data.desi.lbl.gov/doc/papers). Typos corrected and a new figure and discussion added to Appendix A

DESI 2024 IV: Baryon Acoustic Oscillations from the Lyman Alpha Forest

Authors: DESI Collaboration, A. G. Adame, J. Aguilar, S. Ahlen, S. Alam, D. M. Alexander, M. Alvarez, O. Alves, A. Anand, U. Andrade, E. Armengaud, S. Avila, A. Aviles, H. Awan, S. Bailey, C. Baltay, A. Bault, J. Bautista, J. Behera, S. BenZvi, F. Beutler, D. Bianchi, C. Blake, R. Blum, S. Brieden , et al. (174 additional authors not shown)

Abstract: We present the measurement of Baryon Acoustic Oscillations (BAO) from the Lyman-$α$ (Ly$α$) forest of high-redshift quasars with the first-year dataset of the Dark Energy Spectroscopic Instrument (DESI). Our analysis uses over $420\,000$ Ly$α$ forest spectra and their correlation with the spatial distribution of more than $700\,000$ quasars. An essential facet of this work is the development of a… ▽ More We present the measurement of Baryon Acoustic Oscillations (BAO) from the Lyman-$α$ (Ly$α$) forest of high-redshift quasars with the first-year dataset of the Dark Energy Spectroscopic Instrument (DESI). Our analysis uses over $420\,000$ Ly$α$ forest spectra and their correlation with the spatial distribution of more than $700\,000$ quasars. An essential facet of this work is the development of a new analysis methodology on a blinded dataset. We conducted rigorous tests using synthetic data to ensure the reliability of our methodology and findings before unblinding. Additionally, we conducted multiple data splits to assess the consistency of the results and scrutinized various analysis approaches to confirm their robustness. For a given value of the sound horizon ($r_d$), we measure the expansion at $z_{\rm eff}=2.33$ with 2\% precision, $H(z_{\rm eff}) = (239.2 \pm 4.8) (147.09~{\rm Mpc} /r_d)$ km/s/Mpc. Similarly, we present a 2.4\% measurement of the transverse comoving distance to the same redshift, $D_M(z_{\rm eff}) = (5.84 \pm 0.14) (r_d/147.09~{\rm Mpc})$ Gpc. Together with other DESI BAO measurements at lower redshifts, these results are used in a companion paper to constrain cosmological parameters. △ Less

Submitted 12 April, 2024; v1 submitted 3 April, 2024; originally announced April 2024.

Comments: This DESI Collaboration Key Publication is part of the 2024 publication series using the first year of observations (see https://data.desi.lbl.gov/doc/papers)

DESI 2024 III: Baryon Acoustic Oscillations from Galaxies and Quasars

Authors: DESI Collaboration, A. G. Adame, J. Aguilar, S. Ahlen, S. Alam, D. M. Alexander, M. Alvarez, O. Alves, A. Anand, U. Andrade, E. Armengaud, S. Avila, A. Aviles, H. Awan, S. Bailey, C. Baltay, A. Bault, J. Behera, S. BenZvi, F. Beutler, D. Bianchi, C. Blake, R. Blum, S. Brieden, A. Brodzeller , et al. (171 additional authors not shown)

Abstract: We present the DESI 2024 galaxy and quasar baryon acoustic oscillations (BAO) measurements using over 5.7 million unique galaxy and quasar redshifts in the range 0.1<z<2.1. Divided by tracer type, we utilize 300,017 galaxies from the magnitude-limited Bright Galaxy Survey with 0.1<z<0.4, 2,138,600 Luminous Red Galaxies with 0.4<z<1.1, 2,432,022 Emission Line Galaxies with 0.8<z<1.6, and 856,652 qu… ▽ More We present the DESI 2024 galaxy and quasar baryon acoustic oscillations (BAO) measurements using over 5.7 million unique galaxy and quasar redshifts in the range 0.1<z<2.1. Divided by tracer type, we utilize 300,017 galaxies from the magnitude-limited Bright Galaxy Survey with 0.1<z<0.4, 2,138,600 Luminous Red Galaxies with 0.4<z<1.1, 2,432,022 Emission Line Galaxies with 0.8<z<1.6, and 856,652 quasars with 0.8<z<2.1, over a ~7,500 square degree footprint. The analysis was blinded at the catalog-level to avoid confirmation bias. All fiducial choices of the BAO fitting and reconstruction methodology, as well as the size of the systematic errors, were determined on the basis of the tests with mock catalogs and the blinded data catalogs. We present several improvements to the BAO analysis pipeline, including enhancing the BAO fitting and reconstruction methods in a more physically-motivated direction, and also present results using combinations of tracers. We present a re-analysis of SDSS BOSS and eBOSS results applying the improved DESI methodology and find scatter consistent with the level of the quoted SDSS theoretical systematic uncertainties. With the total effective survey volume of ~ 18 Gpc$^3$, the combined precision of the BAO measurements across the six different redshift bins is ~0.52%, marking a 1.2-fold improvement over the previous state-of-the-art results using only first-year data. We detect the BAO in all of these six redshift bins. The highest significance of BAO detection is $9.1σ$ at the effective redshift of 0.93, with a constraint of 0.86% placed on the BAO scale. We find our measurements are systematically larger than the prediction of Planck-2018 LCDM model at z<0.8. We translate the results into transverse comoving distance and radial Hubble distance measurements, which are used to constrain cosmological models in our companion paper [abridged]. △ Less

Submitted 3 April, 2024; originally announced April 2024.

Comments: This DESI Collaboration Key Publication is part of the 2024 publication series using the first year of observations (see https://data.desi.lbl.gov/doc/papers)

Alpha-wolves and Alpha-mammals: Exploring Dictionary Attacks on Iris Recognition Systems

Authors: Sudipta Banerjee, Anubhav Jain, Zehua Jiang, Nasir Memon, Julian Togelius, Arun Ross

Abstract: A dictionary attack in a biometric system entails the use of a small number of strategically generated images or templates to successfully match with a large number of identities, thereby compromising security. We focus on dictionary attacks at the template level, specifically the IrisCodes used in iris recognition systems. We present an hitherto unknown vulnerability wherein we mix IrisCodes usin… ▽ More A dictionary attack in a biometric system entails the use of a small number of strategically generated images or templates to successfully match with a large number of identities, thereby compromising security. We focus on dictionary attacks at the template level, specifically the IrisCodes used in iris recognition systems. We present an hitherto unknown vulnerability wherein we mix IrisCodes using simple bitwise operators to generate alpha-mixtures - alpha-wolves (combining a set of "wolf" samples) and alpha-mammals (combining a set of users selected via search optimization) that increase false matches. We evaluate this vulnerability using the IITD, CASIA-IrisV4-Thousand and Synthetic datasets, and observe that an alpha-wolf (from two wolves) can match upto 71 identities @FMR=0.001%, while an alpha-mammal (from two identities) can match upto 133 other identities @FMR=0.01% on the IITD dataset. △ Less

Submitted 20 November, 2023; originally announced March 2024.

Comments: 8 pages, 5 figures, 13 tables, Workshop on Manipulation, Adversarial, and Presentation Attacks in Biometrics, Winter Conference on Applications of Computer Vision

A Probabilistic Hadamard U-Net for MRI Bias Field Correction

Authors: Xin Zhu, Hongyi Pan, Yury Velichko, Adam B. Murphy, Ashley Ross, Baris Turkbey, Ahmet Enis Cetin, Ulas Bagci

Abstract: Magnetic field inhomogeneity correction remains a challenging task in MRI analysis. Most established techniques are designed for brain MRI by supposing that image intensities in the identical tissue follow a uniform distribution. Such an assumption cannot be easily applied to other organs, especially those that are small in size and heterogeneous in texture (large variations in intensity), such as… ▽ More Magnetic field inhomogeneity correction remains a challenging task in MRI analysis. Most established techniques are designed for brain MRI by supposing that image intensities in the identical tissue follow a uniform distribution. Such an assumption cannot be easily applied to other organs, especially those that are small in size and heterogeneous in texture (large variations in intensity), such as the prostate. To address this problem, this paper proposes a probabilistic Hadamard U-Net (PHU-Net) for prostate MRI bias field correction. First, a novel Hadamard U-Net (HU-Net) is introduced to extract the low-frequency scalar field, multiplied by the original input to obtain the prototypical corrected image. HU-Net converts the input image from the time domain into the frequency domain via Hadamard transform. In the frequency domain, high-frequency components are eliminated using the trainable filter (scaling layer), hard-thresholding layer, and sparsity penalty. Next, a conditional variational autoencoder is used to encode possible bias field-corrected variants into a low-dimensional latent space. Random samples drawn from latent space are then incorporated with a prototypical corrected image to generate multiple plausible images. Experimental results demonstrate the effectiveness of PHU-Net in correcting bias-field in prostate MRI with a fast inference speed. It has also been shown that prostate MRI segmentation accuracy improves with the high-quality corrected images from PHU-Net. The code will be available in the final version of this manuscript. △ Less

Submitted 7 March, 2024; originally announced March 2024.

SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code

Authors: Ziniu Hu, Ahmet Iscen, Aashi Jain, Thomas Kipf, Yisong Yue, David A. Ross, Cordelia Schmid, Alireza Fathi

Abstract: This paper introduces SceneCraft, a Large Language Model (LLM) Agent converting text descriptions into Blender-executable Python scripts which render complex scenes with up to a hundred 3D assets. This process requires complex spatial planning and arrangement. We tackle these challenges through a combination of advanced abstraction, strategic planning, and library learning. SceneCraft first models… ▽ More This paper introduces SceneCraft, a Large Language Model (LLM) Agent converting text descriptions into Blender-executable Python scripts which render complex scenes with up to a hundred 3D assets. This process requires complex spatial planning and arrangement. We tackle these challenges through a combination of advanced abstraction, strategic planning, and library learning. SceneCraft first models a scene graph as a blueprint, detailing the spatial relationships among assets in the scene. SceneCraft then writes Python scripts based on this graph, translating relationships into numerical constraints for asset layout. Next, SceneCraft leverages the perceptual strengths of vision-language foundation models like GPT-V to analyze rendered images and iteratively refine the scene. On top of this process, SceneCraft features a library learning mechanism that compiles common script functions into a reusable library, facilitating continuous self-improvement without expensive LLM parameter tuning. Our evaluation demonstrates that SceneCraft surpasses existing LLM-based agents in rendering complex scenes, as shown by its adherence to constraints and favorable human assessments. We also showcase the broader application potential of SceneCraft by reconstructing detailed 3D scenes from the Sintel movie and guiding a video generative model with generated scenes as intermediary control signal. △ Less

Submitted 2 March, 2024; originally announced March 2024.

Redshift evolution and covariances for joint lensing and clustering studies with DESI Y1

Authors: Sihan Yuan, Chris Blake, Alex Krolewski, Johannes Lange, Jack Elvin-Poole, Alexie Leauthaud, Joseph DeRose, Jessica Nicole Aguilar, Steven Ahlen, Gillian Beltz-Mohrmann, David Brooks, Todd Claybaugh, Axel de la Macorra, Peter Doel, Ni Putu Audita Placida Emas, Simone Ferraro, Jaime E. Forero-Romero, Cristhian Garcia-Quintero, Enrique Gaztañaga, Satya Gontcho A Gontcho, Boryana Hadzhiyska, Sven Heydenreich, Klaus Honscheid, Mustapha Ishak, Shahab Joudaki , et al. (26 additional authors not shown)

Abstract: Galaxy-galaxy lensing (GGL) and clustering measurements from the Dark Energy Spectroscopic Instrument Year 1 (DESI Y1) dataset promise to yield unprecedented combined-probe tests of cosmology and the galaxy-halo connection. In such analyses, it is essential to identify and characterise all relevant statistical and systematic errors. In this paper, we forecast the covariances of DESI Y1 GGL+cluster… ▽ More Galaxy-galaxy lensing (GGL) and clustering measurements from the Dark Energy Spectroscopic Instrument Year 1 (DESI Y1) dataset promise to yield unprecedented combined-probe tests of cosmology and the galaxy-halo connection. In such analyses, it is essential to identify and characterise all relevant statistical and systematic errors. In this paper, we forecast the covariances of DESI Y1 GGL+clustering measurements and characterise the systematic bias due to redshift evolution in the lens samples. Focusing on the projected clustering and galaxy-galaxy lensing correlations, we compute a Gaussian analytical covariance, using a suite of N-body and log-normal simulations to characterise the effect of the survey footprint. Using the DESI One Percent Survey data, we measure the evolution of galaxy bias parameters for the DESI Luminous Red Galaxy (LRG) and Bright Galaxy Survey (BGS) samples. We find mild evolution in the LRGs in 0.4 < z < 0.8, subdominant compared to the expected statistical errors. For BGS, we find less evolution effects for brighter absolute magnitude cuts, at the cost of reduced sample size. We find that with a fiducial redshift bin width delta z = 0.1, evolution effects on GGL is negligible across all scales, all fiducial selection cuts, all fiducial redshift bins, given DESI Y1 sample size. Galaxy clustering is more sensitive to evolution due to the bias squared scaling. Nevertheless the redshift evolution effect is insignificant for clustering above the 1-halo scale of 0.1Mpc/h. For studies that wish to reliably access smaller scales, additional treatment of redshift evolution is likely needed. This study serves as a reference for GGL and clustering studies using the DESI Y1 sample △ Less

Submitted 1 March, 2024; originally announced March 2024.

Comments: 19 pages, 15 figures, submitted to MNRAS

Baryon Acoustic Oscillation Theory and Modelling Systematics for the DESI 2024 results

Authors: Shi-Fan Chen, Cullan Howlett, Martin White, Patrick McDonald, Ashley J. Ross, Hee-Jong Seo, Nikhil Padmanabhan, J. Aguilar, S. Ahlen, S. Alam, O. Alves, R. Blum, D. Brooks, X. Chen, S. Cole, T. M. Davis, K. Dawson, A. de la Macorra, Arjun Dey, Z. Ding, P. Doel, S. Ferraro, A. Font-Ribera, D. Forero-Sánchez, J. E. Forero-Romero , et al. (33 additional authors not shown)

Abstract: This paper provides a comprehensive overview of how fitting of Baryon Acoustic Oscillations (BAO) is carried out within the upcoming Dark Energy Spectroscopic Instrument's (DESI) 2024 results using its DR1 dataset, and the associated systematic error budget from theory and modelling of the BAO. We derive new results showing how non-linearities in the clustering of galaxies can cause potential bias… ▽ More This paper provides a comprehensive overview of how fitting of Baryon Acoustic Oscillations (BAO) is carried out within the upcoming Dark Energy Spectroscopic Instrument's (DESI) 2024 results using its DR1 dataset, and the associated systematic error budget from theory and modelling of the BAO. We derive new results showing how non-linearities in the clustering of galaxies can cause potential biases in measurements of the isotropic ($α_{\mathrm{iso}}$) and anisotropic ($α_{\mathrm{ap}}$) BAO distance scales, and how these can be effectively removed with an appropriate choice of reconstruction algorithm. We then demonstrate how theory leads to a clear choice for how to model the BAO and develop, implement and validate a new model for the remaining smooth-broadband (i.e., without BAO) component of the galaxy clustering. Finally, we explore the impact of all remaining modelling choices on the BAO constraints from DESI using a suite of high-precision simulations, arriving at a set of best-practices for DESI BAO fits, and an associated theory and modelling systematic error. Overall, our results demonstrate the remarkable robustness of the BAO to all our modelling choices and motivate a combined theory and modelling systematic error contribution to the post-reconstruction DESI BAO measurements of no more than $0.1\%$ ($0.2\%$) for its isotropic (anisotropic) distance measurements. We expect the theory and best-practices laid out to here to be applicable to other BAO experiments in the era of DESI and beyond. △ Less

Submitted 21 February, 2024; originally announced February 2024.

Comments: 29 pages, 18 figures, 1 table, submitted to MNRAS

VideoPrism: A Foundational Visual Encoder for Video Understanding

Authors: Long Zhao, Nitesh B. Gundavarapu, Liangzhe Yuan, Hao Zhou, Shen Yan, Jennifer J. Sun, Luke Friedman, Rui Qian, Tobias Weyand, Yue Zhao, Rachel Hornung, Florian Schroff, Ming-Hsuan Yang, David A. Ross, Huisheng Wang, Hartwig Adam, Mikhail Sirotenko, Ting Liu, Boqing Gong

Abstract: We introduce VideoPrism, a general-purpose video encoder that tackles diverse video understanding tasks with a single frozen model. We pretrain VideoPrism on a heterogeneous corpus containing 36M high-quality video-caption pairs and 582M video clips with noisy parallel text (e.g., ASR transcripts). The pretraining approach improves upon masked autoencoding by global-local distillation of semantic… ▽ More We introduce VideoPrism, a general-purpose video encoder that tackles diverse video understanding tasks with a single frozen model. We pretrain VideoPrism on a heterogeneous corpus containing 36M high-quality video-caption pairs and 582M video clips with noisy parallel text (e.g., ASR transcripts). The pretraining approach improves upon masked autoencoding by global-local distillation of semantic video embeddings and a token shuffling scheme, enabling VideoPrism to focus primarily on the video modality while leveraging the invaluable text associated with videos. We extensively test VideoPrism on four broad groups of video understanding tasks, from web video question answering to CV for science, achieving state-of-the-art performance on 31 out of 33 video understanding benchmarks. △ Less

Submitted 15 June, 2024; v1 submitted 20 February, 2024; originally announced February 2024.

Comments: Accepted to ICML 2024. v2: added retrieval results on MSRVTT (1K-A), more data analyses, and ablation studies

Dark Energy Survey: Galaxy Sample for the Baryonic Acoustic Oscillation Measurement from the Final Dataset

Authors: J. Mena-Fernández, M. Rodríguez-Monroy, S. Avila, A. Porredon, K. C. Chan, H. Camacho, N. Weaverdyck, I. Sevilla-Noarbe, E. Sanchez, L. Toribio San Cipriano, J. De Vicente, I. Ferrero, R. Cawthon, A. Carnero Rosell, J. Elvin-Poole, G. Giannini, M. Adamow, K. Bechtol, A. Drlica-Wagner, R. A. Gruendl, W. G. Hartley, A. Pieres, A. J. Ross, E. S. Rykoff, E. Sheldon , et al. (63 additional authors not shown)

Abstract: In this paper we present and validate the galaxy sample used for the analysis of the baryon acoustic oscillation (BAO) signal in the Dark Energy Survey (DES) Y6 data. The definition is based on a color and redshift-dependent magnitude cut optimized to select galaxies at redshifts higher than 0.6, while ensuring a high-quality photo-$z$ determination. The optimization is performed using a Fisher fo… ▽ More In this paper we present and validate the galaxy sample used for the analysis of the baryon acoustic oscillation (BAO) signal in the Dark Energy Survey (DES) Y6 data. The definition is based on a color and redshift-dependent magnitude cut optimized to select galaxies at redshifts higher than 0.6, while ensuring a high-quality photo-$z$ determination. The optimization is performed using a Fisher forecast algorithm, finding the optimal $i$-magnitude cut to be given by $i$<19.64+2.894$z_{\rm ph}$. For the optimal sample, we forecast an increase in precision in the BAO measurement of $\sim$25% with respect to the Y3 analysis. Our BAO sample has a total of 15,937,556 galaxies in the redshift range 0.6<$z_{\rm ph}$<1.2, and its angular mask covers 4,273.42 deg${}^2$ to a depth of $i$=22.5. We validate its redshift distributions with three different methods: directional neighborhood fitting algorithm (DNF), which is our primary photo-$z$ estimation; direct calibration with spectroscopic redshifts from VIPERS; and clustering redshift using SDSS galaxies. The fiducial redshift distribution is a combination of these three techniques performed by modifying the mean and width of the DNF distributions to match those of VIPERS and clustering redshift. In this paper we also describe the methodology used to mitigate the effect of observational systematics, which is analogous to the one used in the Y3 analysis. This paper is one of the two dedicated to the analysis of the BAO signal in DES Y6. In its companion paper, we present the angular diameter distance constraints obtained through the fitting to the BAO scale. △ Less

Submitted 16 February, 2024; originally announced February 2024.

Comments: 23 pages, 10 figures. Submitted to PRD

Report number: FERMILAB-PUB-24-0072-PPD

Dark Energy Survey: A 2.1% measurement of the angular Baryonic Acoustic Oscillation scale at redshift $z_{\rm eff}$=0.85 from the final dataset

Authors: DES Collaboration, T. M. C. Abbott, M. Adamow, M. Aguena, S. Allam, O. Alves, A. Amon, F. Andrade-Oliveira, J. Asorey, S. Avila, D. Bacon, K. Bechtol, G. M. Bernstein, E. Bertin, J. Blazek, S. Bocquet, D. Brooks, D. L. Burke, H. Camacho, A. Carnero Rosell, D. Carollo, J. Carretero, F. J. Castander, R. Cawthon, K. C. Chan , et al. (83 additional authors not shown)

Abstract: We present the angular diameter distance measurement obtained with the Baryonic Acoustic Oscillation feature from galaxy clustering in the completed Dark Energy Survey, consisting of six years (Y6) of observations. We use the Y6 BAO galaxy sample, optimized for BAO science in the redshift range 0.6<$z$<1.2, with an effective redshift at $z_{\rm eff}$=0.85 and split into six tomographic bins. The s… ▽ More We present the angular diameter distance measurement obtained with the Baryonic Acoustic Oscillation feature from galaxy clustering in the completed Dark Energy Survey, consisting of six years (Y6) of observations. We use the Y6 BAO galaxy sample, optimized for BAO science in the redshift range 0.6<$z$<1.2, with an effective redshift at $z_{\rm eff}$=0.85 and split into six tomographic bins. The sample has nearly 16 million galaxies over 4,273 square degrees. Our consensus measurement constrains the ratio of the angular distance to sound horizon scale to $D_M(z_{\rm eff})/r_d$ = 19.51$\pm$0.41 (at 68.3% confidence interval), resulting from comparing the BAO position in our data to that predicted by Planck $Λ$CDM via the BAO shift parameter $α=(D_M/r_d)/(D_M/r_d)_{\rm Planck}$. To achieve this, the BAO shift is measured with three different methods, Angular Correlation Function (ACF), Angular Power Spectrum (APS), and Projected Correlation Function (PCF) obtaining $α=$ 0.952$\pm$0.023, 0.962$\pm$0.022, and 0.955$\pm$0.020, respectively, which we combine to $α=$ 0.957$\pm$0.020, including systematic errors. When compared with the $Λ$CDM model that best fits Planck data, this measurement is found to be 4.3% and 2.1$σ$ below the angular BAO scale predicted. To date, it represents the most precise angular BAO measurement at $z$>0.75 from any survey and the most precise measurement at any redshift from photometric surveys. The analysis was performed blinded to the BAO position and it is shown to be robust against analysis choices, data removal, redshift calibrations and observational systematics. △ Less

Submitted 16 February, 2024; originally announced February 2024.

Comments: Submitted to PRD, 39 pages, 12 figures

Report number: FERMILAB-PUB-24-0027-PPD

The SRG/eROSITA All-Sky Survey: Dark Energy Survey Year 3 Weak Gravitational Lensing by eRASS1 selected Galaxy Clusters

Authors: S. Grandis, V. Ghirardini, S. Bocquet, C. Garrel, J. J. Mohr, A. Liu, M. Kluge, L. Kimmig, T. H. Reiprich, A. Alarcon, A. Amon, E. Artis, Y. E. Bahar, F. Balzer, K. Bechtol, M. R. Becker, G. Bernstein, E. Bulbul, A. Campos, A. Carnero Rosell, M. Carrasco Kind, R. Cawthon, C. Chang, R. Chen, I. Chiu , et al. (97 additional authors not shown)

Abstract: Number counts of galaxy clusters across redshift are a powerful cosmological probe, if a precise and accurate reconstruction of the underlying mass distribution is performed -- a challenge called mass calibration. With the advent of wide and deep photometric surveys, weak gravitational lensing by clusters has become the method of choice to perform this measurement. We measure and validate the weak… ▽ More Number counts of galaxy clusters across redshift are a powerful cosmological probe, if a precise and accurate reconstruction of the underlying mass distribution is performed -- a challenge called mass calibration. With the advent of wide and deep photometric surveys, weak gravitational lensing by clusters has become the method of choice to perform this measurement. We measure and validate the weak gravitational lensing (WL) signature in the shape of galaxies observed in the first 3 years of the DES Y3 caused by galaxy clusters selected in the first all-sky survey performed by SRG/eROSITA. These data are then used to determine the scaling between X-ray photon count rate of the clusters and their halo mass and redshift. We empirically determine the degree of cluster member contamination in our background source sample. The individual cluster shear profiles are then analysed with a Bayesian population model that self-consistently accounts for the lens sample selection and contamination, and includes marginalization over a host of instrumental and astrophysical systematics. To quantify the accuracy of the mass extraction of that model, we perform mass measurements on mock cluster catalogs with realistic synthetic shear profiles. This allows us to establish that hydro-dynamical modelling uncertainties at low lens redshifts ($z<0.6$) are the dominant systematic limitation. At high lens redshift the uncertainties of the sources' photometric redshift calibration dominate. With regard to the X-ray count rate to halo mass relation, we constrain all its parameters. This work sets the stage for a joint analysis with the number counts of eRASS1 clusters to constrain a host of cosmological parameters. We demonstrate that WL mass calibration of galaxy clusters can be performed successfully with source galaxies whose calibration was performed primarily for cosmic shear experiments. △ Less

Submitted 13 February, 2024; originally announced February 2024.

Comments: 27 pages, 18 figures, 2 appendices, submitted to A\&A

Journal ref: A&A 687, A178 (2024)

Iris-SAM: Iris Segmentation Using a Foundation Model

Authors: Parisa Farmanifard, Arun Ross

Abstract: Iris segmentation is a critical component of an iris biometric system and it involves extracting the annular iris region from an ocular image. In this work, we develop a pixel-level iris segmentation model from a foundational model, viz., Segment Anything Model (SAM), that has been successfully used for segmenting arbitrary objects. The primary contribution of this work lies in the integration of… ▽ More Iris segmentation is a critical component of an iris biometric system and it involves extracting the annular iris region from an ocular image. In this work, we develop a pixel-level iris segmentation model from a foundational model, viz., Segment Anything Model (SAM), that has been successfully used for segmenting arbitrary objects. The primary contribution of this work lies in the integration of different loss functions during the fine-tuning of SAM on ocular images. In particular, the importance of Focal Loss is borne out in the fine-tuning process since it strategically addresses the class imbalance problem (i.e., iris versus non-iris pixels). Experiments on ND-IRIS-0405, CASIA-Iris-Interval-v3, and IIT-Delhi-Iris datasets convey the efficacy of the trained model for the task of iris segmentation. For instance, on the ND-IRIS-0405 dataset, an average segmentation accuracy of 99.58% was achieved, compared to the best baseline performance of 89.75%. △ Less

Submitted 30 May, 2024; v1 submitted 9 February, 2024; originally announced February 2024.

A Linguistic Comparison between Human and ChatGPT-Generated Conversations

Authors: Morgan Sandler, Hyesun Choung, Arun Ross, Prabu David

Abstract: This study explores linguistic differences between human and LLM-generated dialogues, using 19.5K dialogues generated by ChatGPT-3.5 as a companion to the EmpathicDialogues dataset. The research employs Linguistic Inquiry and Word Count (LIWC) analysis, comparing ChatGPT-generated conversations with human conversations across 118 linguistic categories. Results show greater variability and authenti… ▽ More This study explores linguistic differences between human and LLM-generated dialogues, using 19.5K dialogues generated by ChatGPT-3.5 as a companion to the EmpathicDialogues dataset. The research employs Linguistic Inquiry and Word Count (LIWC) analysis, comparing ChatGPT-generated conversations with human conversations across 118 linguistic categories. Results show greater variability and authenticity in human dialogues, but ChatGPT excels in categories such as social processes, analytical style, cognition, attentional focus, and positive emotional tone, reinforcing recent findings of LLMs being "more human than human." However, no significant difference was found in positive or negative affect between ChatGPT and human dialogues. Classifier analysis of dialogue embeddings indicates implicit coding of the valence of affect despite no explicit mention of affect in the conversations. The research also contributes a novel, companion ChatGPT-generated dataset of conversations between two independent chatbots, which were designed to replicate a corpus of human conversations available for open access and used widely in AI research on language modeling. Our findings enhance understanding of ChatGPT's linguistic capabilities and inform ongoing efforts to distinguish between human and LLM-generated text, which is critical in detecting AI-generated fakes, misinformation, and disinformation. △ Less

Submitted 25 April, 2024; v1 submitted 29 January, 2024; originally announced January 2024.

Comments: Proceedings of the 4th International Conference on Pattern Recognition and Artificial Intelligence (ICPRAI), Jeju, Korea, 2024

Parallel Prefix Sum with SIMD

Authors: Wangda Zhang, Yanbin Wang, Kenneth A. Ross

Abstract: The prefix sum operation is a useful primitive with a broad range of applications. For database systems, it is a building block of many important operators including join, sort and filter queries. In this paper, we study different methods of computing prefix sums with SIMD instructions and multiple threads. For SIMD, we implement and compare horizontal and vertical computations, as well as a theor… ▽ More The prefix sum operation is a useful primitive with a broad range of applications. For database systems, it is a building block of many important operators including join, sort and filter queries. In this paper, we study different methods of computing prefix sums with SIMD instructions and multiple threads. For SIMD, we implement and compare horizontal and vertical computations, as well as a theoretically work-efficient balanced tree version using gather/scatter instructions. With multithreading, the memory bandwidth can become the bottleneck of prefix sum computations. We propose a new method that partitions data into cache-sized smaller partitions to achieve better data locality and reduce bandwidth demands from RAM. We also investigate four different ways of organizing the computation sub-procedures, which have different performance and usability characteristics. In the experiments we find that the most efficient prefix sum computation using our partitioning technique is up to 3x faster than two standard library implementations that already use SIMD and multithreading. △ Less

Submitted 22 December, 2023; originally announced December 2023.