Showing 1–37 of 37 results for author: Friesen, A

Gemma 2: Improving Open Language Models at a Practical Size

Authors: Gemma Team, Morgane Riviere, Shreya Pathak, Pier Giuseppe Sessa, Cassidy Hardin, Surya Bhupatiraju, Léonard Hussenot, Thomas Mesnard, Bobak Shahriari, Alexandre Ramé, Johan Ferret, Peter Liu, Pouya Tafti, Abe Friesen, Michelle Casbon, Sabela Ramos, Ravin Kumar, Charline Le Lan, Sammy Jerome, Anton Tsitsulin, Nino Vieillard, Piotr Stanczyk, Sertan Girgin, Nikola Momchev, Matt Hoffman , et al. (172 additional authors not shown)

Abstract: In this work, we introduce Gemma 2, a new addition to the Gemma family of lightweight, state-of-the-art open models, ranging in scale from 2 billion to 27 billion parameters. In this new version, we apply several known technical modifications to the Transformer architecture, such as interleaving local-global attentions (Beltagy et al., 2020a) and group-query attention (Ainslie et al., 2023). We al… ▽ More In this work, we introduce Gemma 2, a new addition to the Gemma family of lightweight, state-of-the-art open models, ranging in scale from 2 billion to 27 billion parameters. In this new version, we apply several known technical modifications to the Transformer architecture, such as interleaving local-global attentions (Beltagy et al., 2020a) and group-query attention (Ainslie et al., 2023). We also train the 2B and 9B models with knowledge distillation (Hinton et al., 2015) instead of next token prediction. The resulting models deliver the best performance for their size, and even offer competitive alternatives to models that are 2-3 times bigger. We release all our models to the community. △ Less

Submitted 2 August, 2024; v1 submitted 31 July, 2024; originally announced August 2024.

BOND: Aligning LLMs with Best-of-N Distillation

Authors: Pier Giuseppe Sessa, Robert Dadashi, Léonard Hussenot, Johan Ferret, Nino Vieillard, Alexandre Ramé, Bobak Shariari, Sarah Perrin, Abe Friesen, Geoffrey Cideron, Sertan Girgin, Piotr Stanczyk, Andrea Michi, Danila Sinopalnikov, Sabela Ramos, Amélie Héliou, Aliaksei Severyn, Matt Hoffman, Nikola Momchev, Olivier Bachem

Abstract: Reinforcement learning from human feedback (RLHF) is a key driver of quality and safety in state-of-the-art large language models. Yet, a surprisingly simple and strong inference-time strategy is Best-of-N sampling that selects the best generation among N candidates. In this paper, we propose Best-of-N Distillation (BOND), a novel RLHF algorithm that seeks to emulate Best-of-N but without its sign… ▽ More Reinforcement learning from human feedback (RLHF) is a key driver of quality and safety in state-of-the-art large language models. Yet, a surprisingly simple and strong inference-time strategy is Best-of-N sampling that selects the best generation among N candidates. In this paper, we propose Best-of-N Distillation (BOND), a novel RLHF algorithm that seeks to emulate Best-of-N but without its significant computational overhead at inference time. Specifically, BOND is a distribution matching algorithm that forces the distribution of generations from the policy to get closer to the Best-of-N distribution. We use the Jeffreys divergence (a linear combination of forward and backward KL) to balance between mode-covering and mode-seeking behavior, and derive an iterative formulation that utilizes a moving anchor for efficiency. We demonstrate the effectiveness of our approach and several design choices through experiments on abstractive summarization and Gemma models. Aligning Gemma policies with BOND outperforms other RLHF algorithms by improving results on several benchmarks. △ Less

Submitted 19 July, 2024; originally announced July 2024.

Diquarks and $Λ^0/π^+$, $Ξ^-/π^+$ ratios in the framework of the EPNJL model

Authors: A. V. Friesen, Yu. L. Kalinovsky

Abstract: The applicability of the effective models to the description of baryons and the behaviour of ratios of strange baryons to pions is discussed. In the framework of the EPNJL model, the Bethe - Salpeter equation is used to find masses of baryons, which are considered as diquark-quark state. Baryon melting is discussed at a finite chemical potential and a flavor dependence of the hadronic deconfinemen… ▽ More The applicability of the effective models to the description of baryons and the behaviour of ratios of strange baryons to pions is discussed. In the framework of the EPNJL model, the Bethe - Salpeter equation is used to find masses of baryons, which are considered as diquark-quark state. Baryon melting is discussed at a finite chemical potential and a flavor dependence of the hadronic deconfinement temperature is pointed. It is shown that the description of the diquark-quark state at finite chemical potential is limited due to the occurrence of the Bose condensate. This effect is strongly manifested in the description of light diquarks and baryons. Both $Λ^0/π^+$ and $Ξ^-/π^+$ ratios show a sharp behaviour as functions of $T/μ_B$ variable, where T and $μ_B$ are calculated along the melting lines. △ Less

Submitted 28 September, 2023; originally announced September 2023.

Comments: 9 pages, 7 pictures, 1 table

Knowledge Transfer from Teachers to Learners in Growing-Batch Reinforcement Learning

Authors: Patrick Emedom-Nnamdi, Abram L. Friesen, Bobak Shahriari, Nando de Freitas, Matt W. Hoffman

Abstract: Standard approaches to sequential decision-making exploit an agent's ability to continually interact with its environment and improve its control policy. However, due to safety, ethical, and practicality constraints, this type of trial-and-error experimentation is often infeasible in many real-world domains such as healthcare and robotics. Instead, control policies in these domains are typically t… ▽ More Standard approaches to sequential decision-making exploit an agent's ability to continually interact with its environment and improve its control policy. However, due to safety, ethical, and practicality constraints, this type of trial-and-error experimentation is often infeasible in many real-world domains such as healthcare and robotics. Instead, control policies in these domains are typically trained offline from previously logged data or in a growing-batch manner. In this setting a fixed policy is deployed to the environment and used to gather an entire batch of new data before being aggregated with past batches and used to update the policy. This improvement cycle can then be repeated multiple times. While a limited number of such cycles is feasible in real-world domains, the quality and diversity of the resulting data are much lower than in the standard continually-interacting approach. However, data collection in these domains is often performed in conjunction with human experts, who are able to label or annotate the collected data. In this paper, we first explore the trade-offs present in this growing-batch setting, and then investigate how information provided by a teacher (i.e., demonstrations, expert actions, and gradient information) can be leveraged at training time to mitigate the sample complexity and coverage requirements for actor-critic methods. We validate our contributions on tasks from the DeepMind Control Suite. △ Less

Submitted 9 May, 2023; v1 submitted 5 May, 2023; originally announced May 2023.

Comments: Reincarnating Reinforcement Learning Workshop at ICLR 2023

Cancellation of the sigma mode in the thermal pion gas by quark Pauli blocking

Authors: David Blaschke, Alexandra Friesen, Yuriy Kalinovsky

Abstract: We calculate the pressure of the interacting pion gas using the Beth-Uhlenbeck approach to the relativistic virial expansion with Breit-Wigner phase shifts for the $σ$- and $\varrho$- meson resonances. The repulsive phase shift $δ^2_0$ is taken from quark interchange model of Barnes and Swanson [Phys. Rev. D 46 (1992) 131] in very good agreement with experimental data. In this work we show that th… ▽ More We calculate the pressure of the interacting pion gas using the Beth-Uhlenbeck approach to the relativistic virial expansion with Breit-Wigner phase shifts for the $σ$- and $\varrho$- meson resonances. The repulsive phase shift $δ^2_0$ is taken from quark interchange model of Barnes and Swanson [Phys. Rev. D 46 (1992) 131] in very good agreement with experimental data. In this work we show that the cancellation of the attractive (I = 0) and repulsive (I = 2) isospin channel contributions to the scalar $π-π$ interaction in the low-energy region that is known for the vacuum phase shifts, takes place also at finite temperature. This happens despite the strong medium dependence of these phase shifts that enters our model by the temperature dependence of the $σ$- meson and constituent quark masses because for these masses the relation $m_σ(T) \approx 2 m_q (T)$ holds and the scattering length approximation is valid as long as the strong decay channel $σ\to ππ$ is open. Exploiting the Nambu--Jona-Lasinio model for describing the dynamical breaking of chiral symmetry in the vacuum and its restoration at finite temperature, we justify with our approach that the $σ$-meson should be absent from the hadron resonance gas description at low temperatures because the above cancellation holds. However, since this cancellation breaks down in the vicinity of the hadronization transition, where due to chiral symmetry restoration the decay channel $σ\to ππ$ closes and the $σ$- meson becomes a good resonance, the latter should be included into the statistical model description of chemical freeze-out in heavy-ion collisions. △ Less

Submitted 23 January, 2023; v1 submitted 14 December, 2022; originally announced December 2022.

Comments: 8 pages, 4 figures, revision of text, references and figures

Journal ref: Symmetry 15 (2023) 3, 711

Multi-step Planning for Automated Hyperparameter Optimization with OptFormer

Authors: Lucio M. Dery, Abram L. Friesen, Nando De Freitas, Marc'Aurelio Ranzato, Yutian Chen

Abstract: As machine learning permeates more industries and models become more expensive and time consuming to train, the need for efficient automated hyperparameter optimization (HPO) has never been more pressing. Multi-step planning based approaches to hyperparameter optimization promise improved efficiency over myopic alternatives by more effectively balancing out exploration and exploitation. However, t… ▽ More As machine learning permeates more industries and models become more expensive and time consuming to train, the need for efficient automated hyperparameter optimization (HPO) has never been more pressing. Multi-step planning based approaches to hyperparameter optimization promise improved efficiency over myopic alternatives by more effectively balancing out exploration and exploitation. However, the potential of these approaches has not been fully realized due to their technical complexity and computational intensity. In this work, we leverage recent advances in Transformer-based, natural-language-interfaced hyperparameter optimization to circumvent these barriers. We build on top of the recently proposed OptFormer which casts both hyperparameter suggestion and target function approximation as autoregressive generation thus making planning via rollouts simple and efficient. We conduct extensive exploration of different strategies for performing multi-step planning on top of the OptFormer model to highlight its potential for use in constructing non-myopic HPO strategies. △ Less

Submitted 16 November, 2022; v1 submitted 10 October, 2022; originally announced October 2022.

Comments: 8 pages, 7 figures

Pion damping width and pion spectral function in hot pion gas

Authors: D. Goderidze, A. Friesen, Yu. Kalinovsky

Abstract: The temperature behaviour of the pion width in the hadronic phase is investigated in the framework of the NJL model. The contribution to the width from the pion-pion collision is considered with a scalar sigma-meson as an intermediate state. It is shown that the pion width significantly broadens at $T>0.1$ GeV. Using the two-step iteration method, suggested by Kadanoff and Baym, the pion spectral… ▽ More The temperature behaviour of the pion width in the hadronic phase is investigated in the framework of the NJL model. The contribution to the width from the pion-pion collision is considered with a scalar sigma-meson as an intermediate state. It is shown that the pion width significantly broadens at $T>0.1$ GeV. Using the two-step iteration method, suggested by Kadanoff and Baym, the pion spectral function in a hot pion gas is calculated at different temperatures. △ Less

Submitted 23 May, 2022; originally announced May 2022.

Comments: 8 pages, 4 figures

Revisiting Gaussian mixture critics in off-policy reinforcement learning: a sample-based approach

Authors: Bobak Shahriari, Abbas Abdolmaleki, Arunkumar Byravan, Abe Friesen, Siqi Liu, Jost Tobias Springenberg, Nicolas Heess, Matt Hoffman, Martin Riedmiller

Abstract: Actor-critic algorithms that make use of distributional policy evaluation have frequently been shown to outperform their non-distributional counterparts on many challenging control tasks. Examples of this behavior include the D4PG and DMPO algorithms as compared to DDPG and MPO, respectively [Barth-Maron et al., 2018; Hoffman et al., 2020]. However, both agents rely on the C51 critic for value est… ▽ More Actor-critic algorithms that make use of distributional policy evaluation have frequently been shown to outperform their non-distributional counterparts on many challenging control tasks. Examples of this behavior include the D4PG and DMPO algorithms as compared to DDPG and MPO, respectively [Barth-Maron et al., 2018; Hoffman et al., 2020]. However, both agents rely on the C51 critic for value estimation.One major drawback of the C51 approach is its requirement of prior knowledge about the minimum andmaximum values a policy can attain as well as the number of bins used, which fixes the resolution ofthe distributional estimate. While the DeepMind control suite of tasks utilizes standardized rewards and episode lengths, thus enabling the entire suite to be solved with a single setting of these hyperparameters, this is often not the case. This paper revisits a natural alternative that removes this requirement, namelya mixture of Gaussians, and a simple sample-based loss function to train it in an off-policy regime. We empirically evaluate its performance on a broad range of continuous control tasks and demonstrate that it eliminates the need for these distributional hyperparameters and achieves state-of-the-art performance on a variety of challenging tasks (e.g. the humanoid, dog, quadruped, and manipulator domains). Finallywe provide an implementation in the Acme agent repository. △ Less

Submitted 22 April, 2022; v1 submitted 21 April, 2022; originally announced April 2022.

Retrieval-Augmented Reinforcement Learning

Authors: Anirudh Goyal, Abram L. Friesen, Andrea Banino, Theophane Weber, Nan Rosemary Ke, Adria Puigdomenech Badia, Arthur Guez, Mehdi Mirza, Peter C. Humphreys, Ksenia Konyushkova, Laurent Sifre, Michal Valko, Simon Osindero, Timothy Lillicrap, Nicolas Heess, Charles Blundell

Abstract: Most deep reinforcement learning (RL) algorithms distill experience into parametric behavior policies or value functions via gradient updates. While effective, this approach has several disadvantages: (1) it is computationally expensive, (2) it can take many updates to integrate experiences into the parametric model, (3) experiences that are not fully integrated do not appropriately influence the… ▽ More Most deep reinforcement learning (RL) algorithms distill experience into parametric behavior policies or value functions via gradient updates. While effective, this approach has several disadvantages: (1) it is computationally expensive, (2) it can take many updates to integrate experiences into the parametric model, (3) experiences that are not fully integrated do not appropriately influence the agent's behavior, and (4) behavior is limited by the capacity of the model. In this paper we explore an alternative paradigm in which we train a network to map a dataset of past experiences to optimal behavior. Specifically, we augment an RL agent with a retrieval process (parameterized as a neural network) that has direct access to a dataset of experiences. This dataset can come from the agent's past experiences, expert demonstrations, or any other relevant source. The retrieval process is trained to retrieve information from the dataset that may be useful in the current context, to help the agent achieve its goal faster and more efficiently. he proposed method facilitates learning agents that at test-time can condition their behavior on the entire dataset and not only the current state, or current trajectory. We integrate our method into two different RL agents: an offline DQN agent and an online R2D2 agent. In offline multi-task problems, we show that the retrieval-augmented DQN agent avoids task interference and learns faster than the baseline DQN agent. On Atari, we show that retrieval-augmented R2D2 learns significantly faster than the baseline R2D2 agent and achieves higher scores. We run extensive ablations to measure the contributions of the components of our proposed method. △ Less

Submitted 24 May, 2022; v1 submitted 16 February, 2022; originally announced February 2022.

Model-Value Inconsistency as a Signal for Epistemic Uncertainty

Authors: Angelos Filos, Eszter Vértes, Zita Marinho, Gregory Farquhar, Diana Borsa, Abram Friesen, Feryal Behbahani, Tom Schaul, André Barreto, Simon Osindero

Abstract: Using a model of the environment and a value function, an agent can construct many estimates of a state's value, by unrolling the model for different lengths and bootstrapping with its value function. Our key insight is that one can treat this set of value estimates as a type of ensemble, which we call an \emph{implicit value ensemble} (IVE). Consequently, the discrepancy between these estimates c… ▽ More Using a model of the environment and a value function, an agent can construct many estimates of a state's value, by unrolling the model for different lengths and bootstrapping with its value function. Our key insight is that one can treat this set of value estimates as a type of ensemble, which we call an \emph{implicit value ensemble} (IVE). Consequently, the discrepancy between these estimates can be used as a proxy for the agent's epistemic uncertainty; we term this signal \emph{model-value inconsistency} or \emph{self-inconsistency} for short. Unlike prior work which estimates uncertainty by training an ensemble of many models and/or value functions, this approach requires only the single model and value function which are already being learned in most model-based reinforcement learning algorithms. We provide empirical evidence in both tabular and function approximation settings from pixels that self-inconsistency is useful (i) as a signal for exploration, (ii) for acting safely under distribution shifts, and (iii) for robustifying value-based planning with a learned model. △ Less

Submitted 29 June, 2022; v1 submitted 8 December, 2021; originally announced December 2021.

Comments: The first three authors contributed equally. Accepted at ICML 2022

Position Paper: Goals of the Luau Type System

Authors: Lily Brown, Andy Friesen, Alan Jeffrey

Abstract: Luau is the scripting language that powers user-generated experiences on the Roblox platform. It is a statically-typed language, based on the dynamically-typed Lua language, with type inference. These types are used for providing editor assistance in Roblox Studio, the IDE for authoring Roblox experiences. Due to Roblox's uniquely heterogeneous developer community, Luau must operate in a somewhat… ▽ More Luau is the scripting language that powers user-generated experiences on the Roblox platform. It is a statically-typed language, based on the dynamically-typed Lua language, with type inference. These types are used for providing editor assistance in Roblox Studio, the IDE for authoring Roblox experiences. Due to Roblox's uniquely heterogeneous developer community, Luau must operate in a somewhat different fashion than a traditional statically-typed language. In this paper, we describe some of the goals of the Luau type system, focusing on where the goals differ from those of other type systems. △ Less

Submitted 22 September, 2021; originally announced September 2021.

Comments: In HATRA '21: Human Aspects of Types and Reasoning Assistants 2021

Introducing Symmetries to Black Box Meta Reinforcement Learning

Authors: Louis Kirsch, Sebastian Flennerhag, Hado van Hasselt, Abram Friesen, Junhyuk Oh, Yutian Chen

Abstract: Meta reinforcement learning (RL) attempts to discover new RL algorithms automatically from environment interaction. In so-called black-box approaches, the policy and the learning algorithm are jointly represented by a single neural network. These methods are very flexible, but they tend to underperform in terms of generalisation to new, unseen environments. In this paper, we explore the role of sy… ▽ More Meta reinforcement learning (RL) attempts to discover new RL algorithms automatically from environment interaction. In so-called black-box approaches, the policy and the learning algorithm are jointly represented by a single neural network. These methods are very flexible, but they tend to underperform in terms of generalisation to new, unseen environments. In this paper, we explore the role of symmetries in meta-generalisation. We show that a recent successful meta RL approach that meta-learns an objective for backpropagation-based learning exhibits certain symmetries (specifically the reuse of the learning rule, and invariance to input and output permutations) that are not present in typical black-box meta RL systems. We hypothesise that these symmetries can play an important role in meta-generalisation. Building off recent work in black-box supervised meta learning, we develop a black-box meta RL system that exhibits these same symmetries. We show through careful experimentation that incorporating these symmetries can lead to algorithms with a greater ability to generalise to unseen action & observation spaces, tasks, and environments. △ Less

Submitted 5 June, 2022; v1 submitted 22 September, 2021; originally announced September 2021.

Comments: AAAI 2022

Mott dissociation and kaon to pion ratio in the EPNJL model

Authors: D. Blaschke, A. V. Friesen, Yu. L. Kalinovsky, A. E. Radzhabov

Abstract: The behaviour of pseudoscalar mesons within the SU(3)PNJL-like models is considered for finite T and $μ_B$. We compare the pole approximation (Breit-Wigner) with the Beth-Uhlenbeck approach. We evaluate the $K/π$ ratios along the phase transition line in the T-$μ_B$ plane with constant and $T/μ_B$-dependent pion and strange quark chemical potentials. Using the model, we can show that the splitting… ▽ More The behaviour of pseudoscalar mesons within the SU(3)PNJL-like models is considered for finite T and $μ_B$. We compare the pole approximation (Breit-Wigner) with the Beth-Uhlenbeck approach. We evaluate the $K/π$ ratios along the phase transition line in the T-$μ_B$ plane with constant and $T/μ_B$-dependent pion and strange quark chemical potentials. Using the model, we can show that the splitting of kaon and anti-kaon masses appears as a result of introduction of density and this explains the difference in the $K^+/π^+$ ratio and $K^-/π^-$ ratio at low $\sqrt{s_{NN}}$ and their tendency to the same value at high $\sqrt{s_{NN}}$. A sharp "horn" effect in the $K^+/π^+$ ratio is explained by the enhanced pion production which can be described by occurrence of a nonequilibrium pion chemical potential of the order of the pion mass. We elucidate that the horn effect is not related to the existence of a critical endpoint in the QCD phase diagram. △ Less

Submitted 25 January, 2021; originally announced January 2021.

Comments: arXiv admin note: substantial text overlap with arXiv:2009.03284

On the role of planning in model-based deep reinforcement learning

Authors: Jessica B. Hamrick, Abram L. Friesen, Feryal Behbahani, Arthur Guez, Fabio Viola, Sims Witherspoon, Thomas Anthony, Lars Buesing, Petar Veličković, Théophane Weber

Abstract: Model-based planning is often thought to be necessary for deep, careful reasoning and generalization in artificial agents. While recent successes of model-based reinforcement learning (MBRL) with deep function approximation have strengthened this hypothesis, the resulting diversity of model-based methods has also made it difficult to track which components drive success and why. In this paper, we… ▽ More Model-based planning is often thought to be necessary for deep, careful reasoning and generalization in artificial agents. While recent successes of model-based reinforcement learning (MBRL) with deep function approximation have strengthened this hypothesis, the resulting diversity of model-based methods has also made it difficult to track which components drive success and why. In this paper, we seek to disentangle the contributions of recent methods by focusing on three questions: (1) How does planning benefit MBRL agents? (2) Within planning, what choices drive performance? (3) To what extent does planning improve generalization? To answer these questions, we study the performance of MuZero (Schrittwieser et al., 2019), a state-of-the-art MBRL algorithm with strong connections and overlapping components with many other MBRL algorithms. We perform a number of interventions and ablations of MuZero across a wide range of environments, including control tasks, Atari, and 9x9 Go. Our results suggest the following: (1) Planning is most useful in the learning process, both for policy updates and for providing a more useful data distribution. (2) Using shallow trees with simple Monte-Carlo rollouts is as performant as more complex methods, except in the most difficult reasoning tasks. (3) Planning alone is insufficient to drive strong generalization. These results indicate where and how to utilize planning in reinforcement learning settings, and highlight a number of open questions for future MBRL research. △ Less

Submitted 17 March, 2021; v1 submitted 8 November, 2020; originally announced November 2020.

Comments: Published at ICLR 2021

Chiral phase transition and kaon-to-pion ratios in the entanglement SU(3) PNJL model

Authors: D. Blaschke, A. V. Friesen, Yu. L. Kalinovsky, A. Radzhabov

Abstract: Within the three-flavor PNJL and EPNJL chiral quark models we have obtained pseudoscalar meson properties in quark matter at finite temperature $T$ and baryochemical potential $μ_B$. We compare the meson pole (Breit-Wigner) approximation with the Beth-Uhlenbeck (BU) approach that takes into account the continuum of quark-antiquark scattering states when determining the partial densities of pions a… ▽ More Within the three-flavor PNJL and EPNJL chiral quark models we have obtained pseudoscalar meson properties in quark matter at finite temperature $T$ and baryochemical potential $μ_B$. We compare the meson pole (Breit-Wigner) approximation with the Beth-Uhlenbeck (BU) approach that takes into account the continuum of quark-antiquark scattering states when determining the partial densities of pions and kaons. We evaluate the kaon-to-pion ratios along the (pseudo-)critical line in the $T-μ_B$ plane as a proxy for the chemical freezeout line, whereby the variable $x=T/μ_B$ is introduced that corresponds to the conserved entropy per baryon as initial condition for the heavy-ion collision experiments. We present a comparison with the experimental pattern of kaon-to-pion ratios within the BU approach and using $x$-dependent pion and strange quark potentials. A sharp "horn" effect in the energy dependence $K^+/π^+$ ratio is explained by the enhanced pion production at energies above $\sqrt{s_{NN}}=8$ GeV, when the system enters the regime of meson dominance. This effect is in line with the enhancement of low-momentum pion spectra that is discussed as a precursor of the pion Bose condensation and entails the occurrence of a nonequilibrium pion chemical potential of the order of the pion mass. We elucidate that the horn effect is not related to the existence of a critical endpoint in the QCD phase diagram. △ Less

Submitted 7 September, 2020; originally announced September 2020.

Comments: 20 pages, 7 figures

Journal ref: Eur. Phys. J. ST 229, 3517 (2020)

Acme: A Research Framework for Distributed Reinforcement Learning

Authors: Matthew W. Hoffman, Bobak Shahriari, John Aslanides, Gabriel Barth-Maron, Nikola Momchev, Danila Sinopalnikov, Piotr Stańczyk, Sabela Ramos, Anton Raichuk, Damien Vincent, Léonard Hussenot, Robert Dadashi, Gabriel Dulac-Arnold, Manu Orsini, Alexis Jacq, Johan Ferret, Nino Vieillard, Seyed Kamyar Seyed Ghasemipour, Sertan Girgin, Olivier Pietquin, Feryal Behbahani, Tamara Norman, Abbas Abdolmaleki, Albin Cassirer, Fan Yang , et al. (14 additional authors not shown)

Abstract: Deep reinforcement learning (RL) has led to many recent and groundbreaking advances. However, these advances have often come at the cost of both increased scale in the underlying architectures being trained as well as increased complexity of the RL algorithms used to train them. These increases have in turn made it more difficult for researchers to rapidly prototype new ideas or reproduce publishe… ▽ More Deep reinforcement learning (RL) has led to many recent and groundbreaking advances. However, these advances have often come at the cost of both increased scale in the underlying architectures being trained as well as increased complexity of the RL algorithms used to train them. These increases have in turn made it more difficult for researchers to rapidly prototype new ideas or reproduce published RL algorithms. To address these concerns this work describes Acme, a framework for constructing novel RL algorithms that is specifically designed to enable agents that are built using simple, modular components that can be used at various scales of execution. While the primary goal of Acme is to provide a framework for algorithm development, a secondary goal is to provide simple reference implementations of important or state-of-the-art algorithms. These implementations serve both as a validation of our design decisions as well as an important contribution to reproducibility in RL research. In this work we describe the major design decisions made within Acme and give further details as to how its components can be used to implement various algorithms. Our experiments provide baselines for a number of common and state-of-the-art algorithms as well as showing how these algorithms can be scaled up for much larger and more complex environments. This highlights one of the primary advantages of Acme, namely that it can be used to implement large, distributed RL algorithms that can run at massive scales while still maintaining the inherent readability of that implementation. This work presents a second version of the paper which coincides with an increase in modularity, additional emphasis on offline, imitation and learning from demonstrations algorithms, as well as various new agents implemented as part of Acme. △ Less

Submitted 20 September, 2022; v1 submitted 1 June, 2020; originally announced June 2020.

Comments: This work presents a second version of the paper which coincides with an increase in modularity, additional emphasis on offline, imitation and learning from demonstrations algorithms, as well as various new agents implemented as part of Acme

QCD Phase Diagram at NICA energies: $K^+/π^+$ horn effect and light clusters in THESEUS

Authors: D. Blaschke, A. V. Friesen, Yu. B. Ivanov, Yu. L. Kalinovsky, M. Kozhevnikova, S. Liebing, A. Radzhabov, G. Röpke

Abstract: We discuss recent progress in the development of the three-fluid hydrodynamics-based program THESEUS towards an event generator suitable for applications to heavy-ion collisions at the intermediate energies of the planned NICA and FAIR experiments. We follow the strategy that modifications of particle distributions at the freeze-out surface in the QCD phase diagram may be mapped directly to the ob… ▽ More We discuss recent progress in the development of the three-fluid hydrodynamics-based program THESEUS towards an event generator suitable for applications to heavy-ion collisions at the intermediate energies of the planned NICA and FAIR experiments. We follow the strategy that modifications of particle distributions at the freeze-out surface in the QCD phase diagram may be mapped directly to the observable ones within a sudden freeze-out scheme. We report first results of these investigations for the production of light clusters (deuterons and tritons) which can be compared to experimental data from the HADES and the NA49 experiment and for the interpretation of the "horn" effect observed in the collision energy dependence of the $K^+/π^+$ ratio. Medium effects on light cluster production in the QCD phase diagram are negligible at the highest NICA energies but shall play a dominant role at the lowest energies. A sharp "horn"-type signal in the $K^+/π^+$ ratio can be obtained when the onset of Bose condensation modelled by a pion chemical potential results in an enhancement of pions at low momenta (which is seen at LHC energies) and would occur already in the NICA energy range. △ Less

Submitted 16 April, 2020; v1 submitted 2 April, 2020; originally announced April 2020.

Comments: 5 pages, 3 figures, 3 references added, contribution to the Proceedings of "III NICA Days-2019 and IV MPD Collaboration Meeting", Warsaw, 21.-25.10.2019

Journal ref: Acta Phys.Polon.Supp. 14 (2021) 3, 485-489

Using the Beth-Uhlenbeck approach to describe the kaon to pion ratio in a 2+1 flavor PNJL model

Authors: D. Blaschke, A. Friesen, Yu. Kalinovsky, A. Radzhabov

Abstract: The kaon to pion ratios are discussed in the framework of a 2+1 flavor PNJL model. In order to interpret the behaviour of bound states in medium the Beth-Uhlenbeck approach is used. It is shown that in terms of phase shifts in the K+ channel an additional low-energy mode could appear as a bound state in medium since the masses of the quark constituents are different. The comparison with experiment… ▽ More The kaon to pion ratios are discussed in the framework of a 2+1 flavor PNJL model. In order to interpret the behaviour of bound states in medium the Beth-Uhlenbeck approach is used. It is shown that in terms of phase shifts in the K+ channel an additional low-energy mode could appear as a bound state in medium since the masses of the quark constituents are different. The comparison with experimental data for the ratios is performed and the influence of the anomalous mode to the "horn" effect in the K+/pi+ ratio is discussed. △ Less

Submitted 30 December, 2019; originally announced December 2019.

Comments: 8 pages, 4 figures, Talk at the II International Workshop on Theory of Hadronic Matter Under Extreme Conditions

Journal ref: Particles 3 (1), 169-177 (2020)

The role of the chiral phase transition in modelling the kaon to pion ratio

Authors: A. V. Friesen, Yu. L. Kalinovsky, V. D. Toneev

Abstract: A sharp peak in the $K^+/π^+$ ratio in relativistic heavy-ion collision is discussed in the framework of the SU(3) Polyakov-loop extended NJL model with vector interaction. In the model, the $K^+/π^+$ ratio was calculated along the chiral phase transition line for different values of the vector coupling $g_V$. We showed that the value of the vector coupling had no significant effect on the… ▽ More A sharp peak in the $K^+/π^+$ ratio in relativistic heavy-ion collision is discussed in the framework of the SU(3) Polyakov-loop extended NJL model with vector interaction. In the model, the $K^+/π^+$ ratio was calculated along the chiral phase transition line for different values of the vector coupling $g_V$. We showed that the value of the vector coupling had no significant effect on the $K^+/π^+$ behaviour. △ Less

Submitted 2 December, 2019; originally announced December 2019.

Comments: 6 pages, 3 figs

Modular Meta-Learning with Shrinkage

Authors: Yutian Chen, Abram L. Friesen, Feryal Behbahani, Arnaud Doucet, David Budden, Matthew W. Hoffman, Nando de Freitas

Abstract: Many real-world problems, including multi-speaker text-to-speech synthesis, can greatly benefit from the ability to meta-learn large models with only a few task-specific components. Updating only these task-specific modules then allows the model to be adapted to low-data tasks for as many steps as necessary without risking overfitting. Unfortunately, existing meta-learning methods either do not sc… ▽ More Many real-world problems, including multi-speaker text-to-speech synthesis, can greatly benefit from the ability to meta-learn large models with only a few task-specific components. Updating only these task-specific modules then allows the model to be adapted to low-data tasks for as many steps as necessary without risking overfitting. Unfortunately, existing meta-learning methods either do not scale to long adaptation or else rely on handcrafted task-specific architectures. Here, we propose a meta-learning approach that obviates the need for this often sub-optimal hand-selection. In particular, we develop general techniques based on Bayesian shrinkage to automatically discover and learn both task-specific and general reusable modules. Empirically, we demonstrate that our method discovers a small set of meaningful task-specific modules and outperforms existing meta-learning approaches in domains like few-shot text-to-speech that have little task data and long adaptation horizons. We also show that existing meta-learning methods including MAML, iMAML, and Reptile emerge as special cases of our method. △ Less

Submitted 22 October, 2020; v1 submitted 12 September, 2019; originally announced September 2019.

Comments: Accepted by NeurIPS 2020

Renormalization of the 4PI effective action using the functional renormalization group

Authors: M. E. Carrington, S. A. Friesen, C. D. Phillips, D. Pickering

Abstract: Techniques based on $n$-particle irreducible effective actions can be used to study systems where perturbation theory does not apply. The main advantage, relative to other non-perturbative continuum methods, is that the hierarchy of integral equations that must be solved truncates at the level of the action, and no additional approximations are needed. The main problem with the method is renormali… ▽ More Techniques based on $n$-particle irreducible effective actions can be used to study systems where perturbation theory does not apply. The main advantage, relative to other non-perturbative continuum methods, is that the hierarchy of integral equations that must be solved truncates at the level of the action, and no additional approximations are needed. The main problem with the method is renormalization, which until now could only be done at the lowest ($n$=2) level. In this paper we show how to obtain renormalized results from an $n$-particle irreducible effective action at any order. We consider a symmetric scalar theory with quartic coupling in four dimensions and show that the 4 loop 4-particle-irreducible calculation can be renormalized using a renormalization group method. The calculation involves one bare mass and one bare coupling constant which are introduced at the level of the Lagrangian, and cannot be done using any known method by introducing counterterms. △ Less

Submitted 28 January, 2019; v1 submitted 3 January, 2019; originally announced January 2019.

Comments: 16 pages, 7 figures. arXiv admin note: text overlap with arXiv:1711.09135

Journal ref: Phys. Rev. D 99, 074002 (2019)

Strange matter and kaon to pion ratio in SU(3) PNJL model

Authors: A. V. Friesen, Yu. L. Kalinovsky, V. D. Toneev

Abstract: The behavior of strange matter in the frame of the SU(3)Polyakov-loop extended Nambu-Jona-Lasinio model including $U_A(1)$ anomaly is considered. We discuss the appearance of a peak in the ratio of the number of strange mesons to non-strange mesons known as the "horn". The PNJL model gives a schematic description of the chiral phase transition and meson properties at finite temperature and density… ▽ More The behavior of strange matter in the frame of the SU(3)Polyakov-loop extended Nambu-Jona-Lasinio model including $U_A(1)$ anomaly is considered. We discuss the appearance of a peak in the ratio of the number of strange mesons to non-strange mesons known as the "horn". The PNJL model gives a schematic description of the chiral phase transition and meson properties at finite temperature and density. Using the model, we can show that the splitting of kaon and anti-kaon masses appears as a result of introduction of density. This may explain the difference in the $K^+/π^+$ ratio and $K^-/π^-$ ratio at low $\sqrt{s_{NN}}$ and their tendency to the same value at high $\sqrt{s_{NN}}$. We also show that the rise in the ratio $K^+/π^+$ appears near CEP when we build the $K^+/π^+$ ratio along the phase transition diagram and it can be considered as a critical region signal. △ Less

Submitted 15 August, 2018; v1 submitted 13 August, 2018; originally announced August 2018.

Comments: 7 pages, 7 figures

Journal ref: Phys. Rev. C 99, 045201 (2019)

Effects of composite pions on the chiral condensate within the PNJL model at finite temperature

Authors: D. Blaschke, A. Dubinin, D. Ebert, A. V. Friesen

Abstract: We investigate the effect of composite pions on the behaviour of the chiral condensate at finite temperature within the Polyakov-loop improved NJL model. To this end we treat quark-antiquark correlations in the pion channel (bound states and scattering continuum) within a Beth-Uhlenbeck approach that uses medium-dependent phase shifts. A striking medium effect is the Mott transition which occurs w… ▽ More We investigate the effect of composite pions on the behaviour of the chiral condensate at finite temperature within the Polyakov-loop improved NJL model. To this end we treat quark-antiquark correlations in the pion channel (bound states and scattering continuum) within a Beth-Uhlenbeck approach that uses medium-dependent phase shifts. A striking medium effect is the Mott transition which occurs when the binding energy vanishes and the discrete pion bound state merges the continuum. This transition is triggered by the lowering of the continuum edge due to the chiral restoration transition. This in turn also entails a modification of the Polyakov-loop so that the SU(3) center symmetry gets broken at finite temperature and dynamical quarks (and gluons) appear in the system, taking over the role of the dominant degrees of freedom from the pions. At low temperatures our model reproduces the chiral perturbation theory result for the chiral condensate while at high temperatures the PNJL model result is recovered. The new aspect of the current work is a consistent treatment of the chiral restoration transition region within the Beth-Uhlenbeck approach on the basis of mesonic phase shifts for the treatment of the correlations. △ Less

Submitted 3 May, 2018; v1 submitted 26 December, 2017; originally announced December 2017.

Comments: 14 pages, 4 figures, version published in Phys. Part. Nucl. Lett

Journal ref: Phys. Part. Nucl. Lett. 15 (2018) no. 3, 230-235

The 2PI effective theory at next-to-leading order using the functional renormalization group

Authors: M. E. Carrington, S. A. Friesen, B. A. Meggison, C. D. Phillips, D. Pickering, K. Sohrabi

Abstract: We consider a symmetric scalar theory with quartic coupling in 4-dimensions. We show that the 4 loop 2PI calculation can be done using a renormalization group method. The calculation involves one bare coupling constant which is introduced at the level of the Lagrangian and is therefore conceptually simpler than a standard 2PI calculation, which requires multiple counterterms. We explain how our me… ▽ More We consider a symmetric scalar theory with quartic coupling in 4-dimensions. We show that the 4 loop 2PI calculation can be done using a renormalization group method. The calculation involves one bare coupling constant which is introduced at the level of the Lagrangian and is therefore conceptually simpler than a standard 2PI calculation, which requires multiple counterterms. We explain how our method can be used to do the corresponding calculation at the 4PI level, which can not be done using any known method by introducing counterterms. △ Less

Submitted 24 November, 2017; originally announced November 2017.

Comments: 25 pages, 10 figures

Journal ref: Phys. Rev. D 97, 036005 (2018)

Deep Learning as a Mixed Convex-Combinatorial Optimization Problem

Authors: Abram L. Friesen, Pedro Domingos

Abstract: As neural networks grow deeper and wider, learning networks with hard-threshold activations is becoming increasingly important, both for network quantization, which can drastically reduce time and energy requirements, and for creating large integrated systems of deep networks, which may have non-differentiable components and must avoid vanishing and exploding gradients for effective learning. Howe… ▽ More As neural networks grow deeper and wider, learning networks with hard-threshold activations is becoming increasingly important, both for network quantization, which can drastically reduce time and energy requirements, and for creating large integrated systems of deep networks, which may have non-differentiable components and must avoid vanishing and exploding gradients for effective learning. However, since gradient descent is not applicable to hard-threshold functions, it is not clear how to learn networks of them in a principled way. We address this problem by observing that setting targets for hard-threshold hidden units in order to minimize loss is a discrete optimization problem, and can be solved as such. The discrete optimization goal is to find a set of targets such that each unit, including the output, has a linearly separable problem to solve. Given these targets, the network decomposes into individual perceptrons, which can then be learned with standard convex approaches. Based on this, we develop a recursive mini-batch algorithm for learning deep hard-threshold networks that includes the popular but poorly justified straight-through estimator as a special case. Empirically, we show that our algorithm improves classification accuracy in a number of settings, including for AlexNet and ResNet-18 on ImageNet, when compared to the straight-through estimator. △ Less

Submitted 16 April, 2018; v1 submitted 31 October, 2017; originally announced October 2017.

Comments: 14 pages (9 body, 5 pages of references and appendices)

Journal ref: In Proceedings of the International Conference on Learning Representations (ICLR) 2018

The Sum-Product Theorem: A Foundation for Learning Tractable Models

Authors: Abram L. Friesen, Pedro Domingos

Abstract: Inference in expressive probabilistic models is generally intractable, which makes them difficult to learn and limits their applicability. Sum-product networks are a class of deep models where, surprisingly, inference remains tractable even when an arbitrary number of hidden layers are present. In this paper, we generalize this result to a much broader set of learning problems: all those where inf… ▽ More Inference in expressive probabilistic models is generally intractable, which makes them difficult to learn and limits their applicability. Sum-product networks are a class of deep models where, surprisingly, inference remains tractable even when an arbitrary number of hidden layers are present. In this paper, we generalize this result to a much broader set of learning problems: all those where inference consists of summing a function over a semiring. This includes satisfiability, constraint satisfaction, optimization, integration, and others. In any semiring, for summation to be tractable it suffices that the factors of every product have disjoint scopes. This unifies and extends many previous results in the literature. Enforcing this condition at learning time thus ensures that the learned models are tractable. We illustrate the power and generality of this approach by applying it to a new type of structured prediction problem: learning a nonconvex function that can be globally optimized in polynomial time. We show empirically that this greatly outperforms the standard approach of learning without regard to the cost of optimization. △ Less

Submitted 10 November, 2016; originally announced November 2016.

Comments: 15 pages (10 body, 5 pages of appendices)

Journal ref: Proceedings of the 33rd International Conference on Machine Learning, pp. 1909-1918, 2016

Recursive Decomposition for Nonconvex Optimization

Authors: Abram L. Friesen, Pedro Domingos

Abstract: Continuous optimization is an important problem in many areas of AI, including vision, robotics, probabilistic inference, and machine learning. Unfortunately, most real-world optimization problems are nonconvex, causing standard convex techniques to find only local optima, even with extensions like random restarts and simulated annealing. We observe that, in many cases, the local modes of the obje… ▽ More Continuous optimization is an important problem in many areas of AI, including vision, robotics, probabilistic inference, and machine learning. Unfortunately, most real-world optimization problems are nonconvex, causing standard convex techniques to find only local optima, even with extensions like random restarts and simulated annealing. We observe that, in many cases, the local modes of the objective function have combinatorial structure, and thus ideas from combinatorial optimization can be brought to bear. Based on this, we propose a problem-decomposition approach to nonconvex optimization. Similarly to DPLL-style SAT solvers and recursive conditioning in probabilistic inference, our algorithm, RDIS, recursively sets variables so as to simplify and decompose the objective function into approximately independent sub-functions, until the remaining functions are simple enough to be optimized by standard techniques like gradient descent. The variables to set are chosen by graph partitioning, ensuring decomposition whenever possible. We show analytically that RDIS can solve a broad class of nonconvex optimization problems exponentially faster than gradient descent with random restarts. Experimentally, RDIS outperforms standard techniques on problems like structure from motion and protein folding. △ Less

Submitted 8 November, 2016; originally announced November 2016.

Comments: 11 pages, 7 figures, pdflatex

Journal ref: Proceedings of the 24th International Joint Conference on Artificial Intelligence (2015), pp. 253-259

Impact of the vector interaction on the phase structure of QCD matter

Authors: A. V. Friesen, Yu. L. Kalinovsky, V. D. Toneev

Abstract: The 2-flavor Polyakov-loop extended model is generalized by taking into account the effective four-quark vector-type interaction with the coupling strengths, which are endowed with a dependence on the Polyakov field $Φ$. The effective vertex generates entanglement interaction between the Polyakov loop and the chiral condensate. We investigate the influence of an additional quark vector interaction… ▽ More The 2-flavor Polyakov-loop extended model is generalized by taking into account the effective four-quark vector-type interaction with the coupling strengths, which are endowed with a dependence on the Polyakov field $Φ$. The effective vertex generates entanglement interaction between the Polyakov loop and the chiral condensate. We investigate the influence of an additional quark vector interaction and the entanglement interaction on the location of the critical end-point at the given chemical potential or quark density. It is shown that the finite value of the vector interaction strength $G_{\rm v}$ improves the model agreement with the lattice data. The influence of the non-zero $G_{\rm v}$ and entanglement on the thermodynamic observables and the curvature of the crossover boundary in the $T-μ$ plane is also examined. △ Less

Submitted 22 December, 2014; originally announced December 2014.

Comments: 9 pages, 12 figures. arXiv admin note: text overlap with arXiv:1006.3648 by other authors

Quark scattering off quarks and hadrons

Authors: A. V Friesen, Yu. V. Kalinovsky, V. D. Toneev

Abstract: The in-medium elastic scattering $qq\to qq, q\bar{q}\to q\bar{q}$ and $\bar{q}\bar{q}\to \bar{q}\bar{q}$ is calculated within the two-flavor Polyakov-loop-extended Nambu-Jona-Lasinio model. The integral and differential quark-quark scattering, its energy and temperature dependence are considered and their flavor dependence is emphasized. The comparison with results of other approaches is presented… ▽ More The in-medium elastic scattering $qq\to qq, q\bar{q}\to q\bar{q}$ and $\bar{q}\bar{q}\to \bar{q}\bar{q}$ is calculated within the two-flavor Polyakov-loop-extended Nambu-Jona-Lasinio model. The integral and differential quark-quark scattering, its energy and temperature dependence are considered and their flavor dependence is emphasized. The comparison with results of other approaches is presented. The consideration is implemented to the case of quark-pion scattering characterizing the interaction between quarks and hadrons in a kinetic multiphase treatment, and the first estimate of the quark-pion cross sections is given. A possible application of the obtained results to heavy ion collisions is shortly discussed. △ Less

Submitted 13 December, 2013; v1 submitted 26 April, 2013; originally announced April 2013.

Comments: 21 pages, 11 figures, 2 tables

Pion dissociation and Levinson's theorem in hot PNJL quark matter

Authors: A. Wergieluk, D. Blaschke, Yu. L. Kalinovsky, A. Friesen

Abstract: Pion dissociation by the Mott effect in quark plasma is described within the generalized Beth-Uhlenbeck approach on the basis of the PNJL model which allows for a unified description of bound, resonant and scattering states. As a first approximation, we utilize the Breit-Wigner ansatz for the spectral function and clarify its relation to the complex mass pole solution of the pion Bethe-Salpeter eq… ▽ More Pion dissociation by the Mott effect in quark plasma is described within the generalized Beth-Uhlenbeck approach on the basis of the PNJL model which allows for a unified description of bound, resonant and scattering states. As a first approximation, we utilize the Breit-Wigner ansatz for the spectral function and clarify its relation to the complex mass pole solution of the pion Bethe-Salpeter equation. Application of the Levinson theorem proves that describing the pion Mott dissociation solely by means of spectral broadening of the pion bound state beyond T_Mott leaves out a significant aspect. Thus we acknowledge the importance of the continuum of scattering states and show its role for the thermodynamics of pion dissociation. △ Less

Submitted 28 May, 2014; v1 submitted 20 December, 2012; originally announced December 2012.

Comments: 18 pages, 6 figures

Report number: JINR Dubna Report No. E2-2013-19

Journal ref: Phys.Part.Nucl.Lett. 10 (2013) 660-668

Effects of Model Parameters in Thermodynamics of the PNJL Model

Authors: A. F. Friesen, Yu. K. Kalinovsky, V. D. Toneev

Abstract: The thermodynamic behavior of the two-flavor($N_f=$2) three-color ($N_c=3$) Polyakov-loop-extended Nambu-Jona-Lasinio model at the finite chemical potential is investigated. New lattice gluon data for gluon thermodynamics are used defining the effective potential within polynomial and logarithmic forms of its approximation. We study the effects of using different sets of data and different forms o… ▽ More The thermodynamic behavior of the two-flavor($N_f=$2) three-color ($N_c=3$) Polyakov-loop-extended Nambu-Jona-Lasinio model at the finite chemical potential is investigated. New lattice gluon data for gluon thermodynamics are used defining the effective potential within polynomial and logarithmic forms of its approximation. We study the effects of using different sets of data and different forms of the potential on thermodynamic properties of hot and dense matter. It is found that the PNJL thermodynamics depends stronger on the form of the effective potential than on the used lattice data set. Particular attention is paid to the phase diagram in the $(T,μ)$ plane. △ Less

Submitted 13 November, 2011; originally announced November 2011.

Comments: 15 pages, 9 figures, 4 tables

Electric field inside a "Rossky cavity" in uniformly polarized water

Authors: Daniel R. Martin, Allan D. Friesen, Dmitry V. Matyushov

Abstract: Electric field produced inside a solute by a uniformly polarized liquid is strongly affected by dipolar polarization of the liquid at the interface. We show, by numerical simulations, that the electric "cavity" field inside a hydrated non-polar solute does not follow the predictions of standard Maxwell's electrostatics of dielectrics. Instead, the field inside the solute tends, with increasing sol… ▽ More Electric field produced inside a solute by a uniformly polarized liquid is strongly affected by dipolar polarization of the liquid at the interface. We show, by numerical simulations, that the electric "cavity" field inside a hydrated non-polar solute does not follow the predictions of standard Maxwell's electrostatics of dielectrics. Instead, the field inside the solute tends, with increasing solute size, to the limit predicted by the Lorentz virtual cavity. The standard paradigm fails because of its reliance on the surface charge density at the dielectric interface determined by the boundary conditions of the Maxwell dielectric. The interface of a polar liquid instead carries a preferential in-plane orientation of the surface dipoles thus producing virtually no surface charge. The resulting boundary conditions for electrostatic problems differ from the traditional recipes, affecting the microscopic and macroscopic fields based on them. We show that relatively small differences in cavity fields propagate into significant differences in the dielectric constant of an ideal mixture. The slope of the dielectric increment of the mixture versus the solute concentration depends strongly on which polarization scenario at the interface is realized. A much steeper slope found in the case of Lorentz polarization also implies a higher free energy penalty for polarizing such mixtures. △ Less

Submitted 5 July, 2011; v1 submitted 30 June, 2011; originally announced June 2011.

Comments: 9 pages, 8 figures

Non-Gaussian statistics of electrostatic fluctuations of hydration shells

Authors: Allan D. Friesen, Dmitry V. Matyushov

Abstract: We report the statistics of electric field fluctuations produced by SPC/E water inside a Kihara solute given as a hard-sphere core with a Lennard-Jones layer at its surface. The statistics of electric field fluctuations, obtained from numerical simulations, are studied as a function of the magnitude of a point dipole placed close to the solute-water interface. The free energy surface as a function… ▽ More We report the statistics of electric field fluctuations produced by SPC/E water inside a Kihara solute given as a hard-sphere core with a Lennard-Jones layer at its surface. The statistics of electric field fluctuations, obtained from numerical simulations, are studied as a function of the magnitude of a point dipole placed close to the solute-water interface. The free energy surface as a function of the electric field projected on the dipole direction shows a cross-over with the increasing dipole magnitude. While it is a single-well harmonic function at low dipole values, it becomes a double-well surface at intermediate dipole moment magnitudes, transforming to a single-well surface, with a non-zero minimum position, at still higher dipoles. A broad intermediate region where the interfacial waters fluctuate between the two minima is characterized by intense field fluctuations, with non-Gaussian statistics and the variance far exceeding the linear-response expectations. The excited state of the surface water is found to be lifted above the ground state by the energy required to break approximately two hydrogen bonds. This state is pulled down in energy by the external electric field of the solute dipole, making it readily accessible to thermal excitations. The excited state is a localized surface defect in the hydrogen-bond network creating a stress in the nearby network, but otherwise relatively localized in the region closest to the solute dipole. △ Less

Submitted 26 May, 2011; originally announced May 2011.

Decay of a scalar $σ$-meson near the critical end-point in the PNJL model

Authors: A. V. Friesen, Yu. L. Kalinovsky, V. D. Toneev

Abstract: Properties of a scalar $σ$-meson are investigated in the two-flavor Nambu-Jona-Lasinio model with the Polyakov loop. Model analysis of the phase diagram of strong interacting matter is performed. The temperature dependence of the $σ\rightarrowππ$ decay width is studied at the zero chemical potential and near the critical end-point. The calculated strong coupling constant $g_{σππ}$ and the decay wi… ▽ More Properties of a scalar $σ$-meson are investigated in the two-flavor Nambu-Jona-Lasinio model with the Polyakov loop. Model analysis of the phase diagram of strong interacting matter is performed. The temperature dependence of the $σ\rightarrowππ$ decay width is studied at the zero chemical potential and near the critical end-point. The calculated strong coupling constant $g_{σππ}$ and the decay width are compared with available experimental data and other model results. Nonthermal enhancement of the total decay width is noted for the $σ$ meson near the critical end-point when the condition $m_σ\geq2m_π$ is broken. △ Less

Submitted 14 April, 2011; originally announced April 2011.

Comments: 11 pages, 6 figures

Thermodynamics in NJL-like models

Authors: A. V. Friesen, Yu. L. Kalinovsky, V. D. Toneev

Abstract: Thermodynamic behavior of conventional Nambu-Jona-Lasinio and Polyakov-loop-extended Nambu-Jona-Lasinio models is compared. A particular attention is paid to the phase diagram in the ($T -μ$) plane. Thermodynamic behavior of conventional Nambu-Jona-Lasinio and Polyakov-loop-extended Nambu-Jona-Lasinio models is compared. A particular attention is paid to the phase diagram in the ($T -μ$) plane. △ Less

Submitted 11 March, 2011; v1 submitted 9 February, 2011; originally announced February 2011.

Comments: 10 pages, 4 figures, 3 table

Cavity-water interface is polar

Authors: Allan D. Friesen, Dmitry V. Matyushov

Abstract: We present the results of numerical simulations of the electrostatics and dynamics of water hydration shells surrounding Kihara cavities given by a Lennard-Jones (LJ) layer at the surface of a hard-sphere cavity. The local dielectric response of the hydration layer substantially exceeds that of bulk water, with the magnitude of the dielectric constant peak in the shell increasing with the growing… ▽ More We present the results of numerical simulations of the electrostatics and dynamics of water hydration shells surrounding Kihara cavities given by a Lennard-Jones (LJ) layer at the surface of a hard-sphere cavity. The local dielectric response of the hydration layer substantially exceeds that of bulk water, with the magnitude of the dielectric constant peak in the shell increasing with the growing cavity size. The polar shell propagates into bulk water to approximately the cavity radius. The statistics of the electrostatic field produced by water inside the cavity follow linear response and approach the prediction of continuum electrostatics with increasing cavity size. △ Less

Submitted 20 May, 2010; v1 submitted 10 April, 2010; originally announced April 2010.

Comments: 4 pages, 4 figures

Resonance Structure in the $γγ$ Invariant Mass Spectrum in $p$C- and $d$C-Interactions

Authors: Kh. U. Abraamyan, M. I. Baznat, A. V. Friesen, K. K. Gudima, M. A. Kozhin, S. A. Lebedev, M. A. Nazarenko, S. A. Nikitin, G. A. Ososkov, S. G. Reznikov, A. N. Sissakian, A. S. Sorin, V. D. Toneev

Abstract: Along with $π^0$ and $η$ mesons, a resonance structure in the invariant mass spectrum of two photons at $M_{γγ}= 360 \pm 7 \pm 9$ MeV is observed in the reaction $d C\toγ+ γ+X$ at momentum 2.75 GeV/c per nucleon. Estimates of its width and production cross section are $Γ= 63.7 \pm 17.8$ MeV and $σ_{γγ}=98\pm24^{+93}_{-67} {\rm μb}$, respectively. The collected statistics amount to… ▽ More Along with $π^0$ and $η$ mesons, a resonance structure in the invariant mass spectrum of two photons at $M_{γγ}= 360 \pm 7 \pm 9$ MeV is observed in the reaction $d C\toγ+ γ+X$ at momentum 2.75 GeV/c per nucleon. Estimates of its width and production cross section are $Γ= 63.7 \pm 17.8$ MeV and $σ_{γγ}=98\pm24^{+93}_{-67} {\rm μb}$, respectively. The collected statistics amount to $2339 \pm 340$ events of $1.5\cdot 10^6$ triggered interactions of a total number $\sim 10^{12}$ of $d$C-interactions. This resonance structure is not observed in $p$C collisions at the beam momentum 5.5 GeV/c. Possible mechanisms of this ABC-like effect are discussed. △ Less

Submitted 28 September, 2009; v1 submitted 17 June, 2008; originally announced June 2008.

Journal ref: Phys.Rev.C80:034001,2009