Showing 1–44 of 44 results for author: Flores, A

Exploring Human-LLM Conversations: Mental Models and the Originator of Toxicity

Authors: Johannes Schneider, Arianna Casanova Flores, Anne-Catherine Kranz

Abstract: This study explores real-world human interactions with large language models (LLMs) in diverse, unconstrained settings in contrast to most prior research focusing on ethically trimmed models like ChatGPT for specific tasks. We aim to understand the originator of toxicity. Our findings show that although LLMs are rightfully accused of providing toxic content, it is mostly demanded or at least provo… ▽ More This study explores real-world human interactions with large language models (LLMs) in diverse, unconstrained settings in contrast to most prior research focusing on ethically trimmed models like ChatGPT for specific tasks. We aim to understand the originator of toxicity. Our findings show that although LLMs are rightfully accused of providing toxic content, it is mostly demanded or at least provoked by humans who actively seek such content. Our manual analysis of hundreds of conversations judged as toxic by APIs commercial vendors, also raises questions with respect to current practices of what user requests are refused to answer. Furthermore, we conjecture based on multiple empirical indicators that humans exhibit a change of their mental model, switching from the mindset of interacting with a machine more towards interacting with a human. △ Less

Submitted 8 July, 2024; originally announced July 2024.

Study of Clustered Robust Linear Precoding for Cell-Free MU-MIMO Networks

Authors: A. Flores, R. de Lamare

Abstract: Precoding techniques are key to dealing with multiuser interference in the downlink of cell-free (CF) multiple-input multiple-output systems. However, these techniques rely on accurate estimates of the channel state information at the transmitter (CSIT), which is not possible to obtain in practical systems. As a result, precoders cannot handle interference as expected and the residual interference… ▽ More Precoding techniques are key to dealing with multiuser interference in the downlink of cell-free (CF) multiple-input multiple-output systems. However, these techniques rely on accurate estimates of the channel state information at the transmitter (CSIT), which is not possible to obtain in practical systems. As a result, precoders cannot handle interference as expected and the residual interference substantially degrades the performance of the system. To address this problem, CF systems require precoders that are robust to CSIT imperfections. In this paper, we propose novel robust precoding techniques to mitigate the effects of residual multiuser interference. To this end, we include a loading term that minimizes the effects of the imperfect CSIT in the optimization objective. We further derive robust precoders that employ clusters of users and access points to reduce the computational cost and the signaling load. Numerical experiments show that the proposed robust minimum mean-square error (MMSE) precoding techniques outperform the conventional MMSE precoder for various accuracy levels of CSIT estimates. △ Less

Submitted 7 July, 2024; originally announced July 2024.

Comments: 2 figures, 7 figures

Chronicles of CI/CD: A Deep Dive into its Usage Over Time

Authors: Hugo da Gião, André Flores, Rui Pereira, Jácome Cunha

Abstract: DevOps is a combination of methodologies and tools that improves the software development, build, deployment, and monitoring processes by shortening its lifecycle and improving software quality. Part of this process is CI/CD, which embodies mostly the first parts, right up to the deployment. Despite the many benefits of DevOps and CI/CD, it still presents many challenges promoted by the tremendous… ▽ More DevOps is a combination of methodologies and tools that improves the software development, build, deployment, and monitoring processes by shortening its lifecycle and improving software quality. Part of this process is CI/CD, which embodies mostly the first parts, right up to the deployment. Despite the many benefits of DevOps and CI/CD, it still presents many challenges promoted by the tremendous proliferation of different tools, languages, and syntaxes, which makes the field quite challenging to learn and keep up to date. Software repositories contain data regarding various software practices, tools, and uses. This data can help gather multiple insights that inform technical and academic decision-making. GitHub is currently the most popular software hosting platform and provides a search API that lets users query its repositories. Our goal with this paper is to gain insights into the technologies developers use for CI/CD by analyzing GitHub repositories. Using a list of the state-of-the-art CI/CD technologies, we use the GitHub search API to find repositories using each of these technologies. We also use the API to extract various insights regarding those repositories. We then organize and analyze the data collected. From our analysis, we provide an overview of the use of CI/CD technologies in our days, but also what happened in the last 12 years. We also show developers use several technologies simultaneously in the same project and that the change between technologies is quite common. From these insights, we find several research paths, from how to support the use of multiple technologies, both in terms of techniques, but also in terms of human-computer interaction, to aiding developers in evolving their CI/CD pipelines, again considering the various dimensions of the problem. △ Less

Submitted 27 February, 2024; originally announced February 2024.

Predicting Machine Translation Performance on Low-Resource Languages: The Role of Domain Similarity

Authors: Eric Khiu, Hasti Toossi, David Anugraha, Jinyu Liu, Jiaxu Li, Juan Armando Parra Flores, Leandro Acros Roman, A. Seza Doğruöz, En-Shiun Annie Lee

Abstract: Fine-tuning and testing a multilingual large language model is expensive and challenging for low-resource languages (LRLs). While previous studies have predicted the performance of natural language processing (NLP) tasks using machine learning methods, they primarily focus on high-resource languages, overlooking LRLs and shifts across domains. Focusing on LRLs, we investigate three factors: the si… ▽ More Fine-tuning and testing a multilingual large language model is expensive and challenging for low-resource languages (LRLs). While previous studies have predicted the performance of natural language processing (NLP) tasks using machine learning methods, they primarily focus on high-resource languages, overlooking LRLs and shifts across domains. Focusing on LRLs, we investigate three factors: the size of the fine-tuning corpus, the domain similarity between fine-tuning and testing corpora, and the language similarity between source and target languages. We employ classical regression models to assess how these factors impact the model's performance. Our results indicate that domain similarity has the most critical impact on predicting the performance of Machine Translation models. △ Less

Submitted 4 February, 2024; originally announced February 2024.

Comments: 13 pages, 5 figures, accepted to EACL 2024, findings

Tomlinson-Harashima Cluster-Based Precoders for Cell-Free MU-MIMO Networks

Authors: A. Flores, R. C. de Lamare, K. V. Mishra

Abstract: Cell-free (CF) multiple-input multiple-output (MIMO) systems generally employ linear precoding techniques to mitigate the effects of multiuser interference. However, the power loss, efficiency, and precoding accuracy of linear precoders are usually improved by replacing them with nonlinear precoders that employ perturbation and modulo operation. In this work, we propose nonlinear user-centric prec… ▽ More Cell-free (CF) multiple-input multiple-output (MIMO) systems generally employ linear precoding techniques to mitigate the effects of multiuser interference. However, the power loss, efficiency, and precoding accuracy of linear precoders are usually improved by replacing them with nonlinear precoders that employ perturbation and modulo operation. In this work, we propose nonlinear user-centric precoders for CF MIMO, wherein different clusters of access points (APs) serve different users in CF multiple-antenna networks. Each cluster of APs is selected based on large-scale fading coefficients. The clustering procedure results in a sparse nonlinear precoder. We further devise a reduced-dimension nonlinear precoder, where clusters of users are created to reduce the complexity of the nonlinear precoder, the amount of required signaling, and the number of users. Numerical experiments show that the proposed nonlinear techniques for CF systems lead to an enhanced performance when compared to their linear counterparts. △ Less

Submitted 25 December, 2023; originally announced December 2023.

Comments: 2 figures, 6 pages

Clustered Cell-Free Multi-User MIMO Systems with Rate-Splitting

Authors: A. Flores, R. C. de Lamare, K. V. Mishra

Abstract: In this paper, we address two crucial challenges in the design of cell-free (CF) systems: degradation in the performance of CF systems by imperfect channel state information at the transmitter (CSIT) and high computational/signaling loads arising from the increasing number of distributed antennas and parameters to be exchanged. To mitigate the effects of imperfect CSIT, we employ rate-splitting (R… ▽ More In this paper, we address two crucial challenges in the design of cell-free (CF) systems: degradation in the performance of CF systems by imperfect channel state information at the transmitter (CSIT) and high computational/signaling loads arising from the increasing number of distributed antennas and parameters to be exchanged. To mitigate the effects of imperfect CSIT, we employ rate-splitting (RS) multiple-access, which separates the messages into common and private streams. Unlike prior works, we present a clustered CF multi-user multiple-antenna framework with RS, which groups the transmit antennas in several clusters to reduce the computational and signaling loads. The proposed RS-CF system employs one common stream per cluster to exploit the network diversity. Furthermore, we propose new cluster-based linear precoders for this framework. We then devise a power allocation strategy for the common and private streams within clusters and derive closed-form expressions for the sum-rate performance of the proposed cluster-based RS-CF system. Numerical results show that the proposed clustered RS-CF system and algorithms outperform existing approaches. % in terms of the sum-rate. △ Less

Submitted 16 July, 2023; originally announced July 2023.

Comments: 27 pages, 8 figures

A GDPR-compliant Risk Management Approach based on Threat Modelling and ISO 27005

Authors: Denys A. Flores, Ricardo Perugachi

Abstract: Computer systems process, store and transfer sensitive information which makes them a valuable asset. Despite the existence of standards such as ISO 27005 for managing information risk, cyber threats are increasing, exposing such systems to security breaches, and at the same time, compromising users' privacy. However, threat modelling has also emerged as an alternative to identify and analyze them… ▽ More Computer systems process, store and transfer sensitive information which makes them a valuable asset. Despite the existence of standards such as ISO 27005 for managing information risk, cyber threats are increasing, exposing such systems to security breaches, and at the same time, compromising users' privacy. However, threat modelling has also emerged as an alternative to identify and analyze them, reducing the attack landscape by discarding low-risk attack vectors, and mitigating high-risk ones. In this work, we introduce a novel threat-modelling-based approach for risk management, using ISO 27005 as a baseline for integrating ISO 27001/27002 security controls with privacy regulations outlined in the European General Data Protection Regulation (GDPR). In our proposal, risk estimation and mitigation is enhanced by combining STRIDE and attack trees as a threat modelling strategy. Our approach is applied to an IoT case study, where different attacks are analyzed to determine their risk levels and potential countermeasures. △ Less

Submitted 7 June, 2023; originally announced June 2023.

Comments: The 2021 World Congress in Computer Science, Computer Engineering, & Applied Computing (CSCE'21), The 2021 International Conference on Security and Management (SAM'21), 14 pages, 3 figures, 5 tables

Nonlinear Kalman Filtering with Reparametrization Gradients

Authors: San Gultekin, Brendan Kitts, Aaron Flores, John Paisley

Abstract: We introduce a novel nonlinear Kalman filter that utilizes reparametrization gradients. The widely used parametric approximation is based on a jointly Gaussian assumption of the state-space model, which is in turn equivalent to minimizing an approximation to the Kullback-Leibler divergence. It is possible to obtain better approximations using the alpha divergence, but the resulting problem is subs… ▽ More We introduce a novel nonlinear Kalman filter that utilizes reparametrization gradients. The widely used parametric approximation is based on a jointly Gaussian assumption of the state-space model, which is in turn equivalent to minimizing an approximation to the Kullback-Leibler divergence. It is possible to obtain better approximations using the alpha divergence, but the resulting problem is substantially more complex. In this paper, we introduce an alternate formulation based on an energy function, which can be optimized instead of the alpha divergence. The optimization can be carried out using reparametrization gradients, a technique that has recently been utilized in a number of deep learning models. △ Less

Submitted 8 March, 2023; originally announced March 2023.

Leveraging the Hints: Adaptive Bidding in Repeated First-Price Auctions

Authors: Wei Zhang, Yanjun Han, Zhengyuan Zhou, Aaron Flores, Tsachy Weissman

Abstract: With the advent and increasing consolidation of e-commerce, digital advertising has very recently replaced traditional advertising as the main marketing force in the economy. In the past four years, a particularly important development in the digital advertising industry is the shift from second-price auctions to first-price auctions for online display ads. This shift immediately motivated the int… ▽ More With the advent and increasing consolidation of e-commerce, digital advertising has very recently replaced traditional advertising as the main marketing force in the economy. In the past four years, a particularly important development in the digital advertising industry is the shift from second-price auctions to first-price auctions for online display ads. This shift immediately motivated the intellectually challenging question of how to bid in first-price auctions, because unlike in second-price auctions, bidding one's private value truthfully is no longer optimal. Following a series of recent works in this area, we consider a differentiated setup: we do not make any assumption about other bidders' maximum bid (i.e. it can be adversarial over time), and instead assume that we have access to a hint that serves as a prediction of other bidders' maximum bid, where the prediction is learned through some blackbox machine learning model. We consider two types of hints: one where a single point-prediction is available, and the other where a hint interval (representing a type of confidence region into which others' maximum bid falls) is available. We establish minimax optimal regret bounds for both cases and highlight the quantitatively different behavior between the two settings. We also provide improved regret bounds when the others' maximum bid exhibits the further structure of sparsity. Finally, we complement the theoretical results with demonstrations using real bidding data. △ Less

Submitted 5 November, 2022; originally announced November 2022.

Comments: 28 pages

The role of open data in the transformation to Society 5.0: a resource or a tool for SDG-compliant Smart Living?

Authors: Anastasija Nikiforova, Miguel Angel Alor Flores, Miltiadis D. Lytras

Abstract: Open data are characterized by a number of economic, technological, innovative and social benefits. They are seen as a significant contributor to the city's transformation into Smart City. This is all the more so when the society is on the border of Society 5.0, i.e., shift from the information society to a super smart society or society of imagination takes place. However, the question constantly… ▽ More Open data are characterized by a number of economic, technological, innovative and social benefits. They are seen as a significant contributor to the city's transformation into Smart City. This is all the more so when the society is on the border of Society 5.0, i.e., shift from the information society to a super smart society or society of imagination takes place. However, the question constantly asked by open data experts is, what are the key factors to be met and satisfied in order to achieve promised benefits? The current trend of openness suggests that the principle of openness should be followed not only by data but also research, education, software, standard, hardware etc., it should become a philosophy to be followed at different levels, in different domains. This should ensure greater transparency, eliminating inequalities, promoting, and achieving sustainable development goals. Therefore, many agendas now have openness as a prerequisite. This chapter deals with concepts of open (government) data and Society 5.0 pointing to their common objectives, providing some success stories of open data use in smart cities or transformation of cities towards smart cities, mapping them to the features of the Society 5.0. We believe that this trend develops a new form of society, which we refer to as "open data-driven society". It forms a bridge from Society 4.0 to Society 5.0. This Chapter attempts to identify the role of openness in promoting human-centric Smart Society, Smart city, and Smart Living. △ Less

Submitted 29 May, 2023; v1 submitted 23 June, 2022; originally announced June 2022.

Comments: Cite as: Nikiforova, A., Alor Flores M. A., & Lytras, M. D. (2023). The Role Of Open Data In The Transformation To Society 5.0: A Resource Or A Tool For SDG-Compliant Smart Living?. In Smart Cities and Digital Transformation Empowering Communities, Limitless Innovation, Sustainable Development and the Next Generation (pp. 219-252). Emerald Publishing Limited, ISBN: 9781804559956

Journal ref: In Smart Cities and Digital Transformation Empowering Communities, Limitless Innovation, Sustainable Development and the Next Generation (pp. 219-252). Emerald Publishing Limited, ISBN: 9781804559956, 2023

Study of Robust Adaptive Power Allocation Techniques for Rate Splitting based MU-MIMO systems

Authors: A. R. Flores, R. C. de Lamare

Abstract: Rate splitting (RS) systems can better deal with imperfect channel state information at the transmitter (CSIT) than conventional approaches. However, this requires an appropriate power allocation that often has a high computational complexity, which might be inadequate for practical and large systems. To this end, adaptive power allocation techniques can provide good performance with low computati… ▽ More Rate splitting (RS) systems can better deal with imperfect channel state information at the transmitter (CSIT) than conventional approaches. However, this requires an appropriate power allocation that often has a high computational complexity, which might be inadequate for practical and large systems. To this end, adaptive power allocation techniques can provide good performance with low computational cost. This work presents novel robust and adaptive power allocation technique for RS-based multiuser multiple-input multiple-output (MU-MIMO) systems. In particular, we develop a robust adaptive power allocation based on stochastic gradient learning and the minimization of the mean-square error between the transmitted symbols of the RS system and the received signal. The proposed robust power allocation strategy incorporates knowledge of the variance of the channel errors to deal with imperfect CSIT and adjust power levels in the presence of uncertainty. An analysis of the convexity and stability of the proposed power allocation algorithms is provided, together with a study of their computational complexity and theoretical bounds relating the power allocation strategies. Numerical results show that the sum-rate of an RS system with adaptive power allocation outperforms RS and conventional MU-MIMO systems under imperfect CSIT. %\vspace{-0.75em} △ Less

Submitted 3 June, 2022; originally announced June 2022.

Comments: 27 pages, 10 figures

Study of Robust Adaptive Power allocation for the Downlink of Multiple-Antenna Systems

Authors: A. Flores, R. C. de Lamare

Abstract: Multiple-input multiple-output (MIMO) systems greatly increase the overall throughput of wireless systems since they are capable of transmitting multiple streams employing the same time-frequency resources. However, this gain requires an appropriate precoder design and a power allocation technique. In general, precoders and power allocation schemes are designed assuming perfect channel estate info… ▽ More Multiple-input multiple-output (MIMO) systems greatly increase the overall throughput of wireless systems since they are capable of transmitting multiple streams employing the same time-frequency resources. However, this gain requires an appropriate precoder design and a power allocation technique. In general, precoders and power allocation schemes are designed assuming perfect channel estate information (CSI). Nonetheless, this is an optimistic assumption since real systems only possess partial or imperfect CSI at the transmitter (CSIT). The imperfect CSIT originates residual inter-user interference, which is detrimental for wireless systems. In this paper, two adaptive power allocation algorithms are proposed, which are more robust against CSIT imperfections than conventional techniques. Both techniques employ the mean square error as the objective function. Simulation results show that the proposed techniques obtain a higher performance in terms of sum-rate than conventional approaches. △ Less

Submitted 12 February, 2022; originally announced February 2022.

Comments: 7 pages, 3 figures

Rate-Splitting Meets Cell-Free MIMO Communications

Authors: André Flores, Rodrigo C. de Lamare, Kumar Vijay Mishra

Abstract: Multiuser multiple-input multiple-output wireless communications systems have the potential to satisfy the performance requirements of fifth-generation and future wireless networks. In this context, cell-free (CF) systems, where the antennas are distributed over the area of interest, have attracted attention because of their potential to enhance the overall efficiency and throughput performance wh… ▽ More Multiuser multiple-input multiple-output wireless communications systems have the potential to satisfy the performance requirements of fifth-generation and future wireless networks. In this context, cell-free (CF) systems, where the antennas are distributed over the area of interest, have attracted attention because of their potential to enhance the overall efficiency and throughput performance when compared to traditional networks based on cells. However, the performance of CF systems is degraded by imperfect channel state information (CSI). To mitigate the detrimental effects of imperfect CSI, we employ rate splitting (RS) - a multiple-access scheme. The RS approach divides the messages of the users into two separate common and private portions so that interference is managed robustly. Unlike prior works, where the impact of RS in CF systems remains unexamined, we propose a CF architecture that employs RS with linear precoders to address deteriorated CSI. We derive closed-form expressions to compute the sum-rate performance of the proposed RS-CF architecture. Our numerical experiments show that our RS-CF system outperforms existing systems in terms of sum-rate, obtaining up to $10$% higher gain. △ Less

Submitted 3 December, 2021; v1 submitted 1 December, 2021; originally announced December 2021.

Comments: 4 figures, 6 pages

Mapping Access to Water and Sanitation in Colombia using Publicly Accessible Satellite Imagery, Crowd-sourced Geospatial Information and RandomForests

Authors: Niccolo Dejito, Ren Avell Flores, Rodolfo de Guzman, Isabelle Tingzon, Liliana Carvajal, Alberto Aroca, Carlos Delgado

Abstract: Up-to-date, granular, and reliable quality of life data is crucial for humanitarian organizations to develop targeted interventions for vulnerable communities, especially in times of crisis. One such quality of life data is access to water, sanitation and hygeine (WASH). Traditionally, data collection is done through door-to-door surveys sampled over large areas. Unfortunately, the huge costs asso… ▽ More Up-to-date, granular, and reliable quality of life data is crucial for humanitarian organizations to develop targeted interventions for vulnerable communities, especially in times of crisis. One such quality of life data is access to water, sanitation and hygeine (WASH). Traditionally, data collection is done through door-to-door surveys sampled over large areas. Unfortunately, the huge costs associated with collecting these data deter more frequent and large-coverage surveys. To address this challenge, we present a scalable and inexpensive end-to-end WASH estimation workflow using a combination of machine learning and census data, publicly available satellite images, and crowd-sourced geospatial information. We generate a map of WASH estimates at a granularity of 250m x 250m across the entire country of Colombia. The model was able to explain up to 65% of the variation in predicting access to water supply, sewage, and toilets. The code is made available with MIT License at https://github.com/thinkingmachines/geoai-immap-wash. △ Less

Submitted 7 November, 2021; originally announced November 2021.

Comments: Accepted to the 3rd Workshop on Artificial Intelligence for Humanitarian Assistance and Disaster Response at NeurIPS 2021

Mid-flight Forecasting for CPA Lines in Online Advertising

Authors: Hao He, Tian Zhou, Lihua Ren, Niklas Karlsson, Aaron Flores

Abstract: For Verizon MediaDemand Side Platform(DSP), forecasting of ad campaign performance not only feeds key information to the optimization server to allow the system to operate on a high-performance mode, but also produces actionable insights to the advertisers. In this paper, the forecasting problem for CPA lines in the middle of the flight is investigated by taking the bidding mechanism into account.… ▽ More For Verizon MediaDemand Side Platform(DSP), forecasting of ad campaign performance not only feeds key information to the optimization server to allow the system to operate on a high-performance mode, but also produces actionable insights to the advertisers. In this paper, the forecasting problem for CPA lines in the middle of the flight is investigated by taking the bidding mechanism into account. The proposed methodology generates relationships between various key performance metrics and optimization signals. It can also be used to estimate the sensitivity of ad campaign performance metrics to the adjustments of optimization signal, which is important to the design of a campaign management system. The relationship between advertiser spends and effective Cost Per Action(eCPA) is also characterized, which serves as a guidance for mid-flight line adjustment to the advertisers. Several practical issues in implementation, such as downsampling of the dataset, are also discussed in the paper. At last, the forecasting results are validated against actual deliveries and demonstrates promising accuracy. △ Less

Submitted 15 July, 2021; originally announced July 2021.

Comments: 41st International Symposium on Forecasting, June 27-30, 2021

An Efficient Deep Distribution Network for Bid Shading in First-Price Auctions

Authors: Tian Zhou, Hao He, Shengjun Pan, Niklas Karlsson, Bharatbhushan Shetty, Brendan Kitts, Djordje Gligorijevic, San Gultekin, Tingyu Mao, Junwei Pan, Jianlong Zhang, Aaron Flores

Abstract: Since 2019, most ad exchanges and sell-side platforms (SSPs), in the online advertising industry, shifted from second to first price auctions. Due to the fundamental difference between these auctions, demand-side platforms (DSPs) have had to update their bidding strategies to avoid bidding unnecessarily high and hence overpaying. Bid shading was proposed to adjust the bid price intended for second… ▽ More Since 2019, most ad exchanges and sell-side platforms (SSPs), in the online advertising industry, shifted from second to first price auctions. Due to the fundamental difference between these auctions, demand-side platforms (DSPs) have had to update their bidding strategies to avoid bidding unnecessarily high and hence overpaying. Bid shading was proposed to adjust the bid price intended for second-price auctions, in order to balance cost and winning probability in a first-price auction setup. In this study, we introduce a novel deep distribution network for optimal bidding in both open (non-censored) and closed (censored) online first-price auctions. Offline and online A/B testing results show that our algorithm outperforms previous state-of-art algorithms in terms of both surplus and effective cost per action (eCPX) metrics. Furthermore, the algorithm is optimized in run-time and has been deployed into VerizonMedia DSP as production algorithm, serving hundreds of billions of bid requests per day. Online A/B test shows that advertiser's ROI are improved by +2.4%, +2.4%, and +8.6% for impression based (CPM), click based (CPC), and conversion based (CPA) campaigns respectively. △ Less

Submitted 15 July, 2021; v1 submitted 12 July, 2021; originally announced July 2021.

Comments: In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD'21), August 14-18, 2021, Singapore

Study of Multi-Branch Tomlinson-Harashima Precoding with Multiple-Antenna Systems and Rate Splitting

Authors: A. Flores, R. C. de Lamare, B. Clerckx

Abstract: Rate splitting (RS) has emerged as a valuable technology for wireless communications systems due to its capability to deal with uncertainties in the channel state information at the transmitter (CSIT). RS with linear and non-linear precoders, such as the Tomlinson-Harashima (THP) precoder, have been explored in the downlink (DL) of multiuser multi antenna systems. In this work, we propose a multi-… ▽ More Rate splitting (RS) has emerged as a valuable technology for wireless communications systems due to its capability to deal with uncertainties in the channel state information at the transmitter (CSIT). RS with linear and non-linear precoders, such as the Tomlinson-Harashima (THP) precoder, have been explored in the downlink (DL) of multiuser multi antenna systems. In this work, we propose a multi-branch (MB) scheme for a RS-based multiple-antenna system, which creates patterns to order the transmitted symbols and enhances the overall sum rate performance compared to existing approaches. Closed-form expressions are derived for the sum rate through statistical analysis. Simulation results show that the proposed MB-THP for RS outperforms conventional THP and MB-THP schemes. △ Less

Submitted 4 June, 2021; originally announced June 2021.

Comments: 2 figures, 7 pages

Robust MMSE Precoding and Power Allocation for Cell-Free Networks

Authors: V. M. T. Palhares, A. Flores, R. C. de Lamare

Abstract: We consider the downlink of a cell-free massive multiple-input multiple-output (MIMO) system with \textcolor{red}{single}-antenna access points (APs) and single-antenna users. An iterative robust minimum mean-square error (RMMSE) precoder based on generalized loading is developed to mitigate interference in the presence of imperfect channel state information (CSI). An achievable rate analysis is c… ▽ More We consider the downlink of a cell-free massive multiple-input multiple-output (MIMO) system with \textcolor{red}{single}-antenna access points (APs) and single-antenna users. An iterative robust minimum mean-square error (RMMSE) precoder based on generalized loading is developed to mitigate interference in the presence of imperfect channel state information (CSI). An achievable rate analysis is carried out and optimal and uniform power allocation schemes are developed based on the signal-to-interference-plus-noise ratio. An analysis of the computational costs of the proposed RMMSE and existing schemes is also presented. Numerical results show the improvement provided by the proposed RMMSE precoder against linear minimum mean-square error, zero-forcing and conjugate beamforming precoders in the presence of imperfect CSI. △ Less

Submitted 19 April, 2021; originally announced April 2021.

Comments: 8 pages, 4 figures. arXiv admin note: text overlap with arXiv:2104.05165

Iterative Access Point Selection, MMSE Precoding and Power Allocation for Cell-Free Networks

Authors: V. Palhares, A. R. Flores, R. C. de Lamare

Abstract: In this work, we propose iterative access point (AP) selection (APS), linear minimum mean-square error (MMSE) precoding and power allocation techniques for Cell-Free Massive multiple-input multiple-output (MIMO) systems. We consider the downlink channel with single-antenna users and multiple-antenna APs. We derive sum-rate expressions for the proposed iterative APS techniques followed by MMSE prec… ▽ More In this work, we propose iterative access point (AP) selection (APS), linear minimum mean-square error (MMSE) precoding and power allocation techniques for Cell-Free Massive multiple-input multiple-output (MIMO) systems. We consider the downlink channel with single-antenna users and multiple-antenna APs. We derive sum-rate expressions for the proposed iterative APS techniques followed by MMSE precoding and optimal, adaptive, and uniform power allocation schemes. Simulations show that the proposed approach outperforms existing conjugate beamforming (CB) and zero-forcing (ZF) schemes and that performance remains excellent with APS, in the presence of perfect and imperfect channel state information (CSI). △ Less

Submitted 11 April, 2021; originally announced April 2021.

Comments: 13 figures, 14 pages

Tomlinson-Harashima Precoding with Stream Combiners for MU-MIMO with Rate-Splitting

Authors: A. Flores, R. C. de Lamare, B. Clerckx

Abstract: This paper introduces multiuser multiple-input multiple-output (MU-MIMO) architectures based on non-linear precoding and stream combining techniques using rate-splitting (RS), where the transmitter often has only partial knowledge of the channel state information (CSI). In contrast to existing works, we consider deployments where the receivers may be equipped with multiple antennas. This allows us… ▽ More This paper introduces multiuser multiple-input multiple-output (MU-MIMO) architectures based on non-linear precoding and stream combining techniques using rate-splitting (RS), where the transmitter often has only partial knowledge of the channel state information (CSI). In contrast to existing works, we consider deployments where the receivers may be equipped with multiple antennas. This allows us to employ linear combining techniques based on the Min-Max, the maximum ratio and the minimum mean-square error criteria along with Tomlinson-Harashima precoders (THP) for RS-based MU-MIMO systems to enhance the sum-rate performance. Moreover, we incorporate the Multi-Branch (MB) concept into the RS architecture to further improve the sum-rate performance. Closed-form expressions for the signal-to-interference-plus-noise ratio and the sum-rate at the receiver end are devised through statistical analysis. Simulation results show that the proposed RS-THP schemes achieve better performance than conventional linear and THP precoders. △ Less

Submitted 14 March, 2021; originally announced March 2021.

Comments: 12 figures, 5 tables

$FM^2$: Field-matrixed Factorization Machines for Recommender Systems

Authors: Yang Sun, Junwei Pan, Alex Zhang, Aaron Flores

Abstract: Click-through rate (CTR) prediction plays a critical role in recommender systems and online advertising. The data used in these applications are multi-field categorical data, where each feature belongs to one field. Field information is proved to be important and there are several works considering fields in their models. In this paper, we proposed a novel approach to model the field information e… ▽ More Click-through rate (CTR) prediction plays a critical role in recommender systems and online advertising. The data used in these applications are multi-field categorical data, where each feature belongs to one field. Field information is proved to be important and there are several works considering fields in their models. In this paper, we proposed a novel approach to model the field information effectively and efficiently. The proposed approach is a direct improvement of FwFM, and is named as Field-matrixed Factorization Machines (FmFM, or $FM^2$). We also proposed a new explanation of FM and FwFM within the FmFM framework, and compared it with the FFM. Besides pruning the cross terms, our model supports field-specific variable dimensions of embedding vectors, which acts as soft pruning. We also proposed an efficient way to minimize the dimension while keeping the model performance. The FmFM model can also be optimized further by caching the intermediate vectors, and it only takes thousands of floating-point operations (FLOPs) to make a prediction. Our experiment results show that it can out-perform the FFM, which is more complex. The FmFM model's performance is also comparable to DNN models which require much more FLOPs in runtime. △ Less

Submitted 19 March, 2021; v1 submitted 19 February, 2021; originally announced February 2021.

Comments: In Proceedings of the Web Conference 2021 (WWW 2021), April 19-23, 2021, Ljubljana, Slovenia. 10 pages

Implementation of a neural network for non-linearities estimation in a tail-sitter aircraft

Authors: A. Flores, G. Flores

Abstract: The control of a tail-sitter aircraft is a challenging task, especially during transition maneuver where the lift and drag forces are highly nonlinear. In this work, we implement a Neural Network (NN) capable of estimate such nonlinearities. Once they are estimated, one can propose a control scheme where these forces can correctly feed-forwarded. Our implementation of the NN has been programmed in… ▽ More The control of a tail-sitter aircraft is a challenging task, especially during transition maneuver where the lift and drag forces are highly nonlinear. In this work, we implement a Neural Network (NN) capable of estimate such nonlinearities. Once they are estimated, one can propose a control scheme where these forces can correctly feed-forwarded. Our implementation of the NN has been programmed in C++ on the PX4 Autopilot an open-source autopilot for drones. To ensure that this implementation does not considerably affect the autopilot's performance, the coded NN must be of a light computational load. With the aim to test our approach, we have carried out a series of realistic simulations in the Software in The Loop (SITL) using the PX4 Autopilot. These experiments demonstrate that the implemented NN can be used to estimate the tail-sitter aerodynamic forces, and can be used to improve the control algorithms during all the flight phases of the tail-sitter aircraft: hover, cruise flight, and transition. △ Less

Submitted 12 October, 2020; originally announced October 2020.

Comments: 11 pages, 8 figures

Bid Shading by Win-Rate Estimation and Surplus Maximization

Authors: Shengjun Pan, Brendan Kitts, Tian Zhou, Hao He, Bharatbhushan Shetty, Aaron Flores, Djordje Gligorijevic, Junwei Pan, Tingyu Mao, San Gultekin, Jianlong Zhang

Abstract: This paper describes a new win-rate based bid shading algorithm (WR) that does not rely on the minimum-bid-to-win feedback from a Sell-Side Platform (SSP). The method uses a modified logistic regression to predict the profit from each possible shaded bid price. The function form allows fast maximization at run-time, a key requirement for Real-Time Bidding (RTB) systems. We report production result… ▽ More This paper describes a new win-rate based bid shading algorithm (WR) that does not rely on the minimum-bid-to-win feedback from a Sell-Side Platform (SSP). The method uses a modified logistic regression to predict the profit from each possible shaded bid price. The function form allows fast maximization at run-time, a key requirement for Real-Time Bidding (RTB) systems. We report production results from this method along with several other algorithms. We found that bid shading, in general, can deliver significant value to advertisers, reducing price per impression to about 55% of the unshaded cost. Further, the particular approach described in this paper captures 7% more profit for advertisers, than do benchmark methods of just bidding the most probable winning price. We also report 4.3% higher surplus than an industry Sell-Side Platform shading service. Furthermore, we observed 3% - 7% lower eCPM, eCPC and eCPA when the algorithm was integrated with budget controllers. We attribute the gains above as being mainly due to the explicit maximization of the surplus function, and note that other algorithms can take advantage of this same approach. △ Less

Submitted 19 September, 2020; originally announced September 2020.

Comments: AdKDD 2020

Using Known Words to Learn More Words: A Distributional Analysis of Child Vocabulary Development

Authors: Andrew Z. Flores, Jessica Montag, Jon Willits

Abstract: Why do children learn some words before others? Understanding individual variability across children and also variability across words, may be informative of the learning processes that underlie language learning. We investigated item-based variability in vocabulary development using lexical properties of distributional statistics derived from a large corpus of child-directed speech. Unlike previo… ▽ More Why do children learn some words before others? Understanding individual variability across children and also variability across words, may be informative of the learning processes that underlie language learning. We investigated item-based variability in vocabulary development using lexical properties of distributional statistics derived from a large corpus of child-directed speech. Unlike previous analyses, we predicted word trajectories cross-sectionally, shedding light on trends in vocabulary development that may not have been evident at a single time point. We also show that whether one looks at a single age group or across ages as a whole, the best distributional predictor of whether a child knows a word is the number of other known words with which that word tends to co-occur. Keywords: age of acquisition; vocabulary development; lexical diversity; child-directed speech; △ Less

Submitted 21 November, 2021; v1 submitted 14 September, 2020; originally announced September 2020.

Bid Shading in The Brave New World of First-Price Auctions

Authors: Djordje Gligorijevic, Tian Zhou, Bharatbhushan Shetty, Brendan Kitts, Shengjun Pan, Junwei Pan, Aaron Flores

Abstract: Online auctions play a central role in online advertising, and are one of the main reasons for the industry's scalability and growth. With great changes in how auctions are being organized, such as changing the second- to first-price auction type, advertisers and demand platforms are compelled to adapt to a new volatile environment. Bid shading is a known technique for preventing overpaying in auc… ▽ More Online auctions play a central role in online advertising, and are one of the main reasons for the industry's scalability and growth. With great changes in how auctions are being organized, such as changing the second- to first-price auction type, advertisers and demand platforms are compelled to adapt to a new volatile environment. Bid shading is a known technique for preventing overpaying in auction systems that can help maintain the strategy equilibrium in first-price auctions, tackling one of its greatest drawbacks. In this study, we propose a machine learning approach of modeling optimal bid shading for non-censored online first-price ad auctions. We clearly motivate the approach and extensively evaluate it in both offline and online settings on a major demand side platform. The results demonstrate the superiority and robustness of the new approach as compared to the existing approaches across a range of performance metrics. △ Less

Submitted 2 September, 2020; originally announced September 2020.

Comments: In Proceedings of the 29th ACM International Conference on Information and Knowledge Management (CIKM'20), October 19-23, 2020, Virtual Event, Ireland

Mapping New Informal Settlements using Machine Learning and Time Series Satellite Images: An Application in the Venezuelan Migration Crisis

Authors: Isabelle Tingzon, Niccolo Dejito, Ren Avell Flores, Rodolfo De Guzman, Liliana Carvajal, Katerine Zapata Erazo, Ivan Enrique Contreras Cala, Jeffrey Villaveces, Daniela Rubio, Rayid Ghani

Abstract: Since 2014, nearly 2 million Venezuelans have fled to Colombia to escape an economically devastated country during what is one of the largest humanitarian crises in modern history. Non-government organizations and local government units are faced with the challenge of identifying, assessing, and monitoring rapidly growing migrant communities in order to provide urgent humanitarian aid. However, wi… ▽ More Since 2014, nearly 2 million Venezuelans have fled to Colombia to escape an economically devastated country during what is one of the largest humanitarian crises in modern history. Non-government organizations and local government units are faced with the challenge of identifying, assessing, and monitoring rapidly growing migrant communities in order to provide urgent humanitarian aid. However, with many of these displaced populations living in informal settlements areas across the country, locating migrant settlements across large territories can be a major challenge. To address this problem, we propose a novel approach for rapidly and cost-effectively locating new and emerging informal settlements using machine learning and publicly accessible Sentinel-2 time-series satellite imagery. We demonstrate the effectiveness of the approach in identifying potential Venezuelan migrant settlements in Colombia that have emerged between 2015 to 2020. Finally, we emphasize the importance of post-classification verification and present a two-step validation approach consisting of (1) remote validation using Google Earth and (2) on-the-ground validation through the Premise App, a mobile crowdsourcing platform. △ Less

Submitted 15 December, 2020; v1 submitted 27 August, 2020; originally announced August 2020.

Learning to Bid Optimally and Efficiently in Adversarial First-price Auctions

Authors: Yanjun Han, Zhengyuan Zhou, Aaron Flores, Erik Ordentlich, Tsachy Weissman

Abstract: First-price auctions have very recently swept the online advertising industry, replacing second-price auctions as the predominant auction mechanism on many platforms. This shift has brought forth important challenges for a bidder: how should one bid in a first-price auction, where unlike in second-price auctions, it is no longer optimal to bid one's private value truthfully and hard to know the ot… ▽ More First-price auctions have very recently swept the online advertising industry, replacing second-price auctions as the predominant auction mechanism on many platforms. This shift has brought forth important challenges for a bidder: how should one bid in a first-price auction, where unlike in second-price auctions, it is no longer optimal to bid one's private value truthfully and hard to know the others' bidding behaviors? In this paper, we take an online learning angle and address the fundamental problem of learning to bid in repeated first-price auctions, where both the bidder's private valuations and other bidders' bids can be arbitrary. We develop the first minimax optimal online bidding algorithm that achieves an $\widetilde{O}(\sqrt{T})$ regret when competing with the set of all Lipschitz bidding policies, a strong oracle that contains a rich set of bidding strategies. This novel algorithm is built on the insight that the presence of a good expert can be leveraged to improve performance, as well as an original hierarchical expert-chaining structure, both of which could be of independent interest in online learning. Further, by exploiting the product structure that exists in the problem, we modify this algorithm--in its vanilla form statistically optimal but computationally infeasible--to a computationally efficient and space efficient algorithm that also retains the same $\widetilde{O}(\sqrt{T})$ minimax optimal regret guarantee. Additionally, through an impossibility result, we highlight that one is unlikely to compete this favorably with a stronger oracle (than the considered Lipschitz bidding policies). Finally, we test our algorithm on three real-world first-price auction datasets obtained from Verizon Media and demonstrate our algorithm's superior performance compared to several existing bidding algorithms. △ Less

Submitted 9 July, 2020; originally announced July 2020.

Transition control of a tail-sitter UAV using recurrent neural networks

Authors: Alejandro Flores, Gerardo Flores

Abstract: This paper presents the implementation of a Recurrent Neural Network (RNN) based-controller for the stabilization of the flight transition maneuver (hover-cruise and vice versa) of a tail-sitter UAV. The control strategy is based on attitude and velocity stabilization. For that aim, the RNN is used for the estimation of high nonlinear aerodynamic terms during the transition stage. Then, this estim… ▽ More This paper presents the implementation of a Recurrent Neural Network (RNN) based-controller for the stabilization of the flight transition maneuver (hover-cruise and vice versa) of a tail-sitter UAV. The control strategy is based on attitude and velocity stabilization. For that aim, the RNN is used for the estimation of high nonlinear aerodynamic terms during the transition stage. Then, this estimate is used together with a feedback linearization technique for stabilizing the entire system. Results show convergence of linear velocities and the pitch angle during the transition maneuver. To analyze the performance of our proposed control strategy, we present simulations for the transition from hover to cruise and vice versa. △ Less

Submitted 29 June, 2020; originally announced June 2020.

Comments: 7 pages 16 figures Conference paper

Study of Linear Precoding and Stream Combining for Rate Splitting in MU-MIMO Systems

Authors: A. Flores, R. C. de Lamare, B. Clerckx

Abstract: This paper develops stream combining techniques for rate-splitting (RS) multiple-antenna systems with multiple users to enhance the common rate. We propose linear combining techniques based on the Min-Max, the maximum ratio and the minimum mean-square error criteria along with Regularized Block Diagonalization (RBD) precoders for RS-based multiuser multiple-antenna systems. An analysis of the sum… ▽ More This paper develops stream combining techniques for rate-splitting (RS) multiple-antenna systems with multiple users to enhance the common rate. We propose linear combining techniques based on the Min-Max, the maximum ratio and the minimum mean-square error criteria along with Regularized Block Diagonalization (RBD) precoders for RS-based multiuser multiple-antenna systems. An analysis of the sum rate performance is carried out, leading to closed-form expressions. Simulations show that the proposed combining schemes offer a significant sum rate performance gain over conventional linear precoding schemes. △ Less

Submitted 6 March, 2020; originally announced March 2020.

Comments: 5 figures, 5 pages

DeepLight: Deep Lightweight Feature Interactions for Accelerating CTR Predictions in Ad Serving

Authors: Wei Deng, Junwei Pan, Tian Zhou, Deguang Kong, Aaron Flores, Guang Lin

Abstract: Click-through rate (CTR) prediction is a crucial task in online display advertising. The embedding-based neural networks have been proposed to learn both explicit feature interactions through a shallow component and deep feature interactions using a deep neural network (DNN) component. These sophisticated models, however, slow down the prediction inference by at least hundreds of times. To address… ▽ More Click-through rate (CTR) prediction is a crucial task in online display advertising. The embedding-based neural networks have been proposed to learn both explicit feature interactions through a shallow component and deep feature interactions using a deep neural network (DNN) component. These sophisticated models, however, slow down the prediction inference by at least hundreds of times. To address the issue of significantly increased serving delay and high memory usage for ad serving in production, this paper presents \emph{DeepLight}: a framework to accelerate the CTR predictions in three aspects: 1) accelerate the model inference via explicitly searching informative feature interactions in the shallow component; 2) prune redundant layers and parameters at intra-layer and inter-layer level in the DNN component; 3) promote the sparsity of the embedding layer to preserve the most discriminant signals. By combining the above efforts, the proposed approach accelerates the model inference by 46X on Criteo dataset and 27X on Avazu dataset without any loss on the prediction accuracy. This paves the way for successfully deploying complicated embedding-based neural networks in production for ad serving. △ Less

Submitted 6 January, 2021; v1 submitted 17 February, 2020; originally announced February 2020.

Comments: Accepted by WSDM 2021; Source code: https://github.com/WayneDW/DeepLight_Deep-Lightweight-Feature-Interactions

Time-Aware Prospective Modeling of Users for Online Display Advertising

Authors: Djordje Gligorijevic, Jelena Gligorijevic, Aaron Flores

Abstract: Prospective display advertising poses a great challenge for large advertising platforms as the strongest predictive signals of users are not eligible to be used in the conversion prediction systems. To that end efforts are made to collect as much information as possible about each user from various data sources and to design powerful models that can capture weaker signals ultimately obtaining good… ▽ More Prospective display advertising poses a great challenge for large advertising platforms as the strongest predictive signals of users are not eligible to be used in the conversion prediction systems. To that end efforts are made to collect as much information as possible about each user from various data sources and to design powerful models that can capture weaker signals ultimately obtaining good quality of conversion prediction probability estimates. In this study we propose a novel time-aware approach to model heterogeneous sequences of users' activities and capture implicit signals of users' conversion intents. On two real-world datasets we show that our approach outperforms other, previously proposed approaches, while providing interpretability of signal impact to conversion probability. △ Less

Submitted 12 November, 2019; originally announced November 2019.

Comments: Accepted at AdKDD 2019 workshop at KDD'19 conference, Anchorage, Alaska, USA

Predicting Different Types of Conversions with Multi-Task Learning in Online Advertising

Authors: Junwei Pan, Yizhi Mao, Alfonso Lobos Ruiz, Yu Sun, Aaron Flores

Abstract: Conversion prediction plays an important role in online advertising since Cost-Per-Action (CPA) has become one of the primary campaign performance objectives in the industry. Unlike click prediction, conversions have different types in nature, and each type may be associated with different decisive factors. In this paper, we formulate conversion prediction as a multi-task learning problem, so that… ▽ More Conversion prediction plays an important role in online advertising since Cost-Per-Action (CPA) has become one of the primary campaign performance objectives in the industry. Unlike click prediction, conversions have different types in nature, and each type may be associated with different decisive factors. In this paper, we formulate conversion prediction as a multi-task learning problem, so that the prediction models for different types of conversions can be learned together. These models share feature representations, but have their specific parameters, providing the benefit of information-sharing across all tasks. We then propose Multi-Task Field-weighted Factorization Machine (MT-FwFM) to solve these tasks jointly. Our experiment results show that, compared with two state-of-the-art models, MT-FwFM improve the AUC by 0.74% and 0.84% on two conversion types, and the weighted AUC across all conversion types is also improved by 0.50%. △ Less

Submitted 8 March, 2020; v1 submitted 24 July, 2019; originally announced July 2019.

Comments: SIGKDD

Journal ref: SIGKDD 2019

Study of Rate-Splitting Techniques with Block Diagonalization for Multiuser MIMO Systems

Authors: A. Flores, R. C. de Lamare

Abstract: In this work, we investigate Block Diagonalization (BD) techniques for multiuser multiple-antenna systems using rate-splitting (RS) multiple access. In RS multiple access the messages of the users are split into a common part and a private part in order to mitigate multiuser interference. We present the system model for a RS multiple access system operating in a broadcast channel scenario where th… ▽ More In this work, we investigate Block Diagonalization (BD) techniques for multiuser multiple-antenna systems using rate-splitting (RS) multiple access. In RS multiple access the messages of the users are split into a common part and a private part in order to mitigate multiuser interference. We present the system model for a RS multiple access system operating in a broadcast channel scenario where the receivers are equipped with multiple antennas. We also develop linear precoders based on BD for the RS multiple access systems along with combining techniques, such as the min-max criterion and the maximum ratio combining criterion, to enhance the common rate. Closed-form expressions to describe the sum rate performance of the proposed scheme are also derived. The performance of the system is evaluated via simulations considering imperfect channel state information at the transmitter. The results show that the proposed schemes outperform conventional linear precoding methods. △ Less

Submitted 30 June, 2019; originally announced July 2019.

Comments: 9 pages, 3 figures

Latent geometry and dynamics of proximity networks

Authors: Fragkiskos Papadopoulos, Marco Antonio Rodríguez Flores

Abstract: Proximity networks are time-varying graphs representing the closeness among humans moving in a physical space. Their properties have been extensively studied in the past decade as they critically affect the behavior of spreading phenomena and the performance of routing algorithms. Yet, the mechanisms responsible for their observed characteristics remain elusive. Here, we show that many of the obse… ▽ More Proximity networks are time-varying graphs representing the closeness among humans moving in a physical space. Their properties have been extensively studied in the past decade as they critically affect the behavior of spreading phenomena and the performance of routing algorithms. Yet, the mechanisms responsible for their observed characteristics remain elusive. Here, we show that many of the observed properties of proximity networks emerge naturally and simultaneously in a simple latent space network model, called dynamic-$\mathbb{S}^{1}$. The dynamic-$\mathbb{S}^{1}$ does not model node mobility directly, but captures the connectivity in each snapshot---each snapshot in the model is a realization of the $\mathbb{S}^{1}$ model of traditional complex networks, which is isomorphic to hyperbolic geometric graphs. By forgoing the motion component the model facilitates mathematical analysis, allowing us to prove the contact, inter-contact and weight distributions. We show that these distributions are power laws in the thermodynamic limit with exponents lying within the ranges observed in real systems. Interestingly, we find that network temperature plays a central role in network dynamics, dictating the exponents of these distributions, the time-aggregated agent degrees, and the formation of unique and recurrent components. Further, we show that paradigmatic epidemic and rumor spreading processes perform similarly in real and modeled networks. The dynamic-$\mathbb{S}^{1}$ or extensions of it may apply to other types of time-varying networks and constitute the basis of maximum likelihood estimation methods that infer the node coordinates and their evolution in the latent spaces of real systems. △ Less

Submitted 27 November, 2019; v1 submitted 28 June, 2019; originally announced July 2019.

Journal ref: Phys. Rev. E 100, 052313 (2019)

Biological plausibility and stochasticity in scalable VO2 active memristor neurons

Authors: Wei Yi, Kenneth K. Tsang, Stephen K. Lam, Xiwei Bai, Jack A. Crowell, Elias A. Flores

Abstract: Neuromorphic networks of artificial neurons and synapses can solve computational hard problems with energy efficiencies unattainable for von Neumann architectures. For image processing, silicon neuromorphic processors outperform graphic processing units (GPUs) in energy efficiency by a large margin, but they deliver much lower chip-scale throughput. The performance-efficiency dilemma for silicon p… ▽ More Neuromorphic networks of artificial neurons and synapses can solve computational hard problems with energy efficiencies unattainable for von Neumann architectures. For image processing, silicon neuromorphic processors outperform graphic processing units (GPUs) in energy efficiency by a large margin, but they deliver much lower chip-scale throughput. The performance-efficiency dilemma for silicon processors may not be overcome by Moore's law scaling of complementary metal-oxide-semiconductor (CMOS) field-effect transistors. Scalable and biomimetic active memristor neurons and passive memristor synapses form a self-sufficient basis for a transistorless neural network. However, previous demonstrations of memristor neurons only showed simple integrate-and-fire (I&F) behaviors and did not reveal the rich dynamics and computational complexity of biological neurons. Here we show that neurons built with nanoscale vanadium dioxide active memristors possess all three classes of excitability and most of the known biological neuronal dynamics, and are intrinsically stochastic. With the favorable size and power scaling, there is a path toward an all-memristor neuromorphic cortical computer. △ Less

Submitted 20 September, 2018; originally announced September 2018.

Comments: 79 pages, 46 figures, 4 tables

Journal ref: Nat. Commun. 9 (2018) 4661

Diversity, Topology, and the Risk of Node Re-identification in Labeled Social Graphs

Authors: Sameera Horawalavithana, Clayton Gandy, Juan Arroyo Flores, John Skvoretz, Adriana Iamnitchi

Abstract: Real network datasets provide significant benefits for understanding phenomena such as information diffusion or network evolution. Yet the privacy risks raised from sharing real graph datasets, even when stripped of user identity information, are significant. When nodes have associated attributes, the privacy risks increase. In this paper we quantitatively study the impact of binary node attribute… ▽ More Real network datasets provide significant benefits for understanding phenomena such as information diffusion or network evolution. Yet the privacy risks raised from sharing real graph datasets, even when stripped of user identity information, are significant. When nodes have associated attributes, the privacy risks increase. In this paper we quantitatively study the impact of binary node attributes on node privacy by employing machine-learning-based re-identification attacks and exploring the interplay between graph topology and attribute placement. Our experiments show that the population's diversity on the binary attribute consistently degrades anonymity. △ Less

Submitted 31 August, 2018; originally announced August 2018.

Journal ref: Applied Network Science 2019

Study of Set-Membership Adaptive Kernel Algorithms

Authors: A. Flores, R. C. de Lamare

Abstract: In the last decade, a considerable research effort has been devoted to developing adaptive algorithms based on kernel functions. One of the main features of these algorithms is that they form a family of universal approximation techniques, solving problems with nonlinearities elegantly. In this paper, we present data-selective adaptive kernel normalized least-mean square (KNLMS) algorithms that ca… ▽ More In the last decade, a considerable research effort has been devoted to developing adaptive algorithms based on kernel functions. One of the main features of these algorithms is that they form a family of universal approximation techniques, solving problems with nonlinearities elegantly. In this paper, we present data-selective adaptive kernel normalized least-mean square (KNLMS) algorithms that can increase their learning rate and reduce their computational complexity. In fact, these methods deal with kernel expansions, creating a growing structure also known as the dictionary, whose size depends on the number of observations and their innovation. The algorithms described herein use an adaptive step-size to accelerate the learning and can offer an excellent tradeoff between convergence speed and steady state, which allows them to solve nonlinear filtering and estimation problems with a large number of parameters without requiring a large computational cost. The data-selective update scheme also limits the number of operations performed and the size of the dictionary created by the kernel expansion, saving computational resources and dealing with one of the major problems of kernel adaptive algorithms. A statistical analysis is carried out along with a computational complexity analysis of the proposed algorithms. Simulations show that the proposed KNLMS algorithms outperform existing algorithms in examples of nonlinear system identification and prediction of a time series originating from a nonlinear difference equation. △ Less

Submitted 15 August, 2018; originally announced August 2018.

Comments: 34 pages, 10 figures

Similarity forces and recurrent components in human face-to-face interaction networks

Authors: Marco Antonio Rodríguez Flores, Fragkiskos Papadopoulos

Abstract: We show that the social dynamics responsible for the formation of connected components that appear recurrently in face-to-face interaction networks, find a natural explanation in the assumption that the agents of the temporal network reside in a hidden similarity space. Distances between the agents in this space act as similarity forces directing their motion towards other agents in the physical s… ▽ More We show that the social dynamics responsible for the formation of connected components that appear recurrently in face-to-face interaction networks, find a natural explanation in the assumption that the agents of the temporal network reside in a hidden similarity space. Distances between the agents in this space act as similarity forces directing their motion towards other agents in the physical space and determining the duration of their interactions. By contrast, if such forces are ignored in the motion of the agents recurrent components do not form, although other main properties of such networks can still be reproduced. △ Less

Submitted 19 December, 2018; v1 submitted 2 August, 2018; originally announced August 2018.

Journal ref: Phys. Rev. Lett. 121, 258301 (2018)

Tomlinson-Harashima Precoded Rate-Splitting for Multiuser MIMO Systems

Authors: A. Flores, B. Clerckx, R. C. de Lamare

Abstract: In this work, we investigate the performance of Rate-Splitting (RS) based on Tomlinson-Harashima Precoding (THP) in a multiple-antenna broadcast channel with perfect and imperfect Channel State Information at the Transmitter (CSIT). In particular, we consider RS using centralized and decentralized THP structures, where only one user splits its message into a common and private part, and develop ex… ▽ More In this work, we investigate the performance of Rate-Splitting (RS) based on Tomlinson-Harashima Precoding (THP) in a multiple-antenna broadcast channel with perfect and imperfect Channel State Information at the Transmitter (CSIT). In particular, we consider RS using centralized and decentralized THP structures, where only one user splits its message into a common and private part, and develop expressions to describe the signal-to-interference-plus-noise (SINR) ratio and the sum rates associated with these schemes. Furthermore, we also assess the performance achieved by RS combined with Dirty-Paper Coding (DPC). Simulations show that RS with THP outperforms existing standard THP and RS with linear precoding schemes. △ Less

Submitted 18 July, 2018; originally announced July 2018.

Comments: 4 figures, 6 pages

Study of Set-Membership Kernel Adaptive Algorithms and Applications

Authors: R. C. de Lamare, André Flores

Abstract: Adaptive algorithms based on kernel structures have been a topic of significant research over the past few years. The main advantage is that they form a family of universal approximators, offering an elegant solution to problems with nonlinearities. Nevertheless these methods deal with kernel expansions, creating a growing structure also known as dictionary, whose size depends on the number of new… ▽ More Adaptive algorithms based on kernel structures have been a topic of significant research over the past few years. The main advantage is that they form a family of universal approximators, offering an elegant solution to problems with nonlinearities. Nevertheless these methods deal with kernel expansions, creating a growing structure also known as dictionary, whose size depends on the number of new inputs. In this paper we derive the set-membership kernel-based normalized least-mean square (SM-NKLMS) algorithm, which is capable of limiting the size of the dictionary created in stationary environments. We also derive as an extension the set-membership kernelized affine projection (SM-KAP) algorithm. Finally several experiments are presented to compare the proposed SM-NKLMS and SM-KAP algorithms to the existing methods. △ Less

Submitted 27 August, 2017; originally announced August 2017.

Comments: 4 figures, 6 pages

Study of Sparsity-Aware Set-Membership Adaptive Algorithms with Adjustable Penalties

Authors: André Flores, Rodrigo C. de Lamare

Abstract: In this paper, we propose sparsity-aware data-selective adaptive filtering algorithms with adjustable penalties. Prior work incorporates a penalty function into the cost function used in the optimization that originates the algorithms to improve their performance by exploiting sparsity. However, the strength of the penalty function is controlled by a scalar that is often a fixed parameter. In cont… ▽ More In this paper, we propose sparsity-aware data-selective adaptive filtering algorithms with adjustable penalties. Prior work incorporates a penalty function into the cost function used in the optimization that originates the algorithms to improve their performance by exploiting sparsity. However, the strength of the penalty function is controlled by a scalar that is often a fixed parameter. In contrast to prior work, we develop a framework to derive algorithms that automatically adjust the penalty function parameter and the step size to achieve a better performance. Simulations for a system identification application show that the proposed algorithms outperform in convergence speed existing sparsity-aware algorithms. △ Less

Submitted 4 August, 2017; originally announced August 2017.

Comments: 4 figures, 2 tables

Assortment Optimization under the Sequential Multinomial Logit Model

Authors: Alvaro Flores, Gerardo Berbeglia, Pascal van Hentenryck

Abstract: We study the assortment optimization problem under the Sequential Multinomial Logit (SML), a discrete choice model that generalizes the multinomial logit (MNL). Under the SML model, products are partitioned into two levels, to capture differences in attractiveness, brand awareness and, or visibility of the products in the market. When a consumer is presented with an assortment of products, she fir… ▽ More We study the assortment optimization problem under the Sequential Multinomial Logit (SML), a discrete choice model that generalizes the multinomial logit (MNL). Under the SML model, products are partitioned into two levels, to capture differences in attractiveness, brand awareness and, or visibility of the products in the market. When a consumer is presented with an assortment of products, she first considers products in the first level and, if none of them is purchased, products in the second level are considered. This model is a special case of the Perception-Adjusted Luce Model (PALM) recently proposed by Echenique et al (2018). It can explain many behavioural phenomena such as the attraction, compromise, similarity effects and choice overload which cannot be explained by the MNL model or any discrete choice model based on random utility. In particular, the SML model allows violations to regularity which states that the probability of choosing a product cannot increase if the offer set is enlarged. This paper shows that the seminal concept of revenue-ordered assortment sets, which contain an optimal assortment under the MNL model, can be generalized to the SML model. More precisely, the paper proves that all optimal assortments under the SML are revenue-ordered by level, a natural generalization of revenue-ordered assortments that contains, at most, a quadratic number of assortments. As a corollary, assortment optimization under the SML is polynomial-time solvable. This result is particularly interesting given that the SML model does not satisfy the regularity condition and, therefore, it can explain choice behaviours that cannot be explained by any choice model based on random utility. △ Less

Submitted 29 August, 2018; v1 submitted 9 July, 2017; originally announced July 2017.

Assortment and Price Optimization Under the Two-Stage Luce model

Authors: Alvaro Flores, Gerardo Berbeglia, Pascal Van Hentenryck

Abstract: This paper studies assortment and pricing optimization problems under the Two-Stage Luce model (2SLM), a discrete choice model introduced by Echenique and Saito (2018) that generalizes the multinomial logit model (MNL). The model employs an utility function as in the the MNL, and a dominance relation between products. When consumers are offered an assortmentS , they first discard all dominated pro… ▽ More This paper studies assortment and pricing optimization problems under the Two-Stage Luce model (2SLM), a discrete choice model introduced by Echenique and Saito (2018) that generalizes the multinomial logit model (MNL). The model employs an utility function as in the the MNL, and a dominance relation between products. When consumers are offered an assortmentS , they first discard all dominated products in S and then select one of the remaining products using the standard MNL. This model may violate the regularity condition, which states that the probability of choosing a product cannot increase if the offer set is enlarged. Therefore, the 2SLM falls outside the large family of discrete choice models based on random utility which contains almost all choice models studied in revenue management. We prove that the assortment problem under the 2SLM is polynomial-time solvable. Moreover, we show that the capacitated assortment optimization problem is NP-hard and but it admits polynomial-time algorithms for the relevant special cases cases where (1) the dominance relation is attractiveness-correlated and (2) its transitive reduction is a forest. The proofs exploit a strong connection between assortments under the 2SLM and independent sets in comparability graphs. Finally, we study the associated joint pricing and assortment problem under this model. First, we show that well known optimal pricing policy for the MNL can be arbitrarily bad. Our main result in this section is the development of an efficient algorithm for this pricing problem. The resulting optimal pricing strategy is simple to describe: it assigns the same price for all products, except for the one with the highest attractiveness and as well as for the one with the lowest attractiveness. △ Less

Submitted 23 April, 2019; v1 submitted 26 June, 2017; originally announced June 2017.

Comments: Corrected the abstract. Submitted to 2019 INFORMS Revenue Management and Pricing Conference

Trial-Offer Markets with Continuation

Authors: Pascal Van Hentenryck, Alvaro Flores, Gerardo Berbeglia

Abstract: Trial-offer markets, where customers can sample a product before deciding whether to buy it, are ubiquitous in the online experience. Their static and dynamic properties are often studied by assuming that consumers follow a multinomial logit model and try exactly one product. In this paper, we study how to generalize existing results to a more realistic setting where consumers can try multiple pro… ▽ More Trial-offer markets, where customers can sample a product before deciding whether to buy it, are ubiquitous in the online experience. Their static and dynamic properties are often studied by assuming that consumers follow a multinomial logit model and try exactly one product. In this paper, we study how to generalize existing results to a more realistic setting where consumers can try multiple products. We show that a multinomial logit model with continuation can be reduced to a standard multinomial logit model with different appeal and product qualities. We examine the consequences of this reduction on the performance and predictability of the market, the role of social influence, and the ranking policies. △ Less

Submitted 4 October, 2016; originally announced October 2016.

Comments: arXiv admin note: text overlap with arXiv:1505.02469