-
How to Measure Human-AI Prediction Accuracy in Explainable AI Systems
Authors:
Sujay Koujalgi,
Andrew Anderson,
Iyadunni Adenuga,
Shikha Soneji,
Rupika Dikkala,
Teresita Guzman Nader,
Leo Soccio,
Sourav Panda,
Rupak Kumar Das,
Margaret Burnett,
Jonathan Dodge
Abstract:
Assessing an AI system's behavior-particularly in Explainable AI Systems-is sometimes done empirically, by measuring people's abilities to predict the agent's next move-but how to perform such measurements? In empirical studies with humans, an obvious approach is to frame the task as binary (i.e., prediction is either right or wrong), but this does not scale. As output spaces increase, so do floor…
▽ More
Assessing an AI system's behavior-particularly in Explainable AI Systems-is sometimes done empirically, by measuring people's abilities to predict the agent's next move-but how to perform such measurements? In empirical studies with humans, an obvious approach is to frame the task as binary (i.e., prediction is either right or wrong), but this does not scale. As output spaces increase, so do floor effects, because the ratio of right answers to wrong answers quickly becomes very small. The crux of the problem is that the binary framing is failing to capture the nuances of the different degrees of "wrongness." To address this, we begin by proposing three mathematical bases upon which to measure "partial wrongness." We then uses these bases to perform two analyses on sequential decision-making domains: the first is an in-lab study with 86 participants on a size-36 action space; the second is a re-analysis of a prior study on a size-4 action space. Other researchers adopting our operationalization of the prediction task and analysis methodology will improve the rigor of user studies conducted with that task, which is particularly important when the domain features a large output space.
△ Less
Submitted 23 August, 2024;
originally announced September 2024.
-
Automated Bioacoustic Monitoring for South African Bird Species on Unlabeled Data
Authors:
Michael Doell,
Dominik Kuehn,
Vanessa Suessle,
Matthew J. Burnett,
Colleen T. Downs,
Andreas Weinmann,
Elke Hergenroether
Abstract:
Analyses for biodiversity monitoring based on passive acoustic monitoring (PAM) recordings is time-consuming and challenged by the presence of background noise in recordings. Existing models for sound event detection (SED) worked only on certain avian species and the development of further models required labeled data. The developed framework automatically extracted labeled data from available pla…
▽ More
Analyses for biodiversity monitoring based on passive acoustic monitoring (PAM) recordings is time-consuming and challenged by the presence of background noise in recordings. Existing models for sound event detection (SED) worked only on certain avian species and the development of further models required labeled data. The developed framework automatically extracted labeled data from available platforms for selected avian species. The labeled data were embedded into recordings, including environmental sounds and noise, and were used to train convolutional recurrent neural network (CRNN) models. The models were evaluated on unprocessed real world data recorded in urban KwaZulu-Natal habitats. The Adapted SED-CRNN model reached a F1 score of 0.73, demonstrating its efficiency under noisy, real-world conditions. The proposed approach to automatically extract labeled data for chosen avian species enables an easy adaption of PAM to other species and habitats for future conservation projects.
△ Less
Submitted 19 June, 2024;
originally announced June 2024.
-
Improving User Mental Models of XAI Systems with Inclusive Design Approaches
Authors:
Md Montaser Hamid,
Fatima Moussaoui,
Jimena Noa Guevara,
Andrew Anderson,
Margaret Burnett
Abstract:
Explainable Artificial Intelligence (XAI) systems aim to improve users' understanding of AI but rarely consider the inclusivity aspects of XAI. Without inclusive approaches, improving explanations might not work well for everyone. This study investigates leveraging users' diverse problem-solving styles as an inclusive strategy to fix an XAI prototype, with the ultimate goal of improving users' men…
▽ More
Explainable Artificial Intelligence (XAI) systems aim to improve users' understanding of AI but rarely consider the inclusivity aspects of XAI. Without inclusive approaches, improving explanations might not work well for everyone. This study investigates leveraging users' diverse problem-solving styles as an inclusive strategy to fix an XAI prototype, with the ultimate goal of improving users' mental models of AI. We ran a between-subject study with 69 participants. Our results show that the inclusivity fixes increased participants' engagement with explanations and produced significantly improved mental models. Analyzing differences in mental model scores further highlighted specific inclusivity fixes that contributed to the significant improvement in the mental model.
△ Less
Submitted 19 April, 2024;
originally announced April 2024.
-
SocioEconomicMag Meets a Platform for SES-Diverse College Students: A Case Study
Authors:
Puja Agarwal,
Divya Prem,
Christopher Bogart,
Abrar Fallatah,
Aileen Abril Castro-Guzman,
Pannapat Chanpaisaeng,
Stella Doehring,
Margaret Burnett,
Anita Sarma
Abstract:
Emerging research shows that individual differences in how people use technology sometimes cluster by socioeconomic status (SES) and that when technology is not socioeconomically inclusive, low-SES individuals may abandon it. To understand how to improve technology's SES-inclusivity, we present a multi-phase case study on SocioEconomicMag (SESMag), an emerging inspection method for socio+economic…
▽ More
Emerging research shows that individual differences in how people use technology sometimes cluster by socioeconomic status (SES) and that when technology is not socioeconomically inclusive, low-SES individuals may abandon it. To understand how to improve technology's SES-inclusivity, we present a multi-phase case study on SocioEconomicMag (SESMag), an emerging inspection method for socio+economic inclusivity. In our 16-month case study, a software team developing a learning management platform used SESMag to evaluate and then to improve their platform's SES-inclusivity. The results showed that (1) the practitioners identified SES-inclusivity bugs in 76% of the features they evaluated; (2) these inclusivity bugs actually arise among low-SES college students; and (3) the SESMag process pointed ways towards fixing these bugs. Finally, (4) a user study with SES-diverse college students showed that the platform's SES-inclusivity eradicated 45-54% of the bugs; for some types of bugs, the bug instance eradication rate was 80% or higher.
△ Less
Submitted 10 April, 2023;
originally announced April 2023.
-
Educating Educators to Integrate Inclusive Design Across a 4-Year CS Degree Program
Authors:
Lara Letaw,
Rosalinda Garcia,
Patricia Morreale,
Gail Verdi,
Heather Garcia,
Geraldine Jimena Noa,
Spencer P. Madsen,
Maria Jesus Alzugaray-Orellana,
Margaret Burnett
Abstract:
How can an entire CS faculty, who together have been teaching the ACM standard CS curricula, shift to teaching elements of inclusive design across a 4-year undergraduate CS program? And will they even want to try? To investigate these questions, we developed an educate-the-educators curriculum to support this shift. The overall goal of the educate-the-educators curriculum was to enable CS faculty…
▽ More
How can an entire CS faculty, who together have been teaching the ACM standard CS curricula, shift to teaching elements of inclusive design across a 4-year undergraduate CS program? And will they even want to try? To investigate these questions, we developed an educate-the-educators curriculum to support this shift. The overall goal of the educate-the-educators curriculum was to enable CS faculty to creatively engage with embedding inclusive design into their courses in "minimally invasive" ways. GenderMag, an inclusive design evaluation method, was selected for use. The curriculum targeted the following learning outcomes: to enable CS faculty: (1) to analyze the costs and benefits of integrating inclusive design into their own course(s); (2) to evaluate software using the GenderMag method, and recognize its use to identify meaningful issues in software; (3) to integrate inclusive design into existing course materials with provided resources and collaboration; and (4) to prepare to engage and guide students on learning GenderMag concepts. We conducted a field study over a spring/summer followed by end-of-fall interviews, during which we worked with 18 faculty members to integrate inclusive design into 13 courses. Ten of these faculty then taught 7 of these courses that were on the Fall 2021 schedule, across 16 sections. We present the new educate-the-educators curriculum and report on the faculty's experiences acting upon it over the three-month field study and subsequent interviews. Our results showed that, of the 18 faculty we worked with, 83% chose to modify their courses; by Fall 2021, faculty across all four years of a CS degree program had begun teaching inclusive design concepts. When we followed up with the 10 Fall 2021 faculty, 91% of their reported outcomes indicated that the incorporations of inclusive design concepts in their courses went as well as or better than expected.
△ Less
Submitted 6 September, 2022;
originally announced September 2022.
-
How to Debug Inclusivity Bugs? A Debugging Process with Information Architecture
Authors:
Mariam Guizani,
Igor Steinmacher,
Jillian Emard,
Abrar Fallatah,
Margaret Burnett,
Anita Sarma
Abstract:
Although some previous research has found ways to find inclusivity bugs (biases in software that introduce inequities), little attention has been paid to how to go about fixing such bugs. Without a process to move from finding to fixing, acting upon such findings is an ad-hoc activity, at the mercy of the skills of each individual developer. To address this gap, we created Why/Where/Fix, a systema…
▽ More
Although some previous research has found ways to find inclusivity bugs (biases in software that introduce inequities), little attention has been paid to how to go about fixing such bugs. Without a process to move from finding to fixing, acting upon such findings is an ad-hoc activity, at the mercy of the skills of each individual developer. To address this gap, we created Why/Where/Fix, a systematic inclusivity debugging process whose inclusivity fault localization harnesses Information Architecture(IA) -- the way user-facing information is organized, structured and labeled. We then conducted a multi-stage qualitative empirical evaluation of the effectiveness of Why/Where/Fix, using an Open Source Software (OSS) project's infrastructure as our setting. In our study, the OSS project team used the Why/Where/Fix process to find inclusivity bugs, localize the IA faults behind them, and then fix the IA to remove the inclusivity bugs they had found. Our results showed that using Why/Where/Fix reduced the number of inclusivity bugs that OSS newcomer participants experienced by 90%.
△ Less
Submitted 27 February, 2022;
originally announced February 2022.
-
Intersectionality Goes Analytical: Taming Combinatorial Explosion Through Type Abstraction
Authors:
Margaret Burnett,
Martin Erwig,
Abrar Fallatah,
Christopher Bogart,
Anita Sarma
Abstract:
HCI researchers' and practitioners' awareness of intersectionality has been expanding, producing knowledge, recommendations, and prototypes for supporting intersectional populations. However, doing intersectional HCI work is uniquely expensive: it leads to a combinatorial explosion of empirical work (expense 1), and little of the work on one intersectional population can be leveraged to serve anot…
▽ More
HCI researchers' and practitioners' awareness of intersectionality has been expanding, producing knowledge, recommendations, and prototypes for supporting intersectional populations. However, doing intersectional HCI work is uniquely expensive: it leads to a combinatorial explosion of empirical work (expense 1), and little of the work on one intersectional population can be leveraged to serve another (expense 2). In this paper, we explain how representations employed by certain analytical design methods correspond to type abstractions, and use that correspondence to identify a (de)compositional model in which a population's diverse identity properties can be joined and split. We formally prove the model's correctness, and show how it enables HCI designers to harness existing analytical HCI methods for use on new intersectional populations of interest. We illustrate through four design use-cases, how the model can reduce the amount of expense 1 and enable designers to leverage prior work to new intersectional populations, addressing expense 2.
△ Less
Submitted 25 January, 2022;
originally announced January 2022.
-
Toward a Socioeconomic-Aware HCI: Five Facets
Authors:
Catherine Hu,
Christopher Perdriau,
Christopher Mendez,
Caroline Gao,
Abrar Fallatah,
Margaret Burnett
Abstract:
Although inequities and biases relating to people in low socioeconomic situations are starting to capture widespread attention in the popular press, little attention has been given to how such inequities and biases might pervade technology user experiences. Without understanding such inequities in user experiences, technology designers can unwittingly introduce inequities tied to users' socioecono…
▽ More
Although inequities and biases relating to people in low socioeconomic situations are starting to capture widespread attention in the popular press, little attention has been given to how such inequities and biases might pervade technology user experiences. Without understanding such inequities in user experiences, technology designers can unwittingly introduce inequities tied to users' socioeconomic status (SES). To enable the HCI community to address this problem, in this paper, we consider a wide body of research that contributes to how a user's socioeconomic status potentially shapes their interactions and user experiences. We organize that research into 20 aspects of socioeconomic status; then derive a core set of five SES "facets" (attribute types and value ranges) with differing impacts on user experiences for different SES strata; and finally, present actionable paths forward for HCI researchers and practitioners to draw upon these facets, to bring socioeconomic awareness to HCI.
△ Less
Submitted 30 August, 2021;
originally announced August 2021.
-
Measuring User Experience Inclusivity in Human-AI Interaction via Five User Problem-Solving Styles
Authors:
Andrew Anderson,
Jimena Noa Guevara,
Fatima Moussaoui,
Tianyi Li,
Mihaela Vorvoreanu,
Margaret Burnett
Abstract:
Motivations: Recent research has emerged on generally how to improve AI product user experiences, but relatively little is known about an AI product's inclusivity. For example, what kinds of users does it support well, and who does it leave out? And what changes in the product would make it more inclusive?
Objectives: Our overall objective is to help fill this gap, investigating what kinds of di…
▽ More
Motivations: Recent research has emerged on generally how to improve AI product user experiences, but relatively little is known about an AI product's inclusivity. For example, what kinds of users does it support well, and who does it leave out? And what changes in the product would make it more inclusive?
Objectives: Our overall objective is to help fill this gap, investigating what kinds of diverse users an AI product leaves out, and how to act upon that knowledge. To bring actionability to our findings, we focus on users' diversity of problem-solving attributes. Thus, our specific objectives were: (1) to reveal whether participants with diverse problem-solving styles were left behind in a set of AI products; and (2) to relate participants' problem-solving diversity to their demographic diversity, specifically, gender and age.
Methods: We performed 18 experiments, discarding two that failed manipulation checks. Each experiment was a 2x2 factorial experiment with online participants. Each experiment compared two AI products: one deliberately violating an HAI guideline and the other applying the guideline. For our first objective, we analyzed how much each AI product gained/lost inclusivity compared to its counterpart, where inclusivity was supportiveness to participants with particular problem-solving styles. For our second objective, we analyzed how participants' problem-solving styles aligned with their demographics, namely their genders and ages.
Results & Implications: Participants' diverse problem-solving styles revealed six types of inclusivity results: (1) the AI products that followed an HAI guideline were almost always more inclusive across diversity of problem-solving styles than the products that did not follow that guideline-but the "who" that got most of the inclusivity varied widely by guideline and by problem-solving style...
△ Less
Submitted 16 February, 2024; v1 submitted 1 August, 2021;
originally announced August 2021.
-
A novel approach for modelling and classifying sit-to-stand kinematics using inertial sensors
Authors:
Maitreyee Wairagkar,
Emma Villeneuve,
Rachel King,
Balazs Janko,
Malcolm Burnett,
Ann Ashburn,
Veena Agarwal,
R. Simon Sherratt,
William Holderbaum,
William Harwin
Abstract:
Sit-to-stand transitions are an important part of activities of daily living and play a key role in functional mobility in humans. The sit-to-stand movement is often affected in older adults due to frailty and in patients with motor impairments such as Parkinson's disease leading to falls. Studying kinematics of sit-to-stand transitions can provide insight in assessment, monitoring and developing…
▽ More
Sit-to-stand transitions are an important part of activities of daily living and play a key role in functional mobility in humans. The sit-to-stand movement is often affected in older adults due to frailty and in patients with motor impairments such as Parkinson's disease leading to falls. Studying kinematics of sit-to-stand transitions can provide insight in assessment, monitoring and developing rehabilitation strategies for the affected populations. We propose a three-segment body model for estimating sit-to-stand kinematics using only two wearable inertial sensors, placed on the shank and back. Reducing the number of sensors to two instead of one per body segment facilitates monitoring and classifying movements over extended periods, making it more comfortable to wear while reducing the power requirements of sensors. We applied this model on 10 younger healthy adults (YH), 12 older healthy adults (OH) and 12 people with Parkinson's disease (PwP). We have achieved this by incorporating unique sit-to-stand classification technique using unsupervised learning in the model based reconstruction of angular kinematics using extended Kalman filter. Our proposed model showed that it was possible to successfully estimate thigh kinematics despite not measuring the thigh motion with inertial sensor. We classified sit-to-stand transitions, sitting and standing states with the accuracies of 98.67%, 94.20% and 91.41% for YH, OH and PwP respectively. We have proposed a novel integrated approach of modelling and classification for estimating the body kinematics during sit-to-stand motion and successfully applied it on YH, OH and PwP groups.
△ Less
Submitted 14 July, 2021;
originally announced July 2021.
-
Commissioning the HI Observing Mode of the Beamformer for the Cryogenically Cooled Focal L-band Array for the GBT (FLAG)
Authors:
N. M. Pingel,
D. J. Pisano,
M. Ruzindana,
M. Burnett,
K. M. Rajwade,
R. Black,
B. Jeffs,
D. R. Lorimer,
D. Anish Roshi,
R. Prestage,
M. A. McLaughlin,
D. Agarwal,
T. Chamberlin,
L. Hawkins,
L. Jensen,
P. Marganian,
J. D. Nelson,
W. Shillue,
E. Smith,
B. Simon,
V. Van Tonder,
S. White
Abstract:
We present the results of commissioning observations for a new digital beamforming back end for the Focal plane L-band Array for the Robert C. Byrd Green Bank Telescope (FLAG), a cryogenically cooled Phased Array Feed (PAF) with the lowest measured T_sys/eta of any PAF outfitted on a radio telescope to date. We describe the custom software used to apply beamforming weights to the raw element covar…
▽ More
We present the results of commissioning observations for a new digital beamforming back end for the Focal plane L-band Array for the Robert C. Byrd Green Bank Telescope (FLAG), a cryogenically cooled Phased Array Feed (PAF) with the lowest measured T_sys/eta of any PAF outfitted on a radio telescope to date. We describe the custom software used to apply beamforming weights to the raw element covariances to create research quality spectral line images for the new fine-channel mode, study the stability of the beam weights over time, characterize FLAG's sensitivity over a frequency range of 150 MHz, and compare the measured noise properties and observed distribution of neutral hydrogen emission from several extragalactic and Galactic sources with data obtained with the current single-pixel L-band receiver. These commissioning runs establish FLAG as the preeminent PAF receiver currently available for spectral line observations on the world's major radio telescopes.
△ Less
Submitted 25 January, 2021;
originally announced January 2021.
-
Engineering Gender-Inclusivity into Software: Tales from the Trenches
Authors:
Claudia Hilderbrand,
Christopher Perdriau,
Lara Letaw,
Jillian Emard,
Zoe Steine-Hanson,
Margaret Burnett,
Anita Sarma
Abstract:
Although the need for gender-inclusivity in software itself is gaining attention among both SE researchers and SE practitioners, and methods have been published to help, little has been reported on how to make such methods work in real-world settings. For example, how do busy software practitioners use such methods in low-cost ways? How do they endeavor to maximize benefits from using them? How do…
▽ More
Although the need for gender-inclusivity in software itself is gaining attention among both SE researchers and SE practitioners, and methods have been published to help, little has been reported on how to make such methods work in real-world settings. For example, how do busy software practitioners use such methods in low-cost ways? How do they endeavor to maximize benefits from using them? How do they avoid the controversies that can arise in talking about gender? To find out how teams were handling these and similar questions, we turned to 10 real-world software teams. We present these teams experiences "in the trenches," in the form of 12 practices and 3 potential pitfalls, so as to provide their insights to other real-world software teams trying to engineer gender-inclusivity into their software products.
△ Less
Submitted 27 May, 2019;
originally announced May 2019.
-
Fixing Inclusivity Bugs for Information Processing Styles and Learning Styles
Authors:
Zoe Steine-Hanson,
Claudia Hilderbrand,
Lara Letaw,
Jillian Emard,
Christopher Perdriau,
Christopher Mendez,
Margaret Burnett,
Anita Sarma
Abstract:
Most software systems today do not support cognitive diversity. Further, because of differences in problem-solving styles that cluster by gender, software that poorly supports cognitive diversity can also embed gender biases. To help software professionals fix gender bias "bugs" related to people's problem-solving styles for information processing and learning of new software we collected inclusiv…
▽ More
Most software systems today do not support cognitive diversity. Further, because of differences in problem-solving styles that cluster by gender, software that poorly supports cognitive diversity can also embed gender biases. To help software professionals fix gender bias "bugs" related to people's problem-solving styles for information processing and learning of new software we collected inclusivity fixes from three sources. The first two are empirical studies we conducted: a heuristics-driven user study and a field research industry study. The third is data that we obtained about a before/after user study of inclusivity bugs. The resulting seven potential inclusivity fixes show how to debug software to be more inclusive for diverse problem-solving styles.
△ Less
Submitted 7 May, 2019;
originally announced May 2019.
-
From GenderMag to InclusiveMag: An Inclusive Design Meta-Method
Authors:
Christopher Mendez,
Lara Letaw,
Margaret Burnett,
Simone Stumpf,
Anita Sarma,
Claudia Hilderbrand
Abstract:
How can software practitioners assess whether their software supports diverse users? Although there are empirical processes that can be used to find "inclusivity bugs" piecemeal, what is often needed is a systematic inspection method to assess soft-ware's support for diverse populations. To help fill this gap, this paper introduces InclusiveMag, a generalization of GenderMag that can be used to ge…
▽ More
How can software practitioners assess whether their software supports diverse users? Although there are empirical processes that can be used to find "inclusivity bugs" piecemeal, what is often needed is a systematic inspection method to assess soft-ware's support for diverse populations. To help fill this gap, this paper introduces InclusiveMag, a generalization of GenderMag that can be used to generate systematic inclusiveness methods for a particular dimension of diversity. We then present a multi-case study covering eight diversity dimensions, of eight teams' experiences applying InclusiveMag to eight under-served populations and their "mainstream" counterparts.
△ Less
Submitted 7 May, 2019;
originally announced May 2019.
-
Explaining Reinforcement Learning to Mere Mortals: An Empirical Study
Authors:
Andrew Anderson,
Jonathan Dodge,
Amrita Sadarangani,
Zoe Juozapaitis,
Evan Newman,
Jed Irvine,
Souti Chattopadhyay,
Alan Fern,
Margaret Burnett
Abstract:
We present a user study to investigate the impact of explanations on non-experts' understanding of reinforcement learning (RL) agents. We investigate both a common RL visualization, saliency maps (the focus of attention), and a more recent explanation type, reward-decomposition bars (predictions of future types of rewards). We designed a 124 participant, four-treatment experiment to compare partic…
▽ More
We present a user study to investigate the impact of explanations on non-experts' understanding of reinforcement learning (RL) agents. We investigate both a common RL visualization, saliency maps (the focus of attention), and a more recent explanation type, reward-decomposition bars (predictions of future types of rewards). We designed a 124 participant, four-treatment experiment to compare participants' mental models of an RL agent in a simple Real-Time Strategy (RTS) game. Our results show that the combination of both saliency and reward bars were needed to achieve a statistically significant improvement in mental model score over the control. In addition, our qualitative analysis of the data reveals a number of effects for further study.
△ Less
Submitted 18 June, 2019; v1 submitted 22 March, 2019;
originally announced March 2019.
-
Performance of a highly sensitive, 19-element, dual-polarization, cryogenic L-band Phased Array Feed on the Green Bank Telescope
Authors:
D. Anish Roshi,
W. Shillue,
B. Simon,
K. F. Warnick,
B. Jeffs,
D. J. Pisano,
R. Prestage,
S. White,
J. R. Fisher,
M. Morgan,
R. Black,
M. Burnett,
J. Diao,
M. Ruzindana,
V. van Tonder,
L. Hawkins,
P. Marganian,
T. Chamberlin,
J. Ray,
N. M. Pingel,
K. Rajwade,
D. R. Lorimer,
A. Rane,
J. Castro,
W. Groves
, et al. (4 additional authors not shown)
Abstract:
A new 1.4 GHz 19-element, dual-polarization, cryogenic phased array feed (PAF) radio astronomy receiver has been developed for the Robert C. Byrd Green Bank Telescope (GBT) as part of FLAG (Focal L-band Array for the GBT) project. Commissioning observations of calibrator radio sources show that this receiver has the lowest reported beamformed system temperature ($T_{\rm sys}$) normalized by apertu…
▽ More
A new 1.4 GHz 19-element, dual-polarization, cryogenic phased array feed (PAF) radio astronomy receiver has been developed for the Robert C. Byrd Green Bank Telescope (GBT) as part of FLAG (Focal L-band Array for the GBT) project. Commissioning observations of calibrator radio sources show that this receiver has the lowest reported beamformed system temperature ($T_{\rm sys}$) normalized by aperture efficiency ($η$) of any phased array receiver to date. The measured $T_{\rm sys}/η$ is $25.4 \pm 2.5$ K near 1350 MHz for the boresight beam, which is comparable to the performance of the current 1.4 GHz cryogenic single feed receiver on the GBT. The degradation in $T_{\rm sys}/η$ at $\sim$ 4 arcmin (required for Nyquist sampling) and $\sim$ 8 arcmin offsets from the boresight is, respectively, $\sim$ 1\% and $\sim$ 20\% of the boresight value. The survey speed of the PAF with seven formed beams is larger by a factor between 2.1 and 7 compared to a single beam system depending on the observing application. The measured performance, both in frequency and offset from boresight, qualitatively agree with predictions from a rigorous electromagnetic model of the PAF. The astronomical utility of the receiver is demonstrated by observations of the pulsar B0329+54 and an extended HII region, the Rosette Nebula. The enhanced survey speed with the new PAF receiver will enable the GBT to carry out exciting new science, such as more efficient observations of diffuse, extended neutral hydrogen emission from galactic in-flows and searches for Fast Radio Bursts.
△ Less
Submitted 12 March, 2018;
originally announced March 2018.
-
Toward Foraging for Understanding of StarCraft Agents: An Empirical Study
Authors:
Sean Penney,
Jonathan Dodge,
Claudia Hilderbrand,
Andrew Anderson,
Logan Simpson,
Margaret Burnett
Abstract:
Assessing and understanding intelligent agents is a difficult task for users that lack an AI background. A relatively new area, called "Explainable AI," is emerging to help address this problem, but little is known about how users would forage through information an explanation system might offer. To inform the development of Explainable AI systems, we conducted a formative study, using the lens o…
▽ More
Assessing and understanding intelligent agents is a difficult task for users that lack an AI background. A relatively new area, called "Explainable AI," is emerging to help address this problem, but little is known about how users would forage through information an explanation system might offer. To inform the development of Explainable AI systems, we conducted a formative study, using the lens of Information Foraging Theory, into how experienced users foraged in the domain of StarCraft to assess an agent. Our results showed that participants faced difficult foraging problems. These foraging problems caused participants to entirely miss events that were important to them, reluctantly choose to ignore actions they did not want to ignore, and bear high cognitive, navigation, and information costs to access the information they needed.
△ Less
Submitted 26 December, 2017; v1 submitted 21 November, 2017;
originally announced November 2017.
-
How the Experts Do It: Assessing and Explaining Agent Behaviors in Real-Time Strategy Games
Authors:
Jonathan Dodge,
Sean Penney,
Claudia Hilderbrand,
Andrew Anderson,
Margaret Burnett
Abstract:
How should an AI-based explanation system explain an agent's complex behavior to ordinary end users who have no background in AI? Answering this question is an active research area, for if an AI-based explanation system could effectively explain intelligent agents' behavior, it could enable the end users to understand, assess, and appropriately trust (or distrust) the agents attempting to help the…
▽ More
How should an AI-based explanation system explain an agent's complex behavior to ordinary end users who have no background in AI? Answering this question is an active research area, for if an AI-based explanation system could effectively explain intelligent agents' behavior, it could enable the end users to understand, assess, and appropriately trust (or distrust) the agents attempting to help them. To provide insights into this question, we turned to human expert explainers in the real-time strategy domain, "shoutcaster", to understand (1) how they foraged in an evolving strategy game in real time, (2) how they assessed the players' behaviors, and (3) how they constructed pertinent and timely explanations out of their insights and delivered them to their audience. The results provided insights into shoutcasters' foraging strategies for gleaning information necessary to assess and explain the players; a characterization of the types of implicit questions shoutcasters answered; and implications for creating explanations by using the patterns
△ Less
Submitted 18 November, 2017;
originally announced November 2017.
-
Commissioning of FLAG: A phased array feed for the GBT
Authors:
K. M. Rajwade,
N. M. Pingel,
R. A. Black,
M. Ruzindana,
M. Burnett,
B. Jeffs,
K. Warnick,
D. J. Pisano,
D. R. Lorimer,
R. M. Prestage,
L. Hawkins,
J. Ray,
P. Marganian,
T. Chamberlin,
J. Ford,
W. Shillue,
D. A. Roshi
Abstract:
Phased Array Feed (PAF) technology is the next major advancement in radio astronomy in terms of combining high sensitivity and large field of view. The Focal L-band Array for the Green Bank Telescope (FLAG) is one of the most sensitive PAFs developed so far. It consists of 19 dual-polarization elements mounted on a prime focus dewar resulting in seven beams on the sky. Its unprecedented system tem…
▽ More
Phased Array Feed (PAF) technology is the next major advancement in radio astronomy in terms of combining high sensitivity and large field of view. The Focal L-band Array for the Green Bank Telescope (FLAG) is one of the most sensitive PAFs developed so far. It consists of 19 dual-polarization elements mounted on a prime focus dewar resulting in seven beams on the sky. Its unprecedented system temperature of$\sim$17 K will lead to a 3 fold increase in pulsar survey speeds as compared to contemporary single pixel feeds. Early science observations were conducted in a recently concluded commissioning phase of the FLAG where we clearly demonstrated its science capabilities. We observed a selection of normal and millisecond pulsars and detected giant pulses from PSR B1937+21.
△ Less
Submitted 26 October, 2017;
originally announced October 2017.
-
Apex-angle-dependent resonances in triangular split ring resonators
Authors:
Max A. Burnett,
Michael A. Fiddy
Abstract:
Along with other frequency selective structures [1] (circles and squares), triangular split-ring resonators (TSRRs) only allow frequencies near the center resonant frequency to propagate. Further, TSRRs are attractive due to their small surface area [2], comparatively, and large quality factors (Q) factors as previously investigated by Gay-Balmaz, et al. [3]. In this work we examine the effects of…
▽ More
Along with other frequency selective structures [1] (circles and squares), triangular split-ring resonators (TSRRs) only allow frequencies near the center resonant frequency to propagate. Further, TSRRs are attractive due to their small surface area [2], comparatively, and large quality factors (Q) factors as previously investigated by Gay-Balmaz, et al. [3]. In this work we examine the effects of varying the apex angle on the resonant frequency, the Q factor, and the phase shift imparted by the TSRR element within the GHz frequency regime.
△ Less
Submitted 13 January, 2016;
originally announced January 2016.
-
Near-field optical imaging with a CdSe single nanocrystal-based active tip
Authors:
Y. Sonnefraud,
N. Chevalier,
J. -F. Motte,
S. Huant,
P. Reiss,
J. Bleuse,
F. Chandezon,
M. T. Burnett,
W. Ding,
S. A. Maier
Abstract:
We report near-field scanning optical imaging with an active tip made of a single fluorescent CdSe nanocrystal attached at the apex of an optical tip. Although the images are acquired only partially because of the random blinking of the semiconductor particle, our work validates the use of such tips in ultra-high spatial resolution optical microscopy.
We report near-field scanning optical imaging with an active tip made of a single fluorescent CdSe nanocrystal attached at the apex of an optical tip. Although the images are acquired only partially because of the random blinking of the semiconductor particle, our work validates the use of such tips in ultra-high spatial resolution optical microscopy.
△ Less
Submitted 28 January, 2012;
originally announced January 2012.
-
Distance determination for RAVE stars using stellar models
Authors:
M. A. Breddels,
M. C. Smith,
A. Helmi,
O. Bienayme,
J. Binney,
J. Bland-Hawthorn,
C. Boeche,
B. C. M. Burnett,
R. Campbell,
K. C. Freeman,
B. Gibson,
G. Gilmore,
E. K. Grebel,
U. Munari,
J. F. Navarro,
Q. A. Parker,
G. M. Seabroke,
A. Siebert,
A. Siviero,
M. Steinmetz,
F. G. Watson,
M. Williams,
R. F. G. Wyse,
T. Zwitter
Abstract:
(Abridged) Aims:We develop a method for deriving distances from spectroscopic data and obtaining full 6D phase-space coordinates for the RAVE survey's second data release. Methods: We used stellar models combined with atmospheric properties from RAVE (Teff, logg and [Fe/H]) and (J-Ks) photometry from archival sources to derive absolute magnitudes. We are able to derive the full 6D phase-space co…
▽ More
(Abridged) Aims:We develop a method for deriving distances from spectroscopic data and obtaining full 6D phase-space coordinates for the RAVE survey's second data release. Methods: We used stellar models combined with atmospheric properties from RAVE (Teff, logg and [Fe/H]) and (J-Ks) photometry from archival sources to derive absolute magnitudes. We are able to derive the full 6D phase-space coordinates for a large sample of RAVE stars. This method is tested with artificial data, Hipparcos trigonometric parallaxes and observations of the open cluster M67. Results: When we applied our method to a set of 16 146 stars, we found that 25% (4 037) of the stars have relative (statistical) distance errors of < 35%, while 50% (8 073) and 75% (12 110) have relative (statistical) errors smaller than 45% and 50%, respectively. Our various tests show that we can reliably estimate distances for main-sequence stars, but there is an indication of potential systematic problems with giant stars. For the main-sequence star sample (defined as those with log(g) > 4), 25% (1 744) have relative distance errors < 31%, while 50% (3 488) and 75% (5 231) have relative errors smaller than 36% and 42%, respectively. Our full dataset shows the expected decrease in the metallicity of stars as a function of distance from the Galactic plane. The known kinematic substructures in the U and V velocity components of nearby dwarf stars are apparent in our dataset, confirming the accuracy of our data and the reliability of our technique. We provide independent measurements of the orientation of the UV velocity ellipsoid and of the solar motion, and they are in very good agreement with previous work. Conclusions: The distance catalogue for the RAVE second data release is available at http://www.astro.rug.nl/~rave
△ Less
Submitted 3 March, 2010;
originally announced March 2010.
-
Activities, Context and Ubiquitous Computing
Authors:
Paul Prekop,
Mark Burnett
Abstract:
Context and context-awareness provides computing environments with the ability to usefully adapt the services or information they provide. It is the ability to implicitly sense and automatically derive the user needs that separates context-aware applications from traditionally designed applications, and this makes them more attentive, responsive, and aware of their user's identity, and their use…
▽ More
Context and context-awareness provides computing environments with the ability to usefully adapt the services or information they provide. It is the ability to implicitly sense and automatically derive the user needs that separates context-aware applications from traditionally designed applications, and this makes them more attentive, responsive, and aware of their user's identity, and their user's environment. This paper argues that context-aware applications capable of supporting complex, cognitive activities can be built from a model of context called Activity-Centric Context. A conceptual model of Activity-Centric context is presented. The model is illustrated via a detailed example.
△ Less
Submitted 19 September, 2002;
originally announced September 2002.
