Showing 1–14 of 14 results for author: Rosenberg, L

Towards Collective Superintelligence: Amplifying Group IQ using Conversational Swarms

Authors: Louis Rosenberg, Gregg Willcox, Hans Schumann, Ganesh Mani

Abstract: Swarm Intelligence (SI) is a natural phenomenon that enables biological groups to amplify their combined intellect by forming real-time systems. Artificial Swarm Intelligence (or Swarm AI) is a technology that enables networked human groups to amplify their combined intelligence by forming similar systems. In the past, swarm-based methods were constrained to narrowly defined tasks like probabilist… ▽ More Swarm Intelligence (SI) is a natural phenomenon that enables biological groups to amplify their combined intellect by forming real-time systems. Artificial Swarm Intelligence (or Swarm AI) is a technology that enables networked human groups to amplify their combined intelligence by forming similar systems. In the past, swarm-based methods were constrained to narrowly defined tasks like probabilistic forecasting and multiple-choice decision making. A new technology called Conversational Swarm Intelligence (CSI) was developed in 2023 that amplifies the decision-making accuracy of networked human groups through natural conversational deliberations. The current study evaluated the ability of real-time groups using a CSI platform to take a common IQ test known as Raven's Advanced Progressive Matrices (RAPM). First, a baseline group of participants took the Raven's IQ test by traditional survey. This group averaged 45.6% correct. Then, groups of approximately 35 individuals answered IQ test questions together using a CSI platform called Thinkscape. These groups averaged 80.5% correct. This places the CSI groups in the 97th percentile of IQ test-takers and corresponds to an effective IQ increase of 28 points (p<0.001). This is an encouraging result and suggests that CSI is a powerful method for enabling conversational collective intelligence in large, networked groups. In addition, because CSI is scalable across groups of potentially any size, this technology may provide a viable pathway to building a Collective Superintelligence. △ Less

Submitted 25 January, 2024; originally announced January 2024.

Conversational Swarm Intelligence amplifies the accuracy of networked groupwise deliberations

Authors: Louis Rosenberg, Gregg Willcox, Hans Schumann, Ganesh Mani

Abstract: Conversational Swarm Intelligence (CSI) is a communication technology that enables large, networked groups (25 to 2500 people) to hold real-time conversational deliberations online. Modeled on the dynamics of biological swarms, CSI enables the reasoning benefits of small-groups with the collective intelligence benefits of large-groups. In this pilot study, groups of 25 to 30 participants were aske… ▽ More Conversational Swarm Intelligence (CSI) is a communication technology that enables large, networked groups (25 to 2500 people) to hold real-time conversational deliberations online. Modeled on the dynamics of biological swarms, CSI enables the reasoning benefits of small-groups with the collective intelligence benefits of large-groups. In this pilot study, groups of 25 to 30 participants were asked to select players for a weekly Fantasy Football contest over an 11-week period. As a baseline, participants filled out a survey to record their player selections. As an experimental method, participants engaged in a real-time text-chat deliberation using a CSI platform called Thinkscape to collaboratively select sets of players. The results show that the real-time conversational group using CSI outperformed 66% of survey participants, demonstrating significant amplification of intelligence versus the median individual (p=0.020). The CSI method also significantly outperformed the most popular choices from the survey (the Wisdom of Crowd, p<0.001). These results suggest that CSI is an effective technology for amplifying the intelligence of groups engaged in real-time large-scale conversational deliberation and may offer a path to collective superintelligence. △ Less

Submitted 19 December, 2023; originally announced January 2024.

Comments: Paper accepted for publication in proceedings IEEE 14th Annual Computing and Communication Workshop and Conference (CCWC 2024)

Deep Motion Masking for Secure, Usable, and Scalable Real-Time Anonymization of Virtual Reality Motion Data

Authors: Vivek Nair, Wenbo Guo, James F. O'Brien, Louis Rosenberg, Dawn Song

Abstract: Virtual reality (VR) and "metaverse" systems have recently seen a resurgence in interest and investment as major technology companies continue to enter the space. However, recent studies have demonstrated that the motion tracking "telemetry" data used by nearly all VR applications is as uniquely identifiable as a fingerprint scan, raising significant privacy concerns surrounding metaverse technolo… ▽ More Virtual reality (VR) and "metaverse" systems have recently seen a resurgence in interest and investment as major technology companies continue to enter the space. However, recent studies have demonstrated that the motion tracking "telemetry" data used by nearly all VR applications is as uniquely identifiable as a fingerprint scan, raising significant privacy concerns surrounding metaverse technologies. Although previous attempts have been made to anonymize VR motion data, we present in this paper a state-of-the-art VR identification model that can convincingly bypass known defensive countermeasures. We then propose a new "deep motion masking" approach that scalably facilitates the real-time anonymization of VR telemetry data. Through a large-scale user study (N=182), we demonstrate that our method is significantly more usable and private than existing VR anonymity systems. △ Less

Submitted 8 November, 2023; originally announced November 2023.

Towards Collective Superintelligence, a Pilot Study

Authors: Louis Rosenberg, Gregg Willcox, Hans Schumann

Abstract: Conversational Swarm Intelligence (CSI) is a new technology that enables human groups of potentially any size to hold real-time deliberative conversations online. Modeled on the dynamics of biological swarms, CSI aims to optimize group insights and amplify group intelligence. It uses Large Language Models (LLMs) in a novel framework to structure large-scale conversations, combining the benefits of… ▽ More Conversational Swarm Intelligence (CSI) is a new technology that enables human groups of potentially any size to hold real-time deliberative conversations online. Modeled on the dynamics of biological swarms, CSI aims to optimize group insights and amplify group intelligence. It uses Large Language Models (LLMs) in a novel framework to structure large-scale conversations, combining the benefits of small-group deliberative reasoning and large-group collective intelligence. In this study, a group of 241 real-time participants were asked to estimate the number of gumballs in a jar by looking at a photo. In one test case, individual participants entered their estimation in a standard survey. In another test case, participants converged on groupwise estimates collaboratively using a prototype CSI text-chat platform called Thinkscape. The results show that when using CSI, the group of 241 participants estimated within 12% of the correct answer, which was significantly more accurate (p<0.001) than the average individual (mean error of 55%) and the survey-based Wisdom of Crowd (error of 25%). The group using CSI was also more accurate than an estimate generated by GPT 4 (error of 42%). This suggests that CSI is a viable method for enabling large, networked groups to hold coherent real-time deliberative conversations that amplify collective intelligence. Because this technology is scalable, it could provide a possible pathway towards building a general-purpose Collective Superintelligence (CSi). △ Less

Submitted 31 October, 2023; originally announced November 2023.

Conversational Swarm Intelligence (CSI) Enables Rapid Group Insights

Authors: Louis Rosenberg, Gregg Willcox, Hans Schumann

Abstract: When generating insights from human groups, conversational deliberation is a key method for exploring issues, surfacing ideas, debating options, and converging on solutions. Unfortunately, real-time conversations are difficult to scale, losing effectiveness in groups above 4 to 7 members. Conversational Swarm Intelligence (CSI) is a new technology that enables large human groups to hold real-time… ▽ More When generating insights from human groups, conversational deliberation is a key method for exploring issues, surfacing ideas, debating options, and converging on solutions. Unfortunately, real-time conversations are difficult to scale, losing effectiveness in groups above 4 to 7 members. Conversational Swarm Intelligence (CSI) is a new technology that enables large human groups to hold real-time conversations using techniques modeled on the dynamics of biological swarms. Through a novel use of Large Language Models (LLMs), CSI enables real-time dialog among small groups while simultaneously fostering content propagation across a much larger group. This combines the benefits of small-scale deliberative reasoning and large-scale groupwise intelligence. In this study, we engage a group of 81 American voters from one political party in real-time deliberation using a CSI platform called Thinkscape. We then task the group with (a) forecasting which candidate from a set of options will achieve the most national support, and (b) indicating the specific reasons for this result. After only six minutes of deliberation, the group of 81 individuals converged on a selected candidate and surfaced over 400 reasons justifying various candidates, including 206 justifications that supported the selected candidate. We find that the selected candidate was significantly more supported by group members than the other options (p<0.001) and that this effect held even after six minutes of deliberation, demonstrating that CSI provides both the qualitative benefits of conversational focus groups and the quantitative benefits of largescale polling. △ Less

Submitted 30 September, 2023; originally announced October 2023.

Comments: Copyright 2023 IEEE. arXiv admin note: substantial text overlap with arXiv:2309.12366

Berkeley Open Extended Reality Recordings 2023 (BOXRR-23): 4.7 Million Motion Capture Recordings from 105,852 Extended Reality Device Users

Authors: Vivek Nair, Wenbo Guo, Rui Wang, James F. O'Brien, Louis Rosenberg, Dawn Song

Abstract: Extended reality (XR) devices such as the Meta Quest and Apple Vision Pro have seen a recent surge in attention, with motion tracking "telemetry" data lying at the core of nearly all XR and metaverse experiences. Researchers are just beginning to understand the implications of this data for security, privacy, usability, and more, but currently lack large-scale human motion datasets to study. The B… ▽ More Extended reality (XR) devices such as the Meta Quest and Apple Vision Pro have seen a recent surge in attention, with motion tracking "telemetry" data lying at the core of nearly all XR and metaverse experiences. Researchers are just beginning to understand the implications of this data for security, privacy, usability, and more, but currently lack large-scale human motion datasets to study. The BOXRR-23 dataset contains 4,717,215 motion capture recordings, voluntarily submitted by 105,852 XR device users from over 50 countries. BOXRR-23 is over 200 times larger than the largest existing motion capture research dataset and uses a new, highly efficient purpose-built XR Open Recording (XROR) file format. △ Less

Submitted 30 September, 2023; originally announced October 2023.

Comments: Learn more at https://rdi.berkeley.edu/metaverse/boxrr-23

Journal ref: IEEE Transactions on Visualization and Computer Graphics, pages 1-8, March 2024. IEEE VR 2024, Orlando, FL March 16-21, 2024. Best Paper Honorable Mention

Conversational Swarm Intelligence (CSI) Enhances Groupwise Deliberation

Authors: Louis Rosenberg, Gregg Willcox, Hans Schumann, Ganesh Mani

Abstract: Real-time conversational deliberation is a critical groupwise method for reaching decisions, solving problems, evaluating priorities, generating ideas, and producing insights. Unfortunately, real-time conversations are difficult to scale, losing effectiveness as groups grow above 5 to 7 members. Conversational Swarm Intelligence (CSI) is a new technology modeled on the dynamics of biological swarm… ▽ More Real-time conversational deliberation is a critical groupwise method for reaching decisions, solving problems, evaluating priorities, generating ideas, and producing insights. Unfortunately, real-time conversations are difficult to scale, losing effectiveness as groups grow above 5 to 7 members. Conversational Swarm Intelligence (CSI) is a new technology modeled on the dynamics of biological swarms. It aims to enable networked groups of any size to hold productive real-time deliberations that converge on unified solutions. CSI leverages the power of Large Language Models (LLMs) in a unique and powerful way, allowing real-time dialog among small local groups while simultaneously enabling efficient content propagation across much larger populations. In this way, CSI combines the benefits of small-scale deliberative reasoning and large-scale collective intelligence. In this study, we compare deliberative groups of 48 people using standard online chat to the same sized groups using a prototype chat-based CSI system called Thinkscape. Results show that participants using CSI contributed 51% more content (p<0.001) than those using standard chat, and the deliberations using CSI showed 37% less difference in contribution quantity between the most active vs least active members, indicating more balanced dialog. And finally, a large majority of participants preferred deliberating using the CSI system over standard chat (p<0.05) and re-ported feeling more impactful when doing so (p<0.01). These results suggest that Conversational Swarm Intelligence is a promising technology for enabling large-scale deliberation. △ Less

Submitted 14 September, 2023; originally announced September 2023.

Comments: Accepted for publication: 7th International Joint Conference on Advances in Computational Intelligence (IJCACI 2023). Oct 14, 2023. New Delhi, India. arXiv admin note: text overlap with arXiv:2309.03220

ACM Class: H.5.1; I.2

Conversational Swarm Intelligence, a Pilot Study

Authors: Louis Rosenberg, Gregg Willcox, Hans Schumann, Miles Bader, Ganesh Mani, Kokoro Sagae, Devang Acharya, Yuxin Zheng, Andrew Kim, Jialing Deng

Abstract: Conversational Swarm Intelligence (CSI) is a new method for enabling large human groups to hold real-time networked conversations using a technique modeled on the dynamics of biological swarms. Through the novel use of conversational agents powered by Large Language Models (LLMs), the CSI structure simultaneously enables local dialog among small deliberative groups and global propagation of conver… ▽ More Conversational Swarm Intelligence (CSI) is a new method for enabling large human groups to hold real-time networked conversations using a technique modeled on the dynamics of biological swarms. Through the novel use of conversational agents powered by Large Language Models (LLMs), the CSI structure simultaneously enables local dialog among small deliberative groups and global propagation of conversational content across a larger population. In this way, CSI combines the benefits of small-group deliberative reasoning and large-scale collective intelligence. In this pilot study, participants deliberating in conversational swarms (via text chat) (a) produced 30% more contributions (p<0.05) than participants deliberating in a standard centralized chat room and (b) demonstrated 7.2% less variance in contribution quantity. These results indicate that users contributed more content and participated more evenly when using the CSI structure. △ Less

Submitted 31 August, 2023; originally announced September 2023.

Comments: Pending for conference, Collective Intelligence 2023 (ACM)

ACM Class: H.5.2; H.1.2

The Manipulation Problem: Conversational AI as a Threat to Epistemic Agency

Authors: Louis Rosenberg

Abstract: The technology of Conversational AI has made significant advancements over the last eighteen months. As a consequence, conversational agents are likely to be deployed in the near future that are designed to pursue targeted influence objectives. Sometimes referred to as the "AI Manipulation Problem," the emerging risk is that consumers will unwittingly engage in real-time dialog with predatory AI a… ▽ More The technology of Conversational AI has made significant advancements over the last eighteen months. As a consequence, conversational agents are likely to be deployed in the near future that are designed to pursue targeted influence objectives. Sometimes referred to as the "AI Manipulation Problem," the emerging risk is that consumers will unwittingly engage in real-time dialog with predatory AI agents that can skillfully persuade them to buy particular products, believe particular pieces of misinformation, or fool them into revealing sensitive personal data. For many users, current systems like ChatGPT and LaMDA feel safe because they are primarily text-based, but the industry is already shifting towards real-time voice and photorealistic digital personas that look, move, and express like real people. This will enable the deployment of agenda-driven Virtual Spokespeople (VSPs) that will be highly persuasive through real-time adaptive influence. This paper explores the manipulative tactics that are likely to be deployed through conversational AI agents, the unique threats such agents pose to the epistemic agency of human users, and the emerging need for policymakers to protect against the most likely predatory practices. △ Less

Submitted 19 June, 2023; originally announced June 2023.

Comments: 5 pages, 2 figures

Truth in Motion: The Unprecedented Risks and Opportunities of Extended Reality Motion Data

Authors: Vivek Nair, Louis Rosenberg, James F. O'Brien, Dawn Song

Abstract: Motion tracking "telemetry" data lies at the core of nearly all modern extended reality (XR) and metaverse experiences. While generally presumed innocuous, recent studies have demonstrated that motion data actually has the potential to profile and deanonymize XR users, posing a significant threat to security and privacy in the metaverse. Motion tracking "telemetry" data lies at the core of nearly all modern extended reality (XR) and metaverse experiences. While generally presumed innocuous, recent studies have demonstrated that motion data actually has the potential to profile and deanonymize XR users, posing a significant threat to security and privacy in the metaverse. △ Less

Submitted 10 June, 2023; originally announced June 2023.

Journal ref: IEEE Security & Privacy (2024)

Inferring Private Personal Attributes of Virtual Reality Users from Head and Hand Motion Data

Authors: Vivek Nair, Christian Rack, Wenbo Guo, Rui Wang, Shuixian Li, Brandon Huang, Atticus Cull, James F. O'Brien, Marc Latoschik, Louis Rosenberg, Dawn Song

Abstract: Motion tracking "telemetry" data lies at the core of nearly all modern virtual reality (VR) and metaverse experiences. While generally presumed innocuous, recent studies have demonstrated that motion data actually has the potential to uniquely identify VR users. In this study, we go a step further, showing that a variety of private user information can be inferred just by analyzing motion data rec… ▽ More Motion tracking "telemetry" data lies at the core of nearly all modern virtual reality (VR) and metaverse experiences. While generally presumed innocuous, recent studies have demonstrated that motion data actually has the potential to uniquely identify VR users. In this study, we go a step further, showing that a variety of private user information can be inferred just by analyzing motion data recorded from VR devices. We conducted a large-scale survey of VR users (N=1,006) with dozens of questions ranging from background and demographics to behavioral patterns and health information. We then obtained VR motion samples of each user playing the game "Beat Saber," and attempted to infer their survey responses using just their head and hand motion patterns. Using simple machine learning models, over 40 personal attributes could be accurately and consistently inferred from VR motion data alone. Despite this significant observed leakage, there remains limited awareness of the privacy implications of VR motion data, highlighting the pressing need for privacy-preserving mechanisms in multi-user VR applications. △ Less

Submitted 10 June, 2023; v1 submitted 30 May, 2023; originally announced May 2023.

Unique Identification of 50,000+ Virtual Reality Users from Head & Hand Motion Data

Authors: Vivek Nair, Wenbo Guo, Justus Mattern, Rui Wang, James F. O'Brien, Louis Rosenberg, Dawn Song

Abstract: With the recent explosive growth of interest and investment in virtual reality (VR) and the so-called "metaverse," public attention has rightly shifted toward the unique security and privacy threats that these platforms may pose. While it has long been known that people reveal information about themselves via their motion, the extent to which this makes an individual globally identifiable within v… ▽ More With the recent explosive growth of interest and investment in virtual reality (VR) and the so-called "metaverse," public attention has rightly shifted toward the unique security and privacy threats that these platforms may pose. While it has long been known that people reveal information about themselves via their motion, the extent to which this makes an individual globally identifiable within virtual reality has not yet been widely understood. In this study, we show that a large number of real VR users (N=55,541) can be uniquely and reliably identified across multiple sessions using just their head and hand motion relative to virtual objects. After training a classification model on 5 minutes of data per person, a user can be uniquely identified amongst the entire pool of 50,000+ with 94.33% accuracy from 100 seconds of motion, and with 73.20% accuracy from just 10 seconds of motion. This work is the first to truly demonstrate the extent to which biomechanics may serve as a unique identifier in VR, on par with widely used biometrics such as facial or fingerprint recognition. △ Less

Submitted 17 February, 2023; originally announced February 2023.

Journal ref: 32nd USENIX Security Symposium (2023) 895-910

Achieving a quantum smart workforce

Authors: Clarice D. Aiello, D. D. Awschalom, Hannes Bernien, Tina Brower-Thomas, Kenneth R. Brown, Todd A. Brun, Justin R. Caram, Eric Chitambar, Rosa Di Felice, Michael F. J. Fox, Stephan Haas, Alexander W. Holleitner, Eric R. Hudson, Jeffrey H. Hunt, Robert Joynt, Scott Koziol, H. J. Lewandowski, Douglas T. McClure, Jens Palsberg, Gina Passante, Kristen L. Pudenz, Christopher J. K. Richardson, Jessica L. Rosenberg, R. S. Ross, Mark Saffman , et al. (7 additional authors not shown)

Abstract: Interest in building dedicated Quantum Information Science and Engineering (QISE) education programs has greatly expanded in recent years. These programs are inherently convergent, complex, often resource intensive and likely require collaboration with a broad variety of stakeholders. In order to address this combination of challenges, we have captured ideas from many members in the community. Thi… ▽ More Interest in building dedicated Quantum Information Science and Engineering (QISE) education programs has greatly expanded in recent years. These programs are inherently convergent, complex, often resource intensive and likely require collaboration with a broad variety of stakeholders. In order to address this combination of challenges, we have captured ideas from many members in the community. This manuscript not only addresses policy makers and funding agencies (both public and private and from the regional to the international level) but also contains needs identified by industry leaders and discusses the difficulties inherent in creating an inclusive QISE curriculum. We report on the status of eighteen post-secondary education programs in QISE and provide guidance for building new programs. Lastly, we encourage the development of a comprehensive strategic plan for quantum education and workforce development as a means to make the most of the ongoing substantial investments being made in QISE. △ Less

Submitted 23 October, 2020; originally announced October 2020.

Comments: 18 pages, 2 figures, 1 table

Journal ref: Quantum Sci. Technol. 6 030501 (2021)

Towards an Efficient Tile Matrix Inversion of Symmetric Positive Definite Matrices on Multicore Architectures

Authors: Emmanuel Agullo, Henricus Bouwmeester, Jack Dongarra, Jakub Kurzak, Julien Langou, Lee Rosenberg

Abstract: The algorithms in the current sequential numerical linear algebra libraries (e.g. LAPACK) do not parallelize well on multicore architectures. A new family of algorithms, the tile algorithms, has recently been introduced. Previous research has shown that it is possible to write efficient and scalable tile algorithms for performing a Cholesky factorization, a (pseudo) LU factorization, and a QR fa… ▽ More The algorithms in the current sequential numerical linear algebra libraries (e.g. LAPACK) do not parallelize well on multicore architectures. A new family of algorithms, the tile algorithms, has recently been introduced. Previous research has shown that it is possible to write efficient and scalable tile algorithms for performing a Cholesky factorization, a (pseudo) LU factorization, and a QR factorization. In this extended abstract, we attack the problem of the computation of the inverse of a symmetric positive definite matrix. We observe that, using a dynamic task scheduler, it is relatively painless to translate existing LAPACK code to obtain a ready-to-be-executed tile algorithm. However we demonstrate that non trivial compiler techniques (array renaming, loop reversal and pipelining) need then to be applied to further increase the parallelism of our application. We present preliminary experimental results. △ Less

Submitted 22 February, 2010; originally announced February 2010.

Comments: 8 pages, extended abstract submitted to VecPar10 on 12/11/09, notification of acceptance received on 02/05/10. See: http://vecpar.fe.up.pt/2010/