Showing 1–4 of 4 results for author: Zahn, M

Unlocking the Potential of Collaborative AI -- On the Socio-technical Challenges of Federated Machine Learning

Authors: Tobias Müller, Milena Zahn, Florian Matthes

Abstract: The disruptive potential of AI systems roots in the emergence of big data. Yet, a significant portion is scattered and locked in data silos, leaving its potential untapped. Federated Machine Learning is a novel AI paradigm enabling the creation of AI models from decentralized, potentially siloed data. Hence, Federated Machine Learning could technically open data silos and therefore unlock economic… ▽ More The disruptive potential of AI systems roots in the emergence of big data. Yet, a significant portion is scattered and locked in data silos, leaving its potential untapped. Federated Machine Learning is a novel AI paradigm enabling the creation of AI models from decentralized, potentially siloed data. Hence, Federated Machine Learning could technically open data silos and therefore unlock economic potential. However, this requires collaboration between multiple parties owning data silos. Setting up collaborative business models is complex and often a reason for failure. Current literature lacks guidelines on which aspects must be considered to successfully realize collaborative AI projects. This research investigates the challenges of prevailing collaborative business models and distinct aspects of Federated Machine Learning. Through a systematic literature review, focus group, and expert interviews, we provide a systemized collection of socio-technical challenges and an extended Business Model Canvas for the initial viability assessment of collaborative AI projects. △ Less

Submitted 28 April, 2023; v1 submitted 26 April, 2023; originally announced April 2023.

Comments: Accepted for Publication at the 31st European Conference on Information Systems (ECIS 2023)

Efficient human-in-loop deep learning model training with iterative refinement and statistical result validation

Authors: Manuel Zahn, Douglas P. Perrin

Abstract: Annotation and labeling of images are some of the biggest challenges in applying deep learning to medical data. Current processes are time and cost-intensive and, therefore, a limiting factor for the wide adoption of the technology. Additionally validating that measured performance improvements are significant is important to select the best model. In this paper, we demonstrate a method for creati… ▽ More Annotation and labeling of images are some of the biggest challenges in applying deep learning to medical data. Current processes are time and cost-intensive and, therefore, a limiting factor for the wide adoption of the technology. Additionally validating that measured performance improvements are significant is important to select the best model. In this paper, we demonstrate a method for creating segmentations, a necessary part of a data cleaning for ultrasound imaging machine learning pipelines. We propose a four-step method to leverage automatically generated training data and fast human visual checks to improve model accuracy while keeping the time/effort and cost low. We also showcase running experiments multiple times to allow the usage of statistical analysis. Poor quality automated ground truth data and quick visual inspections efficiently train an initial base model, which is refined using a small set of more expensive human-generated ground truth data. The method is demonstrated on a cardiac ultrasound segmentation task, removing background data, including static PHI. Significance is shown by running the experiments multiple times and using the student's t-test on the performance distributions. The initial segmentation accuracy of a simple thresholding algorithm of 92% was improved to 98%. The performance of models trained on complicated algorithms can be matched or beaten by pre-training with the poorer performing algorithms and a small quantity of high-quality data. The introduction of statistic significance analysis for deep learning models helps to validate the performance improvements measured. The method offers a cost-effective and fast approach to achieving high-accuracy models while minimizing the cost and effort of acquiring high-quality training data. △ Less

Submitted 3 April, 2023; originally announced April 2023.

Locating disparities in machine learning

Authors: Moritz von Zahn, Oliver Hinz, Stefan Feuerriegel

Abstract: Machine learning can provide predictions with disparate outcomes, in which subgroups of the population (e.g., defined by age, gender, or other sensitive attributes) are systematically disadvantaged. In order to comply with upcoming legislation, practitioners need to locate such disparate outcomes. However, previous literature typically detects disparities through statistical procedures for when th… ▽ More Machine learning can provide predictions with disparate outcomes, in which subgroups of the population (e.g., defined by age, gender, or other sensitive attributes) are systematically disadvantaged. In order to comply with upcoming legislation, practitioners need to locate such disparate outcomes. However, previous literature typically detects disparities through statistical procedures for when the sensitive attribute is specified a priori. This limits applicability in real-world settings where datasets are high dimensional and, on top of that, sensitive attributes may be unknown. As a remedy, we propose a data-driven framework called Automatic Location of Disparities (ALD) which aims at locating disparities in machine learning. ALD meets several demands from industry: ALD (1) is applicable to arbitrary machine learning classifiers; (2) operates on different definitions of disparities (e.g., statistical parity or equalized odds); and (3) deals with both categorical and continuous predictors even if disparities arise from complex and multi-way interactions known as intersectionality (e. g., age above 60 and female). ALD produces interpretable audit reports as output. We demonstrate the effectiveness of ALD based on both synthetic and real-world datasets. As a result, we empower practitioners to effectively locate and mitigate disparities in machine learning algorithms, conduct algorithmic audits, and protect individuals from discrimination. △ Less

Submitted 4 September, 2023; v1 submitted 13 August, 2022; originally announced August 2022.

Obstacle avoidance for blind people using a 3D camera and a haptic feedback sleeve

Authors: Manuel Zahn, Armaghan Ahmad Khan

Abstract: Navigation and obstacle avoidance are some of the hardest tasks for the visually impaired. Recent research projects have proposed technological solutions to tackle this problem. So far most systems fail to provide multidimensional feedback while working under various lighting conditions. We present a novel obstacle avoidance system by combining a 3D camera with a haptic feedback sleeve. Our system… ▽ More Navigation and obstacle avoidance are some of the hardest tasks for the visually impaired. Recent research projects have proposed technological solutions to tackle this problem. So far most systems fail to provide multidimensional feedback while working under various lighting conditions. We present a novel obstacle avoidance system by combining a 3D camera with a haptic feedback sleeve. Our system uses the distance information of the camera and maps it onto a 2D vibration array on the forearm. In our functionality tests of the haptic feedback sleeve, users were able to correctly identify and localize 98,6% of single motor vibration patterns and 70% of multidirectional and multi-motor vibration patterns. The combined obstacle avoidance system was evaluated on a testing route in the dark, simulating a navigation task. All users were able to complete the task and showed performance improvement over multiple runs. The system is independent of lighting conditions and can be used indoors and outdoors. Therefore, the obstacle avoidance system demonstrates a promising approach towards using technology to enable more independence for the visually impaired. △ Less

Submitted 12 January, 2022; originally announced January 2022.