-
Open-source data pipeline for street-view images: a case study on community mobility during COVID-19 pandemic
Authors:
Matthew Martell,
Nick Terry,
Ribhu Sengupta,
Chris Salazar,
Nicole A. Errett,
Scott B. Miles,
Joseph Wartman,
Youngjun Choe
Abstract:
Street View Images (SVI) are a common source of valuable data for researchers. Researchers have used SVI data for estimating pedestrian volumes, demographic surveillance, and to better understand built and natural environments in cityscapes. However, the most common source of publicly available SVI data is Google Street View. Google Street View images are collected infrequently, making temporal an…
▽ More
Street View Images (SVI) are a common source of valuable data for researchers. Researchers have used SVI data for estimating pedestrian volumes, demographic surveillance, and to better understand built and natural environments in cityscapes. However, the most common source of publicly available SVI data is Google Street View. Google Street View images are collected infrequently, making temporal analysis challenging, especially in low population density areas. Our main contribution is the development of an open-source data pipeline for processing 360-degree video recorded from a car-mounted camera. The video data is used to generate SVIs, which then can be used as an input for temporal analysis. We demonstrate the use of the pipeline by collecting a SVI dataset over a 38-month longitudinal survey of Seattle, WA, USA during the COVID-19 pandemic. The output of our pipeline is validated through statistical analyses of pedestrian traffic in the images. We confirm known results in the literature and provide new insights into outdoor pedestrian traffic patterns. This study demonstrates the feasibility and value of collecting and using SVI for research purposes beyond what is possible with currently available SVI data. Limitations and future improvements on the data pipeline and case study are also discussed.
△ Less
Submitted 23 January, 2024;
originally announced January 2024.
-
Street View Data Collection Design for Disaster Reconnaissance
Authors:
Nicole A. Errett,
Joseph Wartman,
Scott B. Miles,
Ben Silver,
Matthew Martell,
Youngjun Choe
Abstract:
Over the last decade, street-view type images have been used across disciplines to generate and understand various place-based metrics. However efforts to collect this data were often meant to support investigator-driven research without regard to the utility of the data for other researchers. To address this, we describe our methods for collecting and publishing longitudinal data of this type in…
▽ More
Over the last decade, street-view type images have been used across disciplines to generate and understand various place-based metrics. However efforts to collect this data were often meant to support investigator-driven research without regard to the utility of the data for other researchers. To address this, we describe our methods for collecting and publishing longitudinal data of this type in the wake of the COVID-19 pandemic and discuss some of the challenges we encountered along the way. Our process included designing a route taking into account both broad area canvassing and community capitals transects. We also implemented procedures for uploading and publishing data from each survey. Our methods successfully generated the kind of longitudinal data that can be beneficial to a variety of research disciplines. However, there were some challenges with data collection consistency and the sheer magnitude of data produced. Overall, our approach demonstrates the feasibility of generating longitudinal street-view data in the wake of a disaster event. Based on our experience, we provide recommendations for future researchers attempting to create a similar data set.
△ Less
Submitted 8 August, 2023;
originally announced August 2023.
-
Development of a Multi-Task Learning V-Net for Pulmonary Lobar Segmentation on Computed Tomography and Application to Diseased Lungs
Authors:
Marc Boubnovski Martell,
Mitchell Chen,
Kristofer Linton-Reid,
Joram M. Posma,
Susan J Copley,
Eric O. Aboagye
Abstract:
Automated lobar segmentation allows regional evaluation of lung disease and is important for diagnosis and therapy planning. Advanced statistical workflows permitting such evaluation is a needed area within respiratory medicine; their adoption remains slow, with poor workflow accuracy. Diseased lung regions often produce high-density zones on CT images, limiting an algorithm's execution to specify…
▽ More
Automated lobar segmentation allows regional evaluation of lung disease and is important for diagnosis and therapy planning. Advanced statistical workflows permitting such evaluation is a needed area within respiratory medicine; their adoption remains slow, with poor workflow accuracy. Diseased lung regions often produce high-density zones on CT images, limiting an algorithm's execution to specify damaged lobes due to oblique or lacking fissures. This impact motivated developing an improved machine learning method to segment lung lobes that utilises tracheobronchial tree information to enhance segmentation accuracy through the algorithm's spatial familiarity to define lobar extent more accurately. The method undertakes parallel segmentation of lobes and auxiliary tissues simultaneously by employing multi-task learning (MTL) in conjunction with V-Net-attention, a popular convolutional neural network in the imaging realm. In keeping with the model's adeptness for better generalisation, high performance was retained in an external dataset of patients with four distinct diseases: severe lung cancer, COVID-19 pneumonitis, collapsed lungs and Chronic Obstructive Pulmonary Disease (COPD), even though the training data included none of these cases. The benefit of our external validation test is specifically relevant since our choice includes those patients who have diagnosed lung disease with associated radiological abnormalities. To ensure equal rank is given to all segmentations in the main task we report the following performance (Dice score) on a per-segment basis: normal lungs 0.97, COPD 0.94, lung cancer 0.94, COVID-19 pneumonitis 0.94 and collapsed lung 0.92, all at p<0.05. Even segmenting lobes with large deformations on CT images, the model maintained high accuracy. The approach can be readily adopted in the clinical setting as a robust tool for radiologists.
△ Less
Submitted 11 May, 2021;
originally announced May 2021.
