Showing 1–3 of 3 results for author: Huang, G B

Latent Feature Representation via Unsupervised Learning for Pattern Discovery in Massive Electron Microscopy Image Volumes

Authors: Gary B Huang, Huei-Fang Yang, Shin-ya Takemura, Pat Rivlin, Stephen M Plaza

Abstract: We propose a method to facilitate exploration and analysis of new large data sets. In particular, we give an unsupervised deep learning approach to learning a latent representation that captures semantic similarity in the data set. The core idea is to use data augmentations that preserve semantic meaning to generate synthetic examples of elements whose feature representations should be close to on… ▽ More We propose a method to facilitate exploration and analysis of new large data sets. In particular, we give an unsupervised deep learning approach to learning a latent representation that captures semantic similarity in the data set. The core idea is to use data augmentations that preserve semantic meaning to generate synthetic examples of elements whose feature representations should be close to one another. We demonstrate the utility of our method applied to nano-scale electron microscopy data, where even relatively small portions of animal brains can require terabytes of image data. Although supervised methods can be used to predict and identify known patterns of interest, the scale of the data makes it difficult to mine and analyze patterns that are not known a priori. We show the ability of our learned representation to enable query by example, so that if a scientist notices an interesting pattern in the data, they can be presented with other locations with matching patterns. We also demonstrate that clustering of data in the learned space correlates with biologically-meaningful distinctions. Finally, we introduce a visualization tool and software ecosystem to facilitate user-friendly interactive analysis and uncover interesting biological patterns. In short, our work opens possible new avenues in understanding of and discovery in large data sets, arising in domains such as EM analysis. △ Less

Submitted 22 December, 2020; originally announced December 2020.

Large-scale EM Analysis of the Drosophila Antennal Lobe with Automatically Computed Synapse Point Clouds

Authors: Ting Zhao, Shin-ya Takemura, Gary B. Huang, Jane Anne Horne, William T. Katz, Kazunori Shinomiya, Louis K. Scheffer, Ian A. Meinertzhagen, Patricia K. Rivlin, Stephen M. Plaza

Abstract: The promise of extracting connectomes and performing useful analysis on large electron microscopy (EM) datasets has been an elusive dream for many years. Tracing in even the smallest portions of neuropil requires copious human annotation, the rate-limiting step for generating a connectome. While a combination of improved imaging and automatic segmentation will lead to the analysis of increasingly… ▽ More The promise of extracting connectomes and performing useful analysis on large electron microscopy (EM) datasets has been an elusive dream for many years. Tracing in even the smallest portions of neuropil requires copious human annotation, the rate-limiting step for generating a connectome. While a combination of improved imaging and automatic segmentation will lead to the analysis of increasingly large volumes, machines still fail to reach the quality of human tracers. Unfortunately, small errors in image segmentation can lead to catastrophic distortions of the connectome. In this paper, to analyze very large datasets, we explore different mechanisms that are less sensitive to errors in automation. Namely, we advocate and deploy extensive synapse detection on the entire antennal lobe (AL) neuropil in the brain of the fruit fly Drosophila, a region much larger than any densely annotated to date. The resulting synapse point cloud produced is invaluable for determining compartment boundaries in the AL and choosing specific regions for subsequent analysis. We introduce our methodology in this paper for region selection and show both manual and automatic synapse annotation results. Finally, we note the correspondence between image datasets obtained using the synaptic marker, antibody nc82, and our datasets enabling registration between light and EM image modalities. △ Less

Submitted 25 August, 2015; originally announced August 2015.

Annotating Synapses in Large EM Datasets

Authors: Stephen M. Plaza, Toufiq Parag, Gary B. Huang, Donald J. Olbris, Mathew A. Saunders, Patricia K. Rivlin

Abstract: Reconstructing neuronal circuits at the level of synapses is a central problem in neuroscience and becoming a focus of the emerging field of connectomics. To date, electron microscopy (EM) is the most proven technique for identifying and quantifying synaptic connections. As advances in EM make acquiring larger datasets possible, subsequent manual synapse identification ({\em i.e.}, proofreading) f… ▽ More Reconstructing neuronal circuits at the level of synapses is a central problem in neuroscience and becoming a focus of the emerging field of connectomics. To date, electron microscopy (EM) is the most proven technique for identifying and quantifying synaptic connections. As advances in EM make acquiring larger datasets possible, subsequent manual synapse identification ({\em i.e.}, proofreading) for deciphering a connectome becomes a major time bottleneck. Here we introduce a large-scale, high-throughput, and semi-automated methodology to efficiently identify synapses. We successfully applied our methodology to the Drosophila medulla optic lobe, annotating many more synapses than previous connectome efforts. Our approaches are extensible and will make the often complicated process of synapse identification accessible to a wider-community of potential proofreaders. △ Less

Submitted 4 December, 2014; v1 submitted 5 September, 2014; originally announced September 2014.