-
BreakNet: Discontinuity-Resilient Multi-Scale Transformer Segmentation of Retinal Layers
Authors:
Razieh Ganjee,
Bingjie Wang,
Lingyun Wang,
Chengcheng Zhao,
José-Alain Sahel,
Shaohua Pi
Abstract:
Visible light optical coherence tomography (vis-OCT) is gaining traction for retinal imaging due to its high resolution and functional capabilities. However, the significant absorption of hemoglobin in the visible light range leads to pronounced shadow artifacts from retinal blood vessels, posing challenges for accurate layer segmentation. In this study, we present BreakNet, a multi-scale Transfor…
▽ More
Visible light optical coherence tomography (vis-OCT) is gaining traction for retinal imaging due to its high resolution and functional capabilities. However, the significant absorption of hemoglobin in the visible light range leads to pronounced shadow artifacts from retinal blood vessels, posing challenges for accurate layer segmentation. In this study, we present BreakNet, a multi-scale Transformer-based segmentation model designed to address boundary discontinuities caused by these shadow artifacts. BreakNet utilizes hierarchical Transformer and convolutional blocks to extract multi-scale global and local feature maps, capturing essential contextual, textural, and edge characteristics. The model incorporates decoder blocks that expand pathwaproys to enhance the extraction of fine details and semantic information, ensuring precise segmentation. Evaluated on rodent retinal images acquired with prototype vis-OCT, BreakNet demonstrated superior performance over state-of-the-art segmentation models, such as TCCT-BP and U-Net, even when faced with limited-quality ground truth data. Our findings indicate that BreakNet has the potential to significantly improve retinal quantification and analysis.
△ Less
Submitted 26 August, 2024;
originally announced August 2024.
-
Fully Automated OCT-based Tissue Screening System
Authors:
Shaohua Pi,
Razieh Ganjee,
Lingyun Wang,
Riley K. Arbuckle,
Chengcheng Zhao,
Jose A Sahel,
Bingjie Wang,
Yuanyuan Chen
Abstract:
This study introduces a groundbreaking optical coherence tomography (OCT) imaging system dedicated for high-throughput screening applications using ex vivo tissue culture. Leveraging OCT's non-invasive, high-resolution capabilities, the system is equipped with a custom-designed motorized platform and tissue detection ability for automated, successive imaging across samples. Transformer-based deep…
▽ More
This study introduces a groundbreaking optical coherence tomography (OCT) imaging system dedicated for high-throughput screening applications using ex vivo tissue culture. Leveraging OCT's non-invasive, high-resolution capabilities, the system is equipped with a custom-designed motorized platform and tissue detection ability for automated, successive imaging across samples. Transformer-based deep learning segmentation algorithms further ensure robust, consistent, and efficient readouts meeting the standards for screening assays. Validated using retinal explant cultures from a mouse model of retinal degeneration, the system provides robust, rapid, reliable, unbiased, and comprehensive readouts of tissue response to treatments. This fully automated OCT-based system marks a significant advancement in tissue screening, promising to transform drug discovery, as well as other relevant research fields.
△ Less
Submitted 15 May, 2024;
originally announced May 2024.
-
Uncovering Customer Issues through Topological Natural Language Analysis
Authors:
Shu-Ting Pi,
Sidarth Srinivasan,
Yuying Zhu,
Michael Yang,
Qun Liu
Abstract:
E-commerce companies deal with a high volume of customer service requests daily. While a simple annotation system is often used to summarize the topics of customer contacts, thoroughly exploring each specific issue can be challenging. This presents a critical concern, especially during an emerging outbreak where companies must quickly identify and address specific issues. To tackle this challenge,…
▽ More
E-commerce companies deal with a high volume of customer service requests daily. While a simple annotation system is often used to summarize the topics of customer contacts, thoroughly exploring each specific issue can be challenging. This presents a critical concern, especially during an emerging outbreak where companies must quickly identify and address specific issues. To tackle this challenge, we propose a novel machine learning algorithm that leverages natural language techniques and topological data analysis to monitor emerging and trending customer issues. Our approach involves an end-to-end deep learning framework that simultaneously tags the primary question sentence of each customer's transcript and generates sentence embedding vectors. We then whiten the embedding vectors and use them to construct an undirected graph. From there, we define trending and emerging issues based on the topological properties of each transcript. We have validated our results through various methods and found that they are highly consistent with news sources.
△ Less
Submitted 23 February, 2024;
originally announced March 2024.
-
Universal Model in Online Customer Service
Authors:
Shu-Ting Pi,
Cheng-Ping Hsieh,
Qun Liu,
Yuying Zhu
Abstract:
Building machine learning models can be a time-consuming process that often takes several months to implement in typical business scenarios. To ensure consistent model performance and account for variations in data distribution, regular retraining is necessary. This paper introduces a solution for improving online customer service in e-commerce by presenting a universal model for predict-ing label…
▽ More
Building machine learning models can be a time-consuming process that often takes several months to implement in typical business scenarios. To ensure consistent model performance and account for variations in data distribution, regular retraining is necessary. This paper introduces a solution for improving online customer service in e-commerce by presenting a universal model for predict-ing labels based on customer questions, without requiring training. Our novel approach involves using machine learning techniques to tag customer questions in transcripts and create a repository of questions and corresponding labels. When a customer requests assistance, an information retrieval model searches the repository for similar questions, and statistical analysis is used to predict the corresponding label. By eliminating the need for individual model training and maintenance, our approach reduces both the model development cycle and costs. The repository only requires periodic updating to maintain accuracy.
△ Less
Submitted 23 February, 2024;
originally announced February 2024.
-
Teacher-Student Learning on Complexity in Intelligent Routing
Authors:
Shu-Ting Pi,
Michael Yang,
Yuying Zhu,
Qun Liu
Abstract:
Customer service is often the most time-consuming aspect for e-commerce websites, with each contact typically taking 10-15 minutes. Effectively routing customers to appropriate agents without transfers is therefore crucial for e-commerce success. To this end, we have developed a machine learning framework that predicts the complexity of customer contacts and routes them to appropriate agents accor…
▽ More
Customer service is often the most time-consuming aspect for e-commerce websites, with each contact typically taking 10-15 minutes. Effectively routing customers to appropriate agents without transfers is therefore crucial for e-commerce success. To this end, we have developed a machine learning framework that predicts the complexity of customer contacts and routes them to appropriate agents accordingly. The framework consists of two parts. First, we train a teacher model to score the complexity of a contact based on the post-contact transcripts. Then, we use the teacher model as a data annotator to provide labels to train a student model that predicts the complexity based on pre-contact data only. Our experiments show that such a framework is successful and can significantly improve customer experience. We also propose a useful metric called complexity AUC that evaluates the effectiveness of customer service at a statistical level.
△ Less
Submitted 23 February, 2024;
originally announced February 2024.
-
Contact Complexity in Customer Service
Authors:
Shu-Ting Pi,
Michael Yang,
Qun Liu
Abstract:
Customers who reach out for customer service support may face a range of issues that vary in complexity. Routing high-complexity contacts to junior agents can lead to multiple transfers or repeated contacts, while directing low-complexity contacts to senior agents can strain their capacity to assist customers who need professional help. To tackle this, a machine learning model that accurately pred…
▽ More
Customers who reach out for customer service support may face a range of issues that vary in complexity. Routing high-complexity contacts to junior agents can lead to multiple transfers or repeated contacts, while directing low-complexity contacts to senior agents can strain their capacity to assist customers who need professional help. To tackle this, a machine learning model that accurately predicts the complexity of customer issues is highly desirable. However, defining the complexity of a contact is a difficult task as it is a highly abstract concept. While consensus-based data annotation by experienced agents is a possible solution, it is time-consuming and costly. To overcome these challenges, we have developed a novel machine learning approach to define contact complexity. Instead of relying on human annotation, we trained an AI expert model to mimic the behavior of agents and evaluate each contact's complexity based on how the AI expert responds. If the AI expert is uncertain or lacks the skills to comprehend the contact transcript, it is considered a high-complexity contact. Our method has proven to be reliable, scalable, and cost-effective based on the collected data.
△ Less
Submitted 23 February, 2024;
originally announced February 2024.
-
Sub2Full: split spectrum to boost OCT despeckling without clean data
Authors:
Lingyun Wang,
Jose A Sahel,
Shaohua Pi
Abstract:
Optical coherence tomography (OCT) suffers from speckle noise, causing the deterioration of image quality, especially in high-resolution modalities like visible light OCT (vis-OCT). The potential of conventional supervised deep learning denoising methods is limited by the difficulty of obtaining clean data. Here, we proposed an innovative self-supervised strategy called Sub2Full (S2F) for OCT desp…
▽ More
Optical coherence tomography (OCT) suffers from speckle noise, causing the deterioration of image quality, especially in high-resolution modalities like visible light OCT (vis-OCT). The potential of conventional supervised deep learning denoising methods is limited by the difficulty of obtaining clean data. Here, we proposed an innovative self-supervised strategy called Sub2Full (S2F) for OCT despeckling without clean data. This approach works by acquiring two repeated B-scans, splitting the spectrum of the first repeat as a low-resolution input, and utilizing the full spectrum of the second repeat as the high-resolution target. The proposed method was validated on vis-OCT retinal images visualizing sublaminar structures in outer retina and demonstrated superior performance over conventional Noise2Noise and Noise2Void schemes. The code is available at https://github.com/PittOCT/Sub2Full-OCT-Denoising.
△ Less
Submitted 18 January, 2024;
originally announced January 2024.
-
Covering and packing with homothets of limited capacity
Authors:
Oriol Solé Pi
Abstract:
This work revolves around the two following questions: Given a convex body $C\subset\mathbb{R}^d$, a positive integer $k$ and a finite set $S\subset\mathbb{R}^d$ (or a finite Borel measure $μ$ on $\mathbb{R}^d$), how many homothets of $C$ are required to cover $S$ if no homothet is allowed to cover more than $k$ points of $S$ (or have measure larger than $k$)? How many homothets of $C$ can be pack…
▽ More
This work revolves around the two following questions: Given a convex body $C\subset\mathbb{R}^d$, a positive integer $k$ and a finite set $S\subset\mathbb{R}^d$ (or a finite Borel measure $μ$ on $\mathbb{R}^d$), how many homothets of $C$ are required to cover $S$ if no homothet is allowed to cover more than $k$ points of $S$ (or have measure larger than $k$)? How many homothets of $C$ can be packed if each of them must cover at least $k$ points of $S$ (or have measure at least $k$)? We prove that, so long as $S$ is not too degenerate, the answer to both questions is $Θ_d(\frac{|S|}{k})$, where the hidden constant is independent of $d$. This is optimal up to a multiplicative constant. Analogous results hold in the case of measures. Then we introduce a generalization of the standard covering and packing densities of a convex body $C$ to Borel measure spaces in $\mathbb{R}^d$ and, using the aforementioned bounds, we show that they are bounded from above and below, respectively, by functions of $d$. As an intermediate result, we give a simple proof the existence of weak $ε$-nets of size $O(\frac{1}ε)$ for the range space induced by all homothets of $C$. Following some recent work in discrete geometry, we investigate the case $d=k=2$ in greater detail. We also provide polynomial time algorithms for constructing a packing/covering exhibiting the $Θ_d(\frac{|S|}{k})$ bound mentioned above in the case that $C$ is an Euclidean ball. Finally, it is shown that if $C$ is a square then it is NP-hard to decide whether $S$ can be covered using $\frac{|S|}{4}$ squares containing $4$ points each.
△ Less
Submitted 5 December, 2022; v1 submitted 16 November, 2022;
originally announced November 2022.
-
Memristor Crossbars with 4.5 Terabits-per-Inch-Square Density and Two Nanometer Dimension
Authors:
Shuang Pi,
Can Li,
Hao Jiang,
Weiwei Xia,
Huolin Xin,
J. Joshua Yang,
Qiangfei Xia
Abstract:
Memristor is a promising building block for the next generation nonvolatile random access memory and bio-inspired computing systems. Organizing memristors into high density crossbar arrays, although challenging, is critical to meet the ever-growing high capacity and low energy demands of these applications especially in the big data era. Here, we construct memristor crossbars with a single-layer d…
▽ More
Memristor is a promising building block for the next generation nonvolatile random access memory and bio-inspired computing systems. Organizing memristors into high density crossbar arrays, although challenging, is critical to meet the ever-growing high capacity and low energy demands of these applications especially in the big data era. Here, we construct memristor crossbars with a single-layer density up to 4.5 terabits per inch square, an order of magnitude denser than the state- of-the-art 64-layer triple level cell NAND flash technology. The memristors in the crossbars are 2 $\times$ 2 nm$^2$ in size, capable of switching with tens of nano ampere electric current. The densely packed memristor crossbars of extremely small working devices provides a power-efficient solution for high density information storage and processing.
△ Less
Submitted 27 May, 2018; v1 submitted 25 April, 2018;
originally announced April 2018.
