-
Continuous and deterministic all-photonic cluster state of indistinguishable photons
Authors:
Zu-En Su,
Boaz Taitler,
Ido Schwartz,
Dan Cogan,
Ismail Nassar,
Oded Kenneth,
Netanel H. Lindner,
David Gershoni
Abstract:
Cluster states are key resources for measurement-based quantum information processing. Photonic cluster and graph states, in particular, play indispensable roles in quantum network and quantum metrology. We demonstrate a semiconductor quantum dot based device in which the confined hole spin acts as a needle in a quantum knitting machine producing continuously and deterministically at sub-Gigahertz…
▽ More
Cluster states are key resources for measurement-based quantum information processing. Photonic cluster and graph states, in particular, play indispensable roles in quantum network and quantum metrology. We demonstrate a semiconductor quantum dot based device in which the confined hole spin acts as a needle in a quantum knitting machine producing continuously and deterministically at sub-Gigahertz repetition rate single indistinguishable photons which are all polarization entangled to each other and to the spin in a one dimensional cluster state. By projecting two nonadjacent photons onto circular polarization bases we disentangle the spin from the photons emitted in between, thus continuously and deterministically preparing all-photonic cluster states for the first time. We use polarization tomography on four sequentially detected photons to demonstrate and to directly quantify the robustness of the cluster's entanglement and the determinism in its photon generation.
△ Less
Submitted 6 March, 2024;
originally announced March 2024.
-
ProtoCon: Pseudo-label Refinement via Online Clustering and Prototypical Consistency for Efficient Semi-supervised Learning
Authors:
Islam Nassar,
Munawar Hayat,
Ehsan Abbasnejad,
Hamid Rezatofighi,
Gholamreza Haffari
Abstract:
Confidence-based pseudo-labeling is among the dominant approaches in semi-supervised learning (SSL). It relies on including high-confidence predictions made on unlabeled data as additional targets to train the model. We propose ProtoCon, a novel SSL method aimed at the less-explored label-scarce SSL where such methods usually underperform. ProtoCon refines the pseudo-labels by leveraging their nea…
▽ More
Confidence-based pseudo-labeling is among the dominant approaches in semi-supervised learning (SSL). It relies on including high-confidence predictions made on unlabeled data as additional targets to train the model. We propose ProtoCon, a novel SSL method aimed at the less-explored label-scarce SSL where such methods usually underperform. ProtoCon refines the pseudo-labels by leveraging their nearest neighbours' information. The neighbours are identified as the training proceeds using an online clustering approach operating in an embedding space trained via a prototypical loss to encourage well-formed clusters. The online nature of ProtoCon allows it to utilise the label history of the entire dataset in one training cycle to refine labels in the following cycle without the need to store image embeddings. Hence, it can seamlessly scale to larger datasets at a low cost. Finally, ProtoCon addresses the poor training signal in the initial phase of training (due to fewer confident predictions) by introducing an auxiliary self-supervised loss. It delivers significant gains and faster convergence over state-of-the-art across 5 datasets, including CIFARs, ImageNet and DomainNet.
△ Less
Submitted 22 March, 2023;
originally announced March 2023.
-
LAVA: Label-efficient Visual Learning and Adaptation
Authors:
Islam Nassar,
Munawar Hayat,
Ehsan Abbasnejad,
Hamid Rezatofighi,
Mehrtash Harandi,
Gholamreza Haffari
Abstract:
We present LAVA, a simple yet effective method for multi-domain visual transfer learning with limited data. LAVA builds on a few recent innovations to enable adapting to partially labelled datasets with class and domain shifts. First, LAVA learns self-supervised visual representations on the source dataset and ground them using class label semantics to overcome transfer collapse problems associate…
▽ More
We present LAVA, a simple yet effective method for multi-domain visual transfer learning with limited data. LAVA builds on a few recent innovations to enable adapting to partially labelled datasets with class and domain shifts. First, LAVA learns self-supervised visual representations on the source dataset and ground them using class label semantics to overcome transfer collapse problems associated with supervised pretraining. Secondly, LAVA maximises the gains from unlabelled target data via a novel method which uses multi-crop augmentations to obtain highly robust pseudo-labels. By combining these ingredients, LAVA achieves a new state-of-the-art on ImageNet semi-supervised protocol, as well as on 7 out of 10 datasets in multi-domain few-shot learning on the Meta-dataset. Code and models are made available.
△ Less
Submitted 19 October, 2022;
originally announced October 2022.
-
Generate, Annotate, and Learn: NLP with Synthetic Text
Authors:
Xuanli He,
Islam Nassar,
Jamie Kiros,
Gholamreza Haffari,
Mohammad Norouzi
Abstract:
This paper studies the use of language models as a source of synthetic unlabeled text for NLP. We formulate a general framework called ``generate, annotate, and learn (GAL)'' to take advantage of synthetic text within knowledge distillation, self-training, and few-shot learning applications. To generate high-quality task-specific text, we either fine-tune LMs on inputs from the task of interest, o…
▽ More
This paper studies the use of language models as a source of synthetic unlabeled text for NLP. We formulate a general framework called ``generate, annotate, and learn (GAL)'' to take advantage of synthetic text within knowledge distillation, self-training, and few-shot learning applications. To generate high-quality task-specific text, we either fine-tune LMs on inputs from the task of interest, or prompt large LMs with few examples. We use the best available classifier to annotate synthetic text with soft pseudo labels for knowledge distillation and self-training, and use LMs to obtain hard labels for few-shot learning. We train new supervised models on the combination of labeled and pseudo-labeled data, which results in significant gains across several applications. We investigate key components of GAL and present theoretical and empirical arguments against the use of class-conditional LMs to generate synthetic labeled text instead of unlabeled text. GAL achieves new state-of-the-art knowledge distillation results for 6-layer transformers on the GLUE leaderboard.
△ Less
Submitted 31 May, 2022; v1 submitted 11 June, 2021;
originally announced June 2021.
-
All Labels Are Not Created Equal: Enhancing Semi-supervision via Label Grouping and Co-training
Authors:
Islam Nassar,
Samitha Herath,
Ehsan Abbasnejad,
Wray Buntine,
Gholamreza Haffari
Abstract:
Pseudo-labeling is a key component in semi-supervised learning (SSL). It relies on iteratively using the model to generate artificial labels for the unlabeled data to train against. A common property among its various methods is that they only rely on the model's prediction to make labeling decisions without considering any prior knowledge about the visual similarity among the classes. In this pap…
▽ More
Pseudo-labeling is a key component in semi-supervised learning (SSL). It relies on iteratively using the model to generate artificial labels for the unlabeled data to train against. A common property among its various methods is that they only rely on the model's prediction to make labeling decisions without considering any prior knowledge about the visual similarity among the classes. In this paper, we demonstrate that this degrades the quality of pseudo-labeling as it poorly represents visually similar classes in the pool of pseudo-labeled data. We propose SemCo, a method which leverages label semantics and co-training to address this problem. We train two classifiers with two different views of the class labels: one classifier uses the one-hot view of the labels and disregards any potential similarity among the classes, while the other uses a distributed view of the labels and groups potentially similar classes together. We then co-train the two classifiers to learn based on their disagreements. We show that our method achieves state-of-the-art performance across various SSL tasks including 5.6% accuracy improvement on Mini-ImageNet dataset with 1000 labeled examples. We also show that our method requires smaller batch size and fewer training iterations to reach its best performance. We make our code available at https://github.com/islam-nassar/semco.
△ Less
Submitted 12 April, 2021;
originally announced April 2021.
-
Nucleus-nucleus reaction cross-sections for deformed nuclei
Authors:
M. Y. M. Hassan,
M. Y. H. Farag,
A. Y. Abul-Magd,
T. E. I. Nassar
Abstract:
Reaction cross-sections are calculated using the Coulomb modified Glauber model for deformed target nuclei. The deformed nuclear matter density of the target is expanded into multipoles of order k = 0,2,4.The reaction cross-sections between some spherical and deformed nuclei are studied at energy range (10-1000 MeV/nucleon). The most significant effects in the intermediate energy range are the C…
▽ More
Reaction cross-sections are calculated using the Coulomb modified Glauber model for deformed target nuclei. The deformed nuclear matter density of the target is expanded into multipoles of order k = 0,2,4.The reaction cross-sections between some spherical and deformed nuclei are studied at energy range (10-1000 MeV/nucleon). The most significant effects in the intermediate energy range are the Coulomb field and in-medium effect that modified the trajectory of the incident beams. Introducing the deformation effect beside the Coulomb field and in-medium effect improves the agreement with the experimental data and two empirical parameterizations in the case of not finding experimental data. Moreover it is indicated that the enhancement of the reaction cross-sections is attributed with fixed orientation in deformed nuclei.
△ Less
Submitted 3 February, 2009;
originally announced February 2009.
