-
Proving that Cryptic Crossword Clue Answers are Correct
Abstract: Cryptic crossword clues are challenging cognitive tasks, for which new test sets are released on a daily basis by multiple international newspapers. Each cryptic clue contains both the definition of the answer to be placed in the crossword grid (in common with regular crosswords), and `wordplay' that proves that the answer is correct (i.e. a human solver can be confident that an answer is correct… ▽ More
Submitted 11 July, 2024; originally announced July 2024.
Comments: Accepted paper for the ICML 2024 Workshop on LLMs and Cognition (4 pages + references + 6 pages of Appendices)
-
Investigating Prompt Engineering in Diffusion Models
Abstract: With the spread of the use of Text2Img diffusion models such as DALL-E 2, Imagen, Mid Journey and Stable Diffusion, one challenge that artists face is selecting the right prompts to achieve the desired artistic output. We present techniques for measuring the effect that specific words and phrases in prompts have, and (in the Appendix) present guidance on the selection of prompts to produce desired… ▽ More
Submitted 21 November, 2022; originally announced November 2022.
Comments: Paper submitted for Creativity and Design workshop at NeurIPS 2022. (4 pages including references + 7 page appendix). We would like to thank Google and the ML Developer Programs Team for their assistance and compute credits used in the experiments for this paper
-
Red Dragon AI at TextGraphs 2021 Shared Task: Multi-Hop Inference Explanation Regeneration by Matching Expert Ratings
Abstract: Creating explanations for answers to science questions is a challenging task that requires multi-hop inference over a large set of fact sentences. This year, to refocus the Textgraphs Shared Task on the problem of gathering relevant statements (rather than solely finding a single 'correct path'), the WorldTree dataset was augmented with expert ratings of 'relevance' of statements to each overall e… ▽ More
Submitted 27 July, 2021; originally announced July 2021.
Comments: Accepted paper for TextGraphs-15 workshop at NAACL 2021. (5 pages including references)
-
Red Dragon AI at TextGraphs 2020 Shared Task: LIT : LSTM-Interleaved Transformer for Multi-Hop Explanation Ranking
Abstract: Explainable question answering for science questions is a challenging task that requires multi-hop inference over a large set of fact sentences. To counter the limitations of methods that view each query-document pair in isolation, we propose the LSTM-Interleaved Transformer which incorporates cross-document interactions for improved multi-hop ranking. The LIT architecture can leverage prior ranki… ▽ More
Submitted 28 December, 2020; originally announced December 2020.
Comments: Accepted paper for TextGraphs-14 workshop at COLING 2020. (6 pages including references)
-
arXiv:1911.09661 [pdf, ps, other]
Paraphrasing with Large Language Models
Abstract: Recently, large language models such as GPT-2 have shown themselves to be extremely adept at text generation and have also been able to achieve high-quality results in many downstream NLP tasks such as text classification, sentiment analysis and question answering with the aid of fine-tuning. We present a useful technique for using a large language model to perform the task of paraphrasing on a va… ▽ More
Submitted 21 November, 2019; originally announced November 2019.
Comments: Accepted paper for WNGT workshop at EMNLP-IJCNLP 2019. (7 pages including references and supplemental material)
-
Red Dragon AI at TextGraphs 2019 Shared Task: Language Model Assisted Explanation Generation
Abstract: The TextGraphs-13 Shared Task on Explanation Regeneration asked participants to develop methods to reconstruct gold explanations for elementary science questions. Red Dragon AI's entries used the language of the questions and explanation text directly, rather than a constructing a separate graph-like representation. Our leaderboard submission placed us 3rd in the competition, but we present here t… ▽ More
Submitted 20 November, 2019; originally announced November 2019.
Comments: Accepted paper for TextGraphs-13 workshop at EMNLP-IJCNLP 2019. (5 pages including references)
-
Unsupervised Natural Question Answering with a Small Model
Abstract: The recent (2019-02) demonstration of the power of huge language models such as GPT-2 to memorise the answers to factoid questions raises questions about the extent to which knowledge is being embedded directly within these large models. This short paper describes an architecture through which much smaller models can also answer such questions - by making use of 'raw' external knowledge. The contr… ▽ More
Submitted 19 November, 2019; originally announced November 2019.
Comments: Accepted paper for FEVER workshop at EMNLP-IJCNLP 2019. (4 pages + references)
-
arXiv:1909.06273 [pdf, ps, other]
Scene Graph Parsing by Attention Graph
Abstract: Scene graph representations, which form a graph of visual object nodes together with their attributes and relations, have proved useful across a variety of vision and language applications. Recent work in the area has used Natural Language Processing dependency tree methods to automatically build scene graphs. In this work, we present an 'Attention Graph' mechanism that can be trained end-to-end… ▽ More
Submitted 13 September, 2019; originally announced September 2019.
Comments: Accepted paper for the ViGIL workshop at NeurIPS 2018. (4 pages + references)
-
arXiv:1909.03508 [pdf, ps, other]
Transformer to CNN: Label-scarce distillation for efficient text classification
Abstract: Significant advances have been made in Natural Language Processing (NLP) modelling since the beginning of 2018. The new approaches allow for accurate results, even when there is little labelled data, because these NLP models can benefit from training on both task-agnostic and task-specific unlabelled data. However, these advantages come with significant size and computational costs. This workshop… ▽ More
Submitted 8 September, 2019; originally announced September 2019.
Comments: Accepted paper for CDNNRIA workshop at NeurIPS 2018. (3 pages + references)
-
arXiv:1909.03315 [pdf, ps, other]
Relationships from Entity Stream
Abstract: Relational reasoning is a central component of intelligent behavior, but has proven difficult for neural networks to learn. The Relation Network (RN) module was recently proposed by DeepMind to solve such problems, and demonstrated state-of-the-art results on a number of datasets. However, the RN module scales quadratically in the size of the input, since it calculates relationship factors between… ▽ More
Submitted 7 September, 2019; originally announced September 2019.
Comments: Accepted paper for the ViGIL workshop at NIPS 2017. (4 pages + references)