AutoFlow: Automated Workflow Generation for
Large Language Model Agents

AI agent is an autonomous entity capable of making decisions and executing actions in a given environment to effectively handle various complex tasks [31, 9, 39, 46]. Recently, with the rapid advancement of Large Language Models (LLMs), LLM-based AI agents have become an important type of agent for complex task solving [8, 24, 36], such as reasoning, planning and coding.

Reasoning: LLMs typically break down complex tasks into a series of steps, constituting a chain of reasoning [41]. Approaches such as Chain of Thought (CoT) and its derivatives [41, 22], including tree [50] and graph structures [2], are commonly used. The self-consistency method [40] samples multiple reasoning paths and selects the most consistent outcome through voting.

Planning: Planning tasks require LLMs to generate a sequence of actions to achieve specific goals [10]. Recent studies have designed platforms to test LLMs’ planning abilities in areas such as expert model integration [8], travel task planning [47], and tool usage [53]. However, a known issue is that LLMs may generate non-executable, invalid or grammatically wrong plans, such as using a piece of text as input to an image-processing tool. To solve the problem, some studies [8, 53] use post-processing method to extract a chain of tools from the generated texts, which use LLM itself as a parser to post-process the generated text. Further, recent attempts integrate finite state machines into LLMs to enhance human’s controllability of LLM in planning [26, 45]. The ReAct approach [51] also uses external tools such as search engines to improve LLM planning. In this work, we build on these ideas to enhance the executability of the generated frameworks.

Coding: LLMs can generate code to solve complex tasks, reducing the need for manual programming [30, 48, 16, 28, 6, 35, 32, 4]. However, the generated code may contain errors or fail to meet user requirements. To mitigate these issues, workflow-based methods have been proposed, including manually designed and automatically generated workflows [17, 44, 54]. Another research direction involves using LLMs for natural language programming, leveraging their strong natural language understanding abilities. A notable example is the CoRE language [48], which unifies natural language programming, pseudo-code programming, and workflow programming under the same framework using LLM as interpreter. Our work follows the workflow concept in natural language programming and develops an automated workflow generation framework to reduce human labor.

Automated Machine Learning (AutoML) aims to reduce human labors in designing and deploying machine learning techniques, simplifying the application of ML in real-world problems. There are three main types of AutoML techniques [49, 27]:

Automated Model Selection: Tools such as Auto-sklearn [7] and Auto-WEKA [23] automatically select the best machine learning model from a library of models and hyper-parameter settings.

Automated Feature Engineering: Tools such as Data Science Machine [18], ExploreKit [19], and VEST [5] generate or select useful features without manual intervention, since feature engineering significantly impacts model performance in many applications.

Neural Architecture Search (NAS): Methods such as ENAS [34], DARTS [29], NASH [38], GNAS [13], and AmoebaNet-A [37] discover effective neural network architectures for specific tasks without manual design. Experiments show that networks generated through NAS can match or even outperform human-designed architectures across various tasks.

AutoML systems typically involve two main components for training: a controller, which is a machine learning model responsible for sampling model selections, and a child model, which comprises the parameters of the machine learning model to be created and used for the task at hand. In our work, we follow this training paradigm, using a workflow generator LLM as the controller, and the generated workflow along with a workflow interpreter LLM as the child model. More details of the proposed technique are introduced in Section 4.

In this section, we introduce how to use natural language programs as a representation of workflows. Specifically, we will use the Code Representation and Execution (CoRE) system [48] as an example to show how to construct workflows as natural language programs and how the LLM Agent follows the workflow by executing the natural language program.

The CoRE system enables users to write workflows in natural language, which unifies natural language programming, pseudo-code programming, and workflow programming. Although the entry barrier is lower than coding in programming languages, constructing workflows in natural language still requires much human labor and domain expertise. Inspired by Automated Machine Learning (AutoML) [14], we would like to automatically learn the best workflow based on the given task and training data. Considering the instructions in CoRE language are written in natural language and LLM has a strong ability of natural language understanding, we also use LLM as the workflow generator. To distinguish with the Interpreter LLM mentioned in 3.1, we denote the LLM that learns to generate workflows as the Workflow Generator LLM, and name the LLM that interprets and executes workflow as the Workflow Interpreter LLM, consistent with Figure 1. In this way, users only need to provide a high-level description of the task and the corresponding dataset, and the generator LLM can generate the optimal workflow in CoRE language for the interpreter LLM to execute on the given task. This process expects to minimize human efforts and automatically pursue the optimal workflow for LLM regardless of users’ knowledge on workflow design.

We use LoRA adapter [12] for fine-tuning open-souced LLMs as workflow generators. The training process is shown in Figure 2.

First, the workflow generator LLM receives a few-shot example workflow and a description of the task from users as the input query. Although the CoRE language has minimal grammar requirements and the instructions are written in natural language, which can be well learned and generated by LLMs, an example workflow can help the workflow generator LLM better understand the grammar of the CoRE language. The natural language description of the task is to help the generator LLM understand the application scenarios of the workflow to be generated. Take the text and image processing tasks in OpenAGI benchmark [8] as an example, the task description could be “Provide a workflow with several steps. The workflow can guide the LLM to design plans for a type of complex tasks realted to text and image processing using the provided tools”.

Second, the next step is to generate an executable workflow based on the input query. For closed-source LLMs such as GPT-4, the model can directly generate a grammatically valid workflow given the few-shot example. However, open-source LLMs such as Mixtral-8x7B cannot consistently generate grammatically valid workflow even if few-shot example workflows are provided. To solve the problem, we follow the post-processing strategy in previous work [8, 53] and use GPT-4 as a parser to revise the output workflow into a grammatically valid one.

Third, the generated workflow will be executed by the interpreter LLM to obtain its performance on the validation dataset. Then, the generator LLM is updated based on the workflow’s performance on the validation dataset. Specifically, we use reinforcement learning (RL) to update the parameters of the LoRA adapter of the generator LLM, with the average metrics of all data instances on the validation dataset as the reward.

These three steps together consist of one iteration of the fine-tuning process. The fine-tuning process will terminal and the final workflow will be produced when the terminal condition is met, when the difference of reward between two consecutive iterations is smaller then a threshold. After the iterative optimization process, the workflow generator LLM produces the optimal workflow for the task based on the execution feedback.

As for closed-source LLMs such as GPT-4, we use in-context learning to avoid fine-tuning the parameters. As shown in Figure 2, the AutoFlow framework also requires an example workflow and a description of the task, and feeds them as the input query to the workflow generator LLM. After the GPT-4 generates the workflow, we do not use a parser to revise the flow since GPT-4 can well follow the CoRE grammar demonstrated by the example workflow. Then, the interpreter LLM executes the workflow to evaluate its performance on the validation dataset as the reward, which is the same process as the fine-tuning method. The difference is that, in the next step, the AutoFlow framework directly includes the reward value in the query and prompts the generator LLM to generate a new workflow given the performance of the previously generated workflow, such as “The execution performance of the previous workflow is 0.6415. Provide a new workflow that can gain a better performance”. The whole process is demonstrated in Figure 2.

We will show in the experimentation that closed-source LLMs such as GPT-4 can well utilize the reward values in the prompt to refine the workflow and finally obtainn the optimal workflow by using the in-context learning method.

We conduct experiments on both closed-source and open-source LLMs:

• •

  GPT-4 [33] (Closed-source) is a generative pre-trained transformer of OpenAI. In this work, we use the GPT-4-1106-preview version.

• •

  Mixtral-8x7B [15] (Open-source) is a pre-trained generative Sparse Mixture of Experts with 46.7 billion parameters.

In our experiment, we apply these two types of LLMs for both workflow generator LLM and interpreter LLM. Thus, there are four combinations in total.

We adopt the following LLM-based agent planning schema:

• •

  Zero-shot Learning (Zero) directly inputs the query to the LLM.

• •

  Chain-of-Thought (CoT) [41] induces the LLM to generate a coherent language sequence that serves as a meaningful intermediate step bridging the input query and the output answer.

• •

  Few-shot Learning (Few) presents a set of high-quality demonstrations in the prompt, each consisting of both input and desired output on the target task.

• •

  CoRE [48] uses a manually designed workflow with LLM as an interpreter.

• •

  AutoFlow is our proposed framework that can automatically generate workflows.

We conduct experiments on a benchmark dataset, OpenAGI [8]. The OpenAGI benchmark tasks are categorized based on their output type and ground-truth label type (Task 1, 2, and 3). Then, based on different task types, different metrics are employed to gauge the performance: CLIP Score [11], assessing the similarity between text and image, is utilized for Text-to-Image tasks (Task 1); BERT Score [55], evaluating text generation with BERT, is applied when both data labels and the expected outputs are texts (Task 2); and ViT Score [43] gauges the similarity between the image label and image output (Task 3).

Our framework and all baselines are implemented by PyTorch, an open-source library. We follow the implementation setting of the OpenAGI platform [8] for Zero-shot and few-shot learnings. We leverage the DSPy framework [20, 21] to apply the CoT strategy to the OpenAGI platform. We also tried Program-of-Thought [6] and ReAct [52] strategies on the OpenAGI platform. However, the ReAct strategy requires text observation, which is unsuitable for our OpenAGI task since some observations are in image format, and Program-of-Thought cannot generate executable codes. Thus, we did not include them as the baselines.

For the hyper-parameter setting of the AutoFlow framework, we set the number of iterations for the workflow generator LLM as 30. For the open-source LLM, Mixtral, as the generator LLM, we use the REINFORCE [42] as the core reinforcement learning (RL) algorithm for the generator LLM, with the average score on the training dataset as the reward. We use Adam as the optimizer with the learning rate at 0.001 for RL. Also, we apply Low-Rank Adaptation (LoRA) [12] with the rank equal to 8 to Mixtral for efficient fine-tuning.

We conduct the experiments on the OpenAGI [8] benchmark dataset. For a fair comparison, we show the results using the same workflow interpreter LLM in a table. Specifically, the results of using the open-source LLM, Mixtral, as the LLM interpreter is shown in Table 1; and the results of using the closed-source LLM, GPT-4, as the LLM interpreter is shown in Table 2. Each row stands for a type of task, each column represents the planning schema of an LLM interpreter. From these two tables, we can see that, after applying our AutoFlow framework, the average score over tasks is significantly better than the baselines. Compared to the best baseline, CoRE, AutoFlow has over 40% improvement when using Mixtral as the LLM interpreter, and over 5% improvement when using GPT-4 as the interpreter LLM. For the score of each type of task, our AutoFlow also reaches the highest one. Thus, the experiment results validate that AutoFlow is effective and can generate a workflow with better performance than manually designed ones.

An interesting observation is that, the best average score when using Mixtral as the LLM interpreter, is AutoFlow with GPT-4 as the workflow generator; and the best average score when using GPT-4 as the LLM interpreter, is AutoFlow with Mixtral as the workflow generator. This observation suggests that the combination of different systems (Mixtral and GPT-4) for the LLM interpreter and workflow generator might lead to a kind of synergistic effect where the strengths of one system complement the weaknesses of the other, which helps to better solve complex multi-step tasks.