@ -269,12 +273,8 @@ In the previous section, only a single *value-based* prompt is used at training
A separate prompt ensemble model is trained for each data split to evaluate the performance of multi-prompt methods in low-resource scenarios. Edit the [train_prompting.sh](prompt-learning/train_prompting.sh) file to add `--with_prompt_ensemble` flag for training with multiple prompt functions.
A separate prompt ensemble model is trained for each data split to evaluate the performance of multi-prompt methods in low-resource scenarios. Edit the [train_prompting.sh](prompt-learning/train_prompting.sh) file to add `--with_prompt_ensemble` flag for training with multiple prompt functions.
The probability of slot $s_{t}$ on multiple prompt functions are calculated using:
The probability of the generated slot (for loss) on multiple prompt functions is calculated by weighted averaging the probability from each prompt function.
where $|K|$ represents the number of prompt functions, $f_{k}$ is the $k$-th prompt function, $\alpha_{k}$ is the weight of prompt $k$. The prompt weight $\alpha_{k}$ is set to `0.25` for all prompt functions. The loss $L$ for prompt ensemble training is calculated using the above function.
Run the training script as before after adding the `--with_prompt_ensemble` flag:
Run the training script as before after adding the `--with_prompt_ensemble` flag: