To create adversarial data, follow the steps:
In the root path, create a .env file and the following keys based on the models to be used:
GOOGLE_API_KEY=YOUR_KEY
OPENAI_API_KEY=YOUR_KEY
python scripts/create_stage_data.py
If you find our work useful, please cite our work:
@misc{anantheswaran2024investigatingrobustnessllmsmath,
title={Investigating the Robustness of LLMs on Math Word Problems},
author={Ujjwala Anantheswaran and Himanshu Gupta and Kevin Scaria and Shreyas Verma and Chitta Baral and Swaroop Mishra},
year={2024},
eprint={2406.15444},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2406.15444},
}