Running Extract Data in batches (advanced)
Edited
Extract Data can handle about 3000 answers at once (e.g. 100 papers X 30 columns, or 300 papers X 10 columns). If you're running a large data extraction and need more answers than that, you'll need to run in batches. To run in batches:
Iterate on your columns using 3-10 papers
Save the columns once you're happy with them
Upload 100 papers (or whatever your batch size is, given your number of columns, to get to 3000 or fewer answers total), and run "Extract Data" on those 100 papers
Add your saved columns and wait for Elicit to provide the answers
Download the CSV of results
Repeat 3-6 for the rest of your papers
Combine the CSVs