...
How to install the Free Download Manager
Go to https://www.freedownloadmanager.org/ and download the installer for Windows or another platform.
Run the installer to install the FDM
Open the program, click the menu top right and click on "Preferences."
Scroll to “Browser Integration” and click the button for the browser that will be used for the downloads (i.e., Edge, Firefox, Chrome)
Follow the instructions from the page that pops up to add the extension to the browser (i.e., Add to Firefox button)
Set any other settings on the preference page (or leave them all at the defaults)
...
Connect to the file locations
Go to the site that you want to download a file from. Make sure the FDM shows as added on the browser.
Choose a file on the site to download and follow whatever steps are required to download it. The FDM will take over the download action and appear with a list of files in the queue to download.
If the queue list doesn’t appear (the preferences page displays), click the left arrow on the top right to go to the download lists.
...
From here, you can stop and start downloads, delete downloads, and see the progress of the downloads. You can quickly adjust the bandwidth allocated for the downloads from the quick menu at the bottom left and use the scheduler to schedule a day/time to download the file.
Other Options for Multiple File Downloads
| Info |
|---|
Note: As with the download manager steps, these suggestions are presented for information purposes only. The ASU Library does not guarantee they will work for you and cannot provide technical assistance for them. These suggestions may not work if a guestbook has been enable for a dataset. |
Sometimes it may be necessary to download all of the files from a dataset at the command line of a server or Linux virtual environment, such as the ASU Agave Cluster. The Dataverse file download API works well in some instances, but if there are numerous files or files that are very large, you may need a script that will create a list of files and then download them individually.
Python Script
Don Sizemore from the Odum Institute has provided a Python script that can be used for multiple file downloads. This script can be copied to the server or virtual machine that you will be copying files to. To invoke it, run it using “python <name of script>.py” and add the parameters for the Dataverse installation URL, persistent DOI, version of the files, directory name, and API token, if needed. An example of this command would be:
python download_dataset.py -d='https://dataverse.asu.edu' -p='doi:authority/shoulder/identifier' -v=1.0
These parameters are explained in the script as well.
WGET Script
Another command-line option for downloading files is a solution provided by Phillip Conzett from UIT. This option involves downloading a spreadsheet, editing it to include the DOIs of the Datasets that you are working with, and then generating a script from the spreadsheet data. This option allows you to download files from multiple datasets at once, depending on how you create the script. Following are the instructions for using the method:
...
Copy the contents of dataset_dois.txt and paste into cell A2 in the LibreOffice spreadsheet dataverse_download_all_files_from_datasets.ods (link below).
...
Copy cells B2 and C2 to the end of the contents of column A.
...
Copy the contents of column C from cell C2 onward.
...
Paste into a plain text document, and save it as dataverse_download_all_files_from_datasets.sh (or similar).
...
In the command line, run the script created in the previous step
This will download all the files from collection abc and collection def into a sub-folder called fileDownload and within this sub-folder into sub-sub-folders named after the dataset DOI suffix.
| View file | ||
|---|---|---|
|
Using the Dataverse API for File Downloads
For more options for downloading individual or multiple files, please see the official Dataverse API guides related to file downloads below.
Dataverse Native API for File Downloads
...
NOTE: we are not using DDIs for files, so you can’t use the persistent ID, you have to use the database File ID
NOTE: you can find the file ID by hovering over the file name and looking at the URL on the bottom left of the screen
...
NOTE: you can find your API key by logging into Dataverse and clicking on your name on the top right, and then choosing “API token”
Per the API notes, the general format for the URL of a file is:
https://dataverse.asu.edu/api/access/datefile/<fileid>
Basically, every file that is not restricted should be able to be downloaded with wget using the following format:
wget https://dataverse.asu.edu/api/access/datafile/<fileid>
Or, using the API:
curl -L -O -J -H X-Dataverse-key:xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx https://dataverse.asu.edu/api/access/datafile/<fileid>