Accessing Public Datasets on the SPARC Portal
Users can get access to public datasets directly through the SPARC Portal. Datasets smaller than 5GB can be downloaded directly through the browser and all datasets can be accessed on Amazon's S3 service using your own AWS account. In order to access the public datasets, go to the
Find Data tab and select one of the datasets. Then, click on the
Get Dataset button for information on where to get the specific dataset.
Download Datasets under 5GB
Datasets smaller than 5GB can be downloaded directly through the browser by clicking on the
Get Dataset button. Clicking on the button will start the download process through the web-browser.
Access Datasets larger than 5GB
Dataset larger than 5GB are made available directly on Amazon's S3 service.
This allows you to access the data in the cloud, or download the data. Detailed information on how to setup your AWS account and how to download/transfer data can be found using the following links:
- Setting up your AWS Account
- Installing and configuring the AWS CLI
- Transferring public data to a private Amazon S3 Bucket
- Downloading a public SPARC Dataset
Download Individual Files from a Dataset
Users can also download individual files and folders within a dataset. To download a single file, click on the ellipses under the operation column. From the dropdown given, click
Download. For files smaller than 5GB, the file will be downloaded and saved to your local machine. Files larger than 5GB are made available directly on Amazon’s S3 service.
Alternatively, for files types such as TIFF, JPEG2000, or JSON, clicking on the file name will open a new page listing the file details. From there, click the
Download button in the top right.
Download Multiple Files from a Dataset
To download multiple files and folders at a time, click the checkbox next to each file to be downloaded. Next, click the
Download button in the top right of the Files tab.
A confirmation screen will appear; name the zip folder and click
Download to complete the action.
Note: Single files will be downloaded and saved in their original file format. Files and/or folders downloaded together will be saved as a zip folder containing the selected files/folders.