Updated October 9, 2024
In the age of large, distributed, digital data, the CyVerse Data Store offers solutions to many contemporary data storage needs. CyVerse's cloud-based data storage is optimized for large data, free to most scientific researchers, accessible through multiple interfaces, and leaves access control in the hands of the data owner(s). This policy describes the key features of the CyVerse Data Store as well as the obligations between CyVerse and its Users.
General Policies
This policy covers any data stored on the CyVerse Data Store, whether private, shared, or public.
- The Data Store provides research scientists, research groups, and research organizations with private, shared, or public storage allocations primarily for use within the CyVerse cyberinfrastructure (CI).
- The CyVerse Data Commons houses public data within the Data Store for use by the research community either within or outside CyVerse CI.
- The Data Store offers reliable, secure storage for datasets of any size that are actively being used for both research and/or education purposes. The Data Store is not intended for permanent, archival storage. While no data storage service, including the CyVerse Data Store, can provide a 100% guarantee against data loss, CyVerse uses industry-standard safeguards to protect against data loss. We recommend that users maintain a back-up of all critical data.
- Data and metadata in the Data Store are stored in a high-performance storage resource that has built-in redundancy and is continuously monitored for security and failure.
- Data in the Data Store are asynchronously mirrored at both the University of Arizona in Tucson and at the Texas Advanced Computing Center in Austin.
Data Storage Options
Allocations
- All domestic and international CyVerse account holders receive a default allocation of 5GB of storage at no cost, to be used for research data. You can view your current Resource Usage on the dashboard of the Discovery Environment.
- All domestic and international CyVerse users may purchase additional storage space over the 5GB default allocation. Current rates through 2024 are $125 USD per TB per year for single-copy for up to 4TB; the cost is $105 USD per TB per year for additional storage. Storage requirements are rounded up to the nearest TB. CyVerse does not pro-rate TBs. For 2025, a flat rate of $250 USD/TB/year will be charged for additional storage-only (double-copy). For requests of >100TB add-on storage, please contact us at support@cyverse.org.
Private and Shared Data
- Private data is stored in a user's home folder ( /iplant/home/$user, where $user is a CyVerse username). You may share data you own with other registered users via the Discovery Environment or using iCommands or create public links to the data.
- For methods of moving data in and out of the CyVerse Data Store, see Downloading and Uploading Data.
- You are automatically owner of any data you upload into your home folder.
- Any data in your home folder counts toward your total data allocation, whether shared with others or not. However, data that other Users share with you, does not affect your allocation, even if they make you an owner.
- For data shared within a lab group or with a few collaborators, we recommend that the project leader or PI create a shared folder within their home folder. The project leader can request a larger allocation for collaborative projects, if needed.
Community Data
- For community-based projects or collaborations involving many PIs, one of the PIs can request a Community Data folder. Community Data folders are intended for large collaborative projects that will ultimately produce public datasets.
- A Community Data folder is requested by an individual CyVerse user, who becomes the owner, but multiple collaborators must be listed on the application. Community Data folders count toward the owner's allocation, but it is understood that owners of Community Data folders will have larger total data allocations, and their personal allocation will not be penalized for hosting a community folder.
- To request a Community Data folder, use the Community and Public Folder Request form. You can simultaneously request an additional allocation for your Community Data folder.
- Community Data folders are housed in the iPlant/homes/shared directory and are visible via the Discovery Environment under "Community Data." Any user who has permission to view the folder can also access its contents using any of the methods available to logged-in CyVerse users. The owner controls who can access the data within a Community Data folder, but it is expected that multiple community members will have read and write access to the folder.
- We recommend that only one person (at most two) be the owner of any shared folder, as owners have permission to permanently delete data and remove other users.
- Data in a Community Data folder can be published to a repository, but the published data should be moved out of the CyVerse Data Store, unless a formal request is made to continue to house them as part of the Data Commons for use with CyVerse analysis tools and services.
- If all or part of a Community Data folder is made public, it becomes part of the Data Commons (below) and is subject to minimum metadata requirements.
- Note: Community Data folders will be phased out. All public folders shared by a community will be considered Community Released Data in the Data Commons (see below). Private folders shared by communities will be managed as groups, with similar functionality to that now provided.
Public Data on CyVerse: The CyVerse Data Commons
- The CyVerse Data Commons manages all public data (data accessible without a user account) that is stored in Community Released Data under the directory /iplant/home/shared and allows CyVerse users to publish data through CyVerse Curated Data. The Data Commons also supports publication to external data repositories. "Public data" on CyVerse is defined as any data that is visible to the public via datacommons.cyverse.org, whether or not the viewer has a CyVerse user account. Public data on CyVerse is also available to registered Users via all methods used to access the CyVerse Data Store.
- Read the Data Commons User Agreement for more policies on sharing and reusing data in the Data Commons.
- The Data Commons is not intended for permanent, archival storage.
Community Released Data Folders
- Individuals or groups of researchers who want to make data public without a permanent identifier can request a Community Released Data folder. Community Released Data folders are intended for datasets that are growing or changing frequently, or that may not need long-term preservation. The person requesting the Community Released Data Folder must have a current paid subscription to CyVerse (Reg, Pro, Commercial.)
- Read the Data Commons User Agreement for more policies on sharing and reusing data in Community Released Data Folders.
CyVerse Curated Data
- CyVerse supports publication of data to CyVerse Curated Data and to selected external repositories. Published data is considered stable, because it should not change unless a new version is published, and because the publisher makes a commitment to long-term access to the data.
- Datasets published in the DCR have permanent identifiers - Digital Object Identifiers (DOIs).
- For more information on the DCR, see the Data Commons User Agreement.
Intellectual Property and Responsibilities
- For private storage and shared data in the CyVerse Data Store, including private Community Data folders, data depositors maintain full ownership, authority, and control over metadata and permissions, as described in the Service Level Agreement.
- For Community Released Data folders, data depositors maintain ownership, authority, and control over metadata and permissions, but the bulk of the data in the Community Released Data folder must remain publicly available.
- For data deposited in CyVerse Curated Data, data depositors maintain intellectual ownership and authority over the data but no longer have the ability to edit the data or its metadata. See the Data Commons User Agreement for information on making changes to the data in the DCR.
- Any public data in the Data Commons that is derived from another source must properly attribute the primary sources and authors before being uploaded to the Data Commons. Attribution is the responsibility of the researcher making the submission or transfer.
- Any data, including derived data, shared with the public through CyVerse must comply with any copyright or reuse restrictions placed on the original source data.
- If there is a dispute about data that is uploaded or published to the Data Commons, CyVerse will not display the data publicly until the dispute is resolved.
- CyVerse does not assert ownership or any intellectual property rights to data it makes available. For derived data, the data policy of the data originator will take precedence over the data policy of CyVerse.
- When using of data in the CyVerse Data Store that was produced by someone else, users must cite or attribute the data originator and must comply with additional terms and conditions of use, if any, set by the data provider. To cite data stored or used at CyVerse, see How to Cite CyVerse.
- Users should be aware that U.S. and international copyright laws differ on the treatment of data collections. For example, Users wishing to redistribute public data as a merged data product are required to follow the applicable laws of the country where the data originated. It is the responsibility of the data user to be aware of the terms and conditions of data use.
User Account Deletion
To request account deletion, users must send an email to support@cyverse.org that meets the following requirements:
- The email request must come from an email account associated with the CyVerse account;
- Must include the CyVerse user name;
- Must include the user's full name.
After receipt of the user's request, CyVerse will send a follow-up email to confirm that deleting the account will result in permanent loss of all of the user's data. Once the user confirms this by replying to the email, the user's account will be deleted.
Security and Privacy
Please refer to CyVerse's Security and Privacy Policy.