Arvados
Arvados is an open source platform designed for managing and processing large biomedical data, supporting scalable, reproducible workflows and secure data sharing.
Overview of Arvados
Arvados is a modern open-source platform designed for the management and processing of large biomedical data sets. It supports the Common Workflow Language (CWL) to create portable and reusable workflows. Arvados facilitates the entire data lifecycle from acquisition to analysis, secure sharing, auditing, and reuse. The platform is particularly robust in handling petabytes of data, supporting the creation and management of complex computational workflows.
Data Management Capabilities of Arvados
Arvados excels in managing large biomedical data sets, including genomics and imaging data. It ensures data integrity through content-addressable storage known as Keep, which supports de-duplication. The platform is capable of versioning and tracking large datasets, allowing for reproducible and versioned computational workflows. Arvados integrates management, analysis, and storage solutions that can scale on demand, both on-premises and in the cloud, including AWS, Azure, and GCP.
Biotech and Pharmaceutical Applications of Arvados
Arvados is widely used by pharmaceutical companies, biotech startups, and research institutions. The platform supports clinical sequencing, drug development, and diagnostic testing. It accelerates new drug identification and validation through sophisticated analytical and machine learning workflows. Additionally, Arvados supports high throughput sequencing and clinical research applications with production-scale, clinical workflows handling large datasets.
Scalability and Deployment Options of Arvados
Arvados is designed to run scalable, portable, and production-ready workflows. It utilizes containerization technologies like Docker and Singularity to execute workflows at scale. The platform supports flexible deployment options, including cloud-based environments on AWS, Azure, and GCP, as well as on-premises and hybrid clusters. Arvados also supports federated multi-cluster workflows, which allow different steps of a workflow to execute on different clusters.
Security and Compliance Features in Arvados
Arvados offers robust security features, including industry-standard TLS encryption for all data in transit. It integrates with various enterprise authentication mechanisms such as LDAP and OpenID Connect. The platform can be configured to comply with HIPAA Security and Privacy standards, ensuring that sensitive biomedical data is managed in compliance with regulatory requirements. Arvados also facilitates secure data sharing and collaboration while adhering to data protection regulations.