LPMX: a pure rootless composable container system
Open Access
- 31 March 2022
- journal article
- research article
- Published by Springer Nature in BMC Bioinformatics
- Vol. 23 (1) , 1-13
Abstract
Background: Delivering tools for genome analysis to users is often difficult given the complex dependencies and conflicts of such tools. Container virtualization systems (such as Singularity) isolate environments, thereby helping developers package tools. However, these systems lack mutual composability, i.e., an easy way to integrate multiple tools in different containers and/or on the host. Another issue is that one may be unable to use a single container system of the same version at all the sites being used, thus discouraging the use of container systems. Results: We developed LPMX, an open-source pure rootless composable container system that provides composability; i.e., the system allows users to easily integrate tools from different containers or even from the host. LPMX accelerates science by letting researchers compose existing containers and containerize tools/pipelines that are difficult to package/containerize using Conda or Singularity, thereby saving researchers’ precious time. The technique used in LPMX allows LPMX to run purely in userspace without root privileges even during installation, thus ensuring that we can use LPMX at any Linux clusters with major distributions. The lowest overhead for launching containers with LPMX gives us courage to isolate tools as much as possible into small containers, thereby minimizing the chance of conflicts. The support for the layered file system keeps the total size of container images for a single genomic pipeline modest, as opposed to Singularity, which uses mostly a flat single-layer image. Conclusions: LPMX is pure rootless container engine with mutual composability, thus saving researchers’ time, and accelerating science.Keywords
All Related Versions
Funding Information
- Japan Society for the Promotion of Science (16H06279, 16K16145)
This publication has 12 references indexed in Scilit:
- Enabling rootless Linux Containers in multi-user environments: The udocker toolComputer Physics Communications, 2018
- Bioconda: sustainable and comprehensive software distribution for the life sciencesNature Methods, 2018
- Minimap2: pairwise alignment for nucleotide sequencesBioinformatics, 2018
- Singularity: Scientific containers for mobility of computePLOS ONE, 2017
- Canu: scalable and accurate long-read assembly via adaptivek-mer weighting and repeat separationGenome Research, 2017
- VarDict: a novel and versatile variant caller for next-generation sequencing in cancer researchNucleic Acids Research, 2016
- A review of bioinformatic pipeline frameworksBriefings in Bioinformatics, 2016
- VarScan 2: Somatic mutation and copy number alteration discovery in cancer by exome sequencingGenome Research, 2012
- The Genome Analysis Toolkit: A MapReduce framework for analyzing next-generation DNA sequencing dataGenome Research, 2010
- The Sequence Alignment/Map format and SAMtoolsBioinformatics, 2009