A scalable file analysis and data generation platform that allows users to easily orchestrate arbitrary docker/vm/shell tools at scale.
- Highly scalable analysis of arbitrary files/repos
- Near zero-cost analysis tool integration
- Static and dynamic analysis sandboxes
- User friendly interfaces: GUI + CLI
- RESTful API for automated access to data
- Multi-tenant friendly permission system
- Full-text search of analysis results
- Key/Value tags for labeling data
Thorium allows for developers or analysts to:
- Easily scale up and orchestrate docker or baremetal based tools
- Easily search and use results from tools
- Comment and share files, tags, and results between users/analysts
Currently no there are no tools included in Thorium but we plan on releasing some soon. We hope to continue to release tools as well as allow for curated contributions from the community.
Thorium was built and intended to run in a K8s cluster but it can also run on a laptop using minikube. However it is important to note the single node deployment was not intended for production and reliability/stability may be less then stellar. To deploy a single node instance follow the Minithor docs here.
For full production deployment on a cluster you will need the following:
- Block store provider
- S3 storage
For on prem deployments we recommend CEPH. To deploy Thorium on a cluster follow the docs here.
Thorium is almost infinitely scalable if you have the compute/storage. Thorium has been tested to support billions of samples and utilization of large amounts of compute. Thorium partitions data temporally and allows admins to configure how scalable they want the system to be.
No, Thorium does not send any telemetry out.
Currently, Thorium supports up to ~50 GiB per file/repo. This is after compression and so it is a fuzzy limit but it should never be significantly smaller then 50 GiB. We do have plans to increase this limit in the future please create an issue if you feel this would be useful.
Yes, we plan to continue to expand our documentation and examples soon.
Contact us at thorium@sandia.gov.
