1
Feature Story
Welcome to LLM ATC’s documentation! — LLM ATC 0.1.3 documentation
Aug 14, 2023 · llm-atc.readthedocs.ioThe tool also provides the feature of saving models to an object store like S3 or GCS, enabling access from anywhere. Additionally, it includes a model registry for serving custom finetuned models. This documentation provides further details and references for using the LLM-ATC tool.
Key takeaways
- LLM-ATC is a tool for finetuning and serving open source large language models (LLMs) and is multi-cloud with one interface.
- It allows finetuning on any cloud including AWS, Azure, GCP, Lambda Cloud, IBM, Samsung, OCI, Cloudflare.
- Serving is supported on AWS and GCP, with more clouds in development. Models are saved to object store (e.g. S3, GCS) for access anywhere.
- LLM-ATC also provides a model registry for serving custom finetuned models.