Published onAugust 14, 2023Drop-In Replacement for GPT with Llama 2 for OpenAI APILLMServingIntroductionLlama-IndexLangchainUse your favorite LLM application frameworks like Llama Index or Langchain with your self-served open source model deployment.
Published onAugust 2, 2023LLM Air Traffic Controller: Easy Finetuning and Serving of Open Source LLMsLLMFinetuneIntroductionLLM-ATC handles orchestration for finetuning and serving LLMs. Just bring your data and let LLM-ATC work under the hood on the cloud provider of your choice.