Beginning with LlamaIndex is a superb selection when constructing an RAG pipeline. Often, you want an OpenAI API key to comply with the various tutorials out there.
Nevertheless, you would possibly face these conditions:
- Your organization can solely use privately deployed fashions on account of compliance.
- You’re utilizing a mannequin fine-tuned by your information science group.
- Authorized restrictions stop your organization’s non-public information from leaving the nation.
- Different causes that require utilizing privately deployed fashions.
When constructing enterprise AI purposes, you’ll be able to’t use OpenAI or different cloud suppliers’ LLM providers.
This results in a irritating first step: How do I join my LlamaIndex code to my firm’s non-public API service?
To save lots of your time, when you simply want the answer, set up this extension:
pip set up -U llama-index-llms-openai-like
This may remedy your drawback.
If you wish to perceive why, let’s proceed.