โก Quickstart
๐ก Create a RAG app on your own data in a minute
Installation
First install the Python package:
Once you have installed the package, depending upon your preference you can either use:
Open Source Models
This includes Open source LLMs like Mistral, Llama, etc.
Free to use, and runs locally on your machine.
Paid Models
This includes paid LLMs like GPT 4, Claude, etc.
Cost money and are accessible via an API.
Open Source Models
This section gives a quickstart example of using Mistral as the Open source LLM and Sentence transformers as the Open source embedding model. These models are free and run mostly on your local machine.
We are using Mistral hosted at Hugging Face, so will you need a Hugging Face token to run this example. Its free and you can create one here.
Paid Models
In this section, we will use both LLM and embedding model from OpenAI.
Next Steps
Now that you have created your first app, you can follow any of the links:
Was this page helpful?