Skip to main content
aj also offers a simplified, out-of-the-box RAG experience directly within the chat interface for your on-device models. How It Works:
  1. Import Your Documents: The app includes a user-friendly PDF Import Wizard that guides you through importing your documents.
  2. Select Your Context: When chatting with any of your on-device models, a new option in the chat interface allows you to select one of your vector stores.
  3. Ask Questions: When you send a message, the app first performs a semantic search on the selected vector store to find the most relevant information.
  4. Get Grounded Responses: This retrieved context is then combined with your question and sent to the on-device model.
The “Smart” Context System: The system is designed to be intelligent. If you ask a question and your selected vector store contains relevant information, the model will use it. However, if your question is a general one, the system will automatically fall back to a “general conversation” mode.