Why Griptape Cloud?
Deliver LLM-powered solutions to your customers more quickly, with fewer headaches and less guesswork. Griptape Cloud is ideal for accelerating time-to-market of conversational and event-driven AI applications that use up-to-the-minute data.
Whether that’s publicly available data or your own private sources, Griptape Cloud provides everything that you need to harness the incredible potential of large language models (LLMs). Griptape helps you enforce total control and security over how data is handled, with strict trust and privacy boundaries.
Bring your preferred model or models, and Griptape Cloud provides everything else that you need to build applications that will redefine the way that your business operates.
Benefits of Griptape Cloud
Simple &
Complete
- Griptape Cloud includes all the pieces you’ll need to run an entire AI application in the cloud.
-
- Fully-managed services for indexing and retrieval let you easily make your data accessible to LLMs, while hosted agents and structures make it simple to integrate any model and orchestrate your business logic.
Modular &
Composable
- Use the pieces that best suit your needs, including your in-house and 3rd-party solutions.
-
- Built with the open source Griptape Framework, Griptape Cloud is designed to be extensible so that you can integrate with existing application infrastructure, such as cloud storage systems, vector databases, and custom-tuned models.
Secure &
Private
- Griptape Cloud gives you end-to-end oversight over how sensitive data is handled throughout the application.
-
- Exercise precise control over which data LLMs can access at every step using the griptape framework’s exclusive Off-Prompt™ capabilities, and enforce governance with confidence using built-in observability tooling.
Overview - Griptape Cloud
Discover the power of Griptape Cloud’s core features in this hands-on demo! We’ll explore essential components like Data Connectors, Knowledge Bases, Structures, Threads, Rulesets, and Rules.
Key Features
- Assistants: The quickest way to get started with Griptape Cloud. With no need to provide credentials for your own LLM provider, Assistants are the easiest way to build chat applications that are connected to your data. They can be extended with a library of powerful tools, allowing them to interact with capabilities external to the LLM that powers them.
- Data Sources: Bring your own data to Griptape Cloud with easy-to-configure Data Sources, and update them automatically with scheduled updates. Data Source types include web pages, Amazon S3 buckets, objects and prefixes, Google Drive, Atlassian Confluence, and your own Griptape Cloud Data Lake. You can create your own custom Data Sources by implementing them as Griptape Structures.
- Data Lakes: Cloud storage integrated directly into Griptape Cloud. Accessible from Griptape Structures with a File Manager Driver and usable as a Data Source. Ideal if you need a simple and easy to use way to stage and integrate external data such as PDF or text files with your applications running on Griptape Cloud, without adding the complexity or cost of integrating with external cloud storage services.
- Knowledge Bases: Collections of Data Sources that your LLM-Powered applications can retrieve information from. Knowledge Bases provide a mechanism to control which Data Sources can be accessed by which applications, allowing for fine grained access control in production, or for data versioning in applications that are at different stages of their testing and deployment lifecycle.
- Retrievers: Retrieval Augmented Generation (RAG) capabilities in Griptape Cloud. Retrievers provide reranking capabilities to give more accurate results in your applications. Retrievers support queries across multiple Knowledge Bases, applying reranking across results returned from multiple Knowledge Bases and boosting the effectiveness of your RAG applications.
- Structures: Deploy and run your own customized components built using Griptape Structures or other Python code and build anything from linear pipelines and flexible workflows, through to complete systems of autonomous agents. Using the Griptape Framework within your Structures unlocks a host of powerful capabilities that accelerate development of your LLM-Powered Applications.
- Conversation Memory: Maintain state and provide context for chat applications built with Assistants and Structures easily with Griptape Cloud’s built in Conversation Memory. You can access Conversation Memory to save it or delete Conversation Memory in your applications via the Threads API.
- Tools: Run your Griptape Framework Tools on Griptape Cloud and supplement the capabilities of LLMs to enable them to interact with third-party services including API endpoints and search services, helpers such as the DateTime Tool and Calculator Tool, as well as powerful Griptape Framework Tools like the Retrieval Augmented Generation (RAG) Tool and the Prompt Summary Tool.
- Drivers & API: Access and control resources in Griptape Cloud from your applications via either the driver abstractions in the Griptape Framework or via a comprehensive and robust REST API.
Use Cases
Retrieval Augmented
Generation
- Ingest public and private data and use this to power your AI applications. Get started in minutes with Data Sources and Knowledge Bases, or your own PostgreSQL with pg-vector instance.
-
- Integrate with a wide variety of external vector stores, including MongoDB Atlas, Redis, OpenSearch, and more with drivers provided in the Griptape Framework.
Working with
Up-to-Date Data
- Automatically load and process data with scheduled updates to Data Sources. Ensure that your applications are always able to provide up-to-date responses, while maintaining context with Conversation Memory.
Building
AI Agents
- Create agents that integrate pre-processed or runtime-processed data into LLMs via tools, enabling sophisticated data-driven interactions within your applications.