Responsible AI Gateway Interfaces
Description
- The Responsible AI (RAI) Gateway Interfaces allow users to use Chat, Completion, and Embedding APIs of large language models. These Gateway APIs not only provide access but also ensure the necessary authorizations and policy checks before making calls to the large language models.
Client Benefits
- Internal users at State Street can only utilize a common registry for large language model (LLM).
- This ensures that all model access is regulated and controlled.
Data Availability
- Data is compartmentalized by application and environment.
- GenAI calls and responses are made in real-time.