Responsible AI Management Interfaces - AWS
Description
Responsible AI Project, provides a governed and centralized mechanism for developers to quickly build, deploy, and manage generative AI applications for business use cases in a responsible manner.
The Management servcies consists of Model Management, Policy Management and Prompt Management.
Model Management APIs provides centralized access to Large Language model management.
Policy Management APIs provides information about client's access to Large Language models. It is coupled with model management capabilitities, guardrails for content control, identity management, and role-based access control.
Prompt Catalog Management API provides centralized access to prompt template management, grounding rules and system prompts.
Client Benefits
- Internal users at State Street can only utilize a common registry for large language model (LLM), Policy Managements and Guardrail Managements.
- This ensures that all model access is regulated and controlled.
Data Availability
- Data is compartmentalized by application and environment.
- Only client level configurations are stored in RAI.