Demos · Deploy Dify With CloudFormation · Deploy Dify on EKS ·
This repository provides the source code for three plugins in Dify: Bedrock Model Provider, SageMaker Model Provider, and AWS Tools, as well as related workflows and demos for reference by Dify users and AWS users.
- Dify environment (can be deployed with one click using AWS CloudFormation - dify.yaml) For production deployment, please refer to solution example Dify-on-EKS
- AWS account and AWS experience
- Basic Linux environment experience
Workflows (Demo Page)
| Name | Description | Link | Dependencies | Owner |
|---|---|---|---|---|
| Term_based_translate | Translation workflow with term mapping | DSL | Tool(Term mapping) | ybalbert |
| Code_translate | Translation workflow between different code types | DSL | binc | |
| Basic_RAG_Sample | Basic RAG workflow example with custom rerank node | DSL | Tool(Rerank) | ybalbert |
| Andrewyng/translation-agent | Recreation of Andrew Ng's translate agent | DSL | ybalbert | |
| rag_based_bot_with_tts | RAG-based bot with voice response capability | DSL | Tool(TTS) | ybalbert |
| s3_rag | simple s3-based rag, no vector db needed | DSL | S3 Operator | ybalbert |
| Marketing-copywriter | End-to-end marketing copywriting | DSL | Lyson Ober | |
| Simple_Kimi | Simple DIY Kimi | DSL | ybalbert | |
| SVG_Designer | SVG icon designer | DSL | Li Jigang | |
| Education_Question_Gen | Education scenario - question generator | DSL | chuanxie | |
| Apply_guardrails | Chat workflow with safety guardrails | DSL | amyli | |
| LLM-Finetuning-Dataflow | LLM fine-tuning data synthesis workflow | DSL | finetuning-on-aws | caoliuh |
| Image/Video Generation Workflow | Generate images and videos based on Amazon Nova Canvas and Reel | DSL | alexwuu | |
| EKS Upgrade Planning | Collect EKS cluster information and generate upgrade plan | DSL | wxyan | |
| Amazon S3 powered DMS with chatbot Capabilities | RAG-based bot for nextcloud integration | DSL | tanzhuaz | |
| ASR_Transcribe | Transcribe audio to text | DSL | ybalbert | |
| Image(Text)-2-Image Search | Image2Image & Text2Image Search | DSL | OpenSearch Knn Retriever | ybalbert |
| MCP Server Integration | MCP Server Integration Demo | DSL | ybalbert | |
| Chat-With-Browser | Interact with Remote Browser based on AgentCore Browser Tool | DSL | agentcore-browser-viewer | ybalbert |
| Manage-Memory-By-yourself | Manage Your memory by yourself based on AgentCore Memory | DSL1 DSL2 | liniyuan | |
| Execute-Code/Command | Execute code and commands in an isolated managed sandbox based on AgentCore Code Interpreter | DSL | runpeng |
💡 For more workflows, check out community websites: dify101.com, difyshare.com, Awesome-Dify-Workflow
| Tool Name | Tool Type | Description | Deployment Documentation | Owner |
|---|---|---|---|---|
| Rerank | PAAS | Text similarity ranking | Notebook | ybalbert |
| TTS | PAAS | Text-to-speech synthesis | Code | ybalbert |
| Bedrock Guardrails | SAAS | Text moderation tool implemented through Amazon Bedrock Guardrail's standalone ApplyGuardrail API | amyli | |
| Term_multilingual_mapping | PAAS | Word segmentation/term mapping | Repo | ybalbert |
| Image Translation Tool | PAAS | Translate text in images | Coming | tangqy |
| Chinese Toxicity Detector | PAAS | Chinese harmful content detection | Coming | ychchen |
| Transcribe Tool | SAAS | AWS transcribe service tool (ASR) | river xie | |
| Bedrock Retriever | PAAS | Amazon Bedrock knowledge base retrieval tool | ychchen | |
| S3 Operator | SAAS | Read and write S3 bucket content, can return presigned URLs | ybalbert | |
| AWS Bedrock Nova Canvas | SAAS | Generate images based on Amazon Nova Canvas | alexwuu | |
| AWS Bedrock Nova Reel | SAAS | Generate videos based on Amazon Nova Reel | alexwuu | |
| OpenSearch Knn Retriever | PAAS | Retrieve data from OpenSearch using KNN method | Notebook | ybalbert |
| Frame Extractor | PAAS | Extract Frame Images from GIF as LLM Input | ybalbert | |
| AgentCore Browser | SAAS | Interact with remote managed browser session | wanglx | |
| AgentCore Memory | SAAS | Record/Retrieve short-term/long term memory with managed service | liniyuan | |
| AgentCore Code Interpreter | SAAS | Execute code and commands in an isolated managed sandbox | runpeng |
| Model Name | Model Type | Deployment Documentation | Owner |
|---|---|---|---|
| Any open source LLM | SageMaker\LLM | Model_hub | ybalbert |
| Bge-m3-rerank-v2 | SageMaker\Rerank | Notebook | ybalbert |
| Bge-embedding-m3 | SageMaker\Embedding | Notebook | ybalbert |
| CosyVoice | SageMaker\TTS | Code | ybalbert |
| SenseVoice | SageMaker\ASR | Notebook | ybalbert |
| Whisper-large-v3-turbo | SageMaker\ASR | Notebook | ybalbert |
📌 Important Note
Dify's SageMaker LLM Provider can support most open-source models. We recommend using Model_hub to deploy these models. It's very user-friendly and supports no-code model fine-tuning and deployment. If you don't want to install Model_hub, you can also refer to this guide to deploy LLMs to SageMaker using vllm.
If you want to add your Embedding/Rerank/ASR/TTS models to the Dify Sagemaker Model Provider, you should first deploy them in Amazon SageMaker. Please refer to the corresponding notebooks for deployment.
- Raise issues on the repository's Issues page
- Consult the internal Lark group
- Fork this repository and submit a Merge Request
- Update README.md, adding your work (such as workflows or tools) to the appropriate table
- Dify 1.0.0 Release & AWS Plugin Adaptation
- How to Use DeepSeek Models on AWS in Dify? Only 5 Minutes
- Dify and Model Hub Integration for Mainstream Open-Source Models
- Dify Native Content Review Extension API Calls Bedrock Guardrail to Build Responsible AI Applications
- Three Steps to Build Kimi Based on the Latest Bedrock C3.5-V2
- AWS Services as Tools Integrated into Dify
- Dify and SageMaker ASR/TTS Integration
- How to use bedrock inference profile