Skip to content

Add support for multiple StepChat models #19

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Add support for multiple StepChat models #19

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 20 additions & 3 deletions src/api/controllers/chat.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -223,7 +223,7 @@ async function createCompletion(
const { deviceId, token } = await acquireToken(refreshToken);
const result = await axios.post(
`https://yuewen.cn/api/proto.chat.v1.ChatMessageService/SendMessageStream`,
messagesPrepare(convId, messages, refs),
messagesPrepare(convId, messages, refs, model),
{
headers: {
"Content-Type": "application/connect+json",
Expand Down Expand Up @@ -303,7 +303,7 @@ async function createCompletionStream(
const { deviceId, token } = await acquireToken(refreshToken);
const result = await axios.post(
`https://yuewen.cn/api/proto.chat.v1.ChatMessageService/SendMessageStream`,
messagesPrepare(convId, messages, refs),
messagesPrepare(convId, messages, refs, model),
{
headers: {
"Content-Type": "application/connect+json",
Expand Down Expand Up @@ -393,9 +393,12 @@ function extractRefFileUrls(messages: any[]) {
* assistant:旧消息2
* user:新消息
*
* @param convId 会话ID
* @param messages 参考gpt系列消息格式，多轮对话请完整提供上下文
* @param refs 引用文件列表
* @param model 模型名称
*/
function messagesPrepare(convId: string, messages: any[], refs: any[]) {
function messagesPrepare(convId: string, messages: any[], refs: any[], model: string = MODEL_NAME) {
// 检查最新消息是否含有"type": "image_url"或"type": "file",如果有则注入消息
let latestMessage = messages[messages.length - 1];
let hasFileOrImage =
Expand Down Expand Up @@ -431,12 +434,26 @@ function messagesPrepare(convId: string, messages: any[], refs: any[]) {
}, "") + "assistant:";

logger.info("\n对话合并：\n" + content);

// 根据model选择exampleId
let exampleId = "6710ff1a80c0c9de0ffa887c"; // 默认使用step2的exampleId

if (model === "step") {
exampleId = undefined; // 如果是step模型，不使用exampleId
} else if (model === "step2-creator-2") {
exampleId = "step2-creator-2";
} else if (model === "stepO1-3") {
exampleId = "stepO1-3";
}

const json = JSON.stringify({
chatId: convId,
messageInfo: {
text: content,
attachments: refs.length > 0 ? refs : undefined,
},
messageMode: "SEND_MESSAGE",
...(exampleId && { exampleId })
});
const data = wrapData(json);
return data;
Expand Down
22 changes: 18 additions & 4 deletions src/api/routes/models.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,14 +10,28 @@ export default {
return {
"data": [
{
"id": "step-v1",
"id": "step",
"object": "model",
"owned_by": "step-free-api"
"owned_by": "step-free-api",
"description": "Default StepChat model"
},
{
"id": "step-v1-vision",
"id": "step2",
"object": "model",
"owned_by": "step-free-api"
"owned_by": "step-free-api",
"description": "StepChat model with exampleId 6710ff1a80c0c9de0ffa887c"
},
{
"id": "step2-creator-2",
"object": "model",
"owned_by": "step-free-api",
"description": "StepChat model with creator-2 capabilities"
},
{
"id": "stepO1-3",
"object": "model",
"owned_by": "step-free-api",
"description": "StepChat model with O1-3 capabilities"
}
]
};
Expand Down