调用大模型对话SSE+Readablesteam+Decoder流式处理最简实现

简化版大模型流式处理代码// 1. 发送请求并处理流式响应asyncfunctionchatWithModel(prompt){constresponseawaitfetch(https://api.example.com/chat,{method:POST,headers:{Content-Type:application/json,Authorization:Bearer YOUR_API_KEY},body:JSON.stringify({prompt,stream:true})});if(!response.ok)thrownewError(请求失败);// 2. 创建可读流constreaderresponse.body.getReader();constdecodernewTextDecoder();returnnewReadableStream({asyncstart(controller){try{while(true){const{done,value}awaitreader.read();if(done)break;// 3. 解码并推送数据consttextdecoder.decode(value);controller.enqueue(text);}}finally{reader.releaseLock();controller.close();}}});}// 4. 使用示例asyncfunctionstartChat(){conststreamawaitchatWithModel(你好请介绍一下自己);constreaderstream.getReader();while(true){const{done,value}awaitreader.read();if(done)break;console.log(value);// 实时输出模型响应}}startChat();更简洁的版本使用for awaitasyncfunctionchatWithModel(prompt){constresponseawaitfetch(https://api.example.com/chat,{method:POST,headers:{Content-Type:application/json,Authorization:Bearer YOUR_API_KEY},body:JSON.stringify({prompt,stream:true})});if(!response.ok)thrownewError(请求失败);constreaderresponse.body.getReader();constdecodernewTextDecoder();returnnewReadableStream({asyncpull(controller){const{done,value}awaitreader.read();if(done){controller.close();return;}controller.enqueue(decoder.decode(value));}});}// 使用(async(){conststreamawaitchatWithModel(你好);constreaderstream.getReader();forawait(constchunkofreadStream(reader)){console.log(chunk);}})();asyncfunction*readStream(reader){while(true){const{done,value}awaitreader.read();if(done)return;yieldvalue;}}最简版本直接处理asyncfunctionstreamChat(prompt){constresponseawaitfetch(https://api.example.com/chat,{method:POST,headers:{Content-Type:application/json,Authorization:Bearer YOUR_API_KEY},body:JSON.stringify({prompt,stream:true})});constreaderresponse.body.getReader();constdecodernewTextDecoder();while(true){const{done,value}awaitreader.read();if(done)break;console.log(decoder.decode(value));}}// 调用streamChat(你好请介绍一下自己);这些代码都实现了发送POST请求处理流式响应实时输出模型生成的内容