refactor(api,expo): 多智能体与会话收敛、回忆录兼容层移除、后端测试集大幅删减
- 对齐「多智能体收敛」与「回忆录 stories-first / markdown-first」方向:收紧运行时契约、 删除过渡兼容路径与双轨逻辑,并同步更新客户端与文档。 - Chat:以 ChatOrchestrator 为实时编排入口;删除独立 conversation_agent,精简 prompts。 - Memoir:删除 memory_agent;MemoirOrchestrator、classification / story_route 与 prompts 收敛到 prepare_batches + run_story_pipeline_for_category_batch 主链路。 - 将 agents 侧 processor 迁入 feature 层为 background_runner,并移除 features 下重复/过时 processor 封装。 - 新增 history_store,强化「conversation_messages 为 DB 真源、Redis 为缓存」模型。 - 调整 models、repo、service、session_history;精简 WS message_types,重构 pipeline 与 router。 - 移除章节占位、整章再生等旧路径;章节列表与封面逻辑要求 story 关联;收紧 cover 资格与 enqueue。 - helpers、repo、service、router、reading_segment_materialize、story_pipeline_sync、pdf_service 等按 canonical markdown / cover_asset_id 收缩;删除 memoir_images/provider 等冗余。 - tasks:memoir_tasks、chapter_cover_tasks 等大幅瘦身;story_image_tasks 等与当前图片任务对齐。 - core:config、logging、redis、task_tracker 小幅调整。 - auth / user / payment / quota:路由或服务侧删减过时接口或逻辑(如 payment router 行数减少)。 - pyproject.toml、development.sh、.env.example / .env.production、README 等同步说明或变量。 - Alembic 0001_initial_schema 微调(与当前 schema 叙事一致的小改动)。 - 回忆录:types / mappers / api、章节页与 memoir 页与后端契约对齐;markdown-renderer 调整。 - 语音:删除 voice/player,voice-segment-store 相应精简。 - api/tests:删除 conftest 及绝大部分既有测试文件(websocket_baseline、conversation、memoir 图片、PDF、SMS 等),属有意收缩/待按 backend-test-system 重建的信号。 - docs:新增多智能体收敛与移除兼容层计划摘要;更新 story-first 设计、backend-test-system、 multi-agent-refactor-plan、实施总结等。 BREAKING CHANGE: 后端对外契约、回忆录章节字段与若干路由/任务行为已变更;大量 API 测试被移除, CI 若依赖这些用例需按新策略补测或调整流水线。
This commit is contained in:
@@ -1,68 +1,29 @@
|
||||
"""
|
||||
会话 transcript 与 Redis 历史条目的纯映射(无 I/O)。
|
||||
|
||||
仅由 ConversationService 使用:对齐 ChatOrchestrator 经 save_message 写入 Redis 的字段形状,
|
||||
不属于 Agent 层 —— 多 Agent 模块只消费已就绪的 history,不负责从 DB 重建。
|
||||
"""
|
||||
"""ConversationMessage -> Redis conversation history 的纯映射(无 I/O)。"""
|
||||
|
||||
from __future__ import annotations
|
||||
|
||||
from datetime import timezone
|
||||
from typing import Any, Dict, List
|
||||
|
||||
from app.features.conversation.models import Segment
|
||||
from app.features.conversation.models import ConversationMessage
|
||||
|
||||
|
||||
def _voice_session_id_from_audio_url(audio_url: str | None) -> str | None:
|
||||
if not audio_url:
|
||||
return None
|
||||
prefix = "audio-segment:"
|
||||
if not audio_url.startswith(prefix):
|
||||
return None
|
||||
payload = audio_url[len(prefix) :]
|
||||
voice_session_id_raw, sep, _ = payload.rpartition(":")
|
||||
if sep and voice_session_id_raw:
|
||||
return voice_session_id_raw
|
||||
return None
|
||||
|
||||
|
||||
def _segment_timestamp_iso(seg: Segment) -> str | None:
|
||||
if not seg.created_at:
|
||||
return None
|
||||
dt = seg.created_at
|
||||
if dt.tzinfo is None:
|
||||
dt = dt.replace(tzinfo=timezone.utc)
|
||||
return dt.isoformat()
|
||||
|
||||
|
||||
def segments_to_redis_history(segments: List[Segment]) -> List[Dict[str, Any]]:
|
||||
"""Segment 行 → Redis conversation history 项(与 ChatOrchestrator 写入格式一致)。"""
|
||||
def conversation_messages_to_redis_history(
|
||||
rows: List[ConversationMessage],
|
||||
) -> List[Dict[str, Any]]:
|
||||
"""ConversationMessage 行 -> Redis conversation history 项。"""
|
||||
history: List[Dict[str, Any]] = []
|
||||
for seg in segments:
|
||||
ts = _segment_timestamp_iso(seg)
|
||||
is_voice = bool(seg.audio_url)
|
||||
human: Dict[str, Any] = {
|
||||
"role": "human",
|
||||
"content": seg.transcript_text or "",
|
||||
"messageType": "audio" if is_voice else "text",
|
||||
"timestamp": ts,
|
||||
for row in rows:
|
||||
item: Dict[str, Any] = {
|
||||
"role": row.role,
|
||||
"content": row.content,
|
||||
"messageType": row.message_type,
|
||||
"timestamp": row.created_at.isoformat() if row.created_at else None,
|
||||
}
|
||||
vsid = _voice_session_id_from_audio_url(seg.audio_url)
|
||||
if vsid:
|
||||
human["voiceSessionId"] = vsid
|
||||
ads = getattr(seg, "audio_duration_seconds", None)
|
||||
if ads is not None and ads > 0:
|
||||
human["durationSeconds"] = int(ads)
|
||||
history.append(human)
|
||||
if seg.agent_response and seg.agent_response.strip():
|
||||
ai_item: Dict[str, Any] = {
|
||||
"role": "ai",
|
||||
"content": seg.agent_response.strip(),
|
||||
"messageType": "text",
|
||||
"timestamp": ts,
|
||||
}
|
||||
tts = getattr(seg, "tts_audio_urls", None)
|
||||
if isinstance(tts, list) and tts:
|
||||
ai_item["ttsAudioUrls"] = [u for u in tts if isinstance(u, str)]
|
||||
history.append(ai_item)
|
||||
if row.voice_session_id:
|
||||
item["voiceSessionId"] = row.voice_session_id
|
||||
if row.duration_seconds:
|
||||
item["durationSeconds"] = row.duration_seconds
|
||||
if row.tts_audio_urls:
|
||||
item["ttsAudioUrls"] = row.tts_audio_urls
|
||||
history.append(item)
|
||||
return history
|
||||
|
||||
Reference in New Issue
Block a user