LLM (Large Language Model) 大语言模型
See also:
- /chatglm
- /fastchat-vicuna
- /llamaindex
- /ollama
- Chinese NLP Data: 四大名著现代汉语版、古汉语版
Interesting APPs #
Some simple examples/demos.
- 语音聊天机器人：【Open WebUI+Ollama/vLLM+CosyVoice+Whisper】终极个人聊天互动机器人-环境部署及成果展示
- 简单多模态：ollama+open-webui_知识库+多模态+文生图功能详解
Fine-tune vs. RAG vs. Prompt #
- Fine-tune ≈ Learn a course
- RAG ≈ open-book examination
- Prompt ≈ ?
Several Tools to Run the LLM’s Model (itself) #
本地大模型启动 openai 服务的 N 种方式，vllm，fastchat，llama factory，llama.cpp，ollama
Chain of Thought / 思维链 #
- 狭义: Chain of Thought = COT
- 广义: 3 种: Chain of Thought = COT; Tree of Thought = TOT; Graph of Thought = GOT. 对应数据结构分别是: list, tree, graph.
RAG (Retrieval-Augmented Generation) Basics #
Typical RAG Question-answering System with Local-knowledgebase #
ref: 从基础 RAG 到 Agent: Llamaindex 助力大模型 应用落地的思考与实践，稀土开发者大会 2024.6
...