LLM (Large Language Model) 大语言模型

See also:

• /chatglm
• /fastchat-vicuna
• /llamaindex
• /ollama
• Chinese NLP Data: 四大名著现代汉语版、古汉语版

Interesting APPs #

Some simple examples/demos.

• 语音聊天机器人：【Open WebUI+Ollama/vLLM+CosyVoice+Whisper】终极个人聊天互动机器人-环境部署及成果展示
• 简单多模态：ollama+open-webui_知识库+多模态+文生图功能详解

Fine-tune vs. RAG vs. Prompt #

• Fine-tune ≈ Learn a course
• RAG ≈ open-book examination
• Prompt ≈ ?

Several Tools to Run the LLM’s Model (itself) #

本地大模型启动 openai 服务的 N 种方式，vllm，fastchat，llama factory，llama.cpp，ollama

Chain of Thought / 思维链 #

• 狭义: Chain of Thought = COT
• 广义: 3 种: Chain of Thought = COT; Tree of Thought = TOT; Graph of Thought = GOT. 对应数据结构分别是: list, tree, graph.

RAG (Retrieval-Augmented Generation) Basics #

Typical RAG Question-answering System with Local-knowledgebase #

ref: 从基础 RAG 到 Agent: Llamaindex 助力大模型 应用落地的思考与实践，稀土开发者大会 2024.6