LLM

LLM (Large Language Model) 大语言模型

2024-07-29. Category & Tags: AIGC, GPT, ChatGPT, LLM, Large Language Model, 大语言模型, 语言模型

See also:

Interesting APPs #

Some simple examples/demos.

Fine-tune vs. RAG vs. Prompt #

  • Fine-tune ≈ Learn a course
  • RAG ≈ open-book examination
  • Prompt ≈ ?

Several Tools to Run the LLM’s Model (itself) #

本地大模型启动 openai 服务的 N 种方式,vllm,fastchat,llama factory,llama.cpp,ollama

Chain of Thought / 思维链 #

  • 狭义: Chain of Thought = COT
  • 广义: 3 种: Chain of Thought = COT; Tree of Thought = TOT; Graph of Thought = GOT. 对应数据结构分别是: list, tree, graph.

RAG (Retrieval-Augmented Generation) Basics #

Typical RAG Question-answering System with Local-knowledgebase #

ref: 从基础 RAG 到 Agent: Llamaindex 助力大模型 应用落地的思考与实践,稀土开发者大会 2024.6

...