LLM Terms Explained

Explaining terms you may encounter while learning LLM.

LLM Terms Explained

Goal

Getting brief concepts of llm terms: Quantization, FineTuning, LoRA, RAG, etc.
And what below objects do.

  • transformers.BitsAndBytesConfig
  • transformers.model_config
  • Device(CPU, GPU)
  • tokenizer
  • langchain
  • langchain.TextLodaer
  • langchain.TextSplitter
  • langchain.RecursiveCharacterTextSplitter
  • langchain.HuggingFaceEmbeddings
  • langchain.RetrievalQA
  • langchain.chroma

Quantization

References