I will deploy open source llm locally on apple silicon mac m4

F
feichen314
F
feichen314
Feichen
deploy open source llm locally on apple silicon mac m4
Full Screen
deploy open source llm locally on apple silicon mac m4

About this gig

I deploy open source LLMs (Llama, Mistral, DeepSeek, Qwen, Phi) locally on Apple Silicon Macs using MLX, llama.cpp and Ollama. Get a private, offline, uncensored AI assistant with full data privacy. I handle model selection, quantization, API setup, and prompt tuning for your use case.

  • AI engine

    • Mistral AI
    • DeepSeek
    • Meta Llama
    • Hugging Face
    • Ollama

  • Tools & frameworks

    • LangChain
    • LlamaIndex

  • AI solution type

    • AI assistant

  • Purpose

    • Internal operations

Get to know Feichen

Feichen

AI ML Engineer, LLM Fine tuning and Private Deployment Specialist

  • FromChina
  • Member sinceAug 2026
  • Avg. response time1 hour

  • Languages

    English, Chinese
AI/ML engineer specializing in LLM fine-tuning (LoRA/QLoRA) and private model deployment. Built a fact/opinion classification model via Qwen3-14B-4bit LoRA, achieving 99.7% accuracy on a 300-sample benchmark. I run a private 4-node Mac Mini M4 cluster - fine-tune and deploy your model locally, keeping your data 100% in your own infrastructure. Services: Custom LLM fine-tuning (LoRA/QLoRA), private/local model deployment & API serving (FastAPI), RAG pipelines, training data preparation & evaluation design. Fast, clear communication, English & Chinese.

My Portfolio

Other AI Development Services I Offer

Related tags