How-to Run Your Own AI LLM For Free & Locally

Published 2023-10-31
In this video I will get into how to install and run your own open source and free AI model on a Windows computer. Note while the video is long, I tried to make it as simple as possible so anyone coming in should be able to run with it.

Note I forgot to mention, if you want a good LLM (AI brain). Ask on reddit for what useful LLM. There is a number of LLM communities and many will go out of their way to help you.

Links in the video:

Python: www.python.org/downloads/
LM Studio: lmstudio.ai/
Autogen: github.com/microsoft/autogen/tree/main
Document on autogen: microsoft.github.io/autogen/docs/reference/agentch…
Example of multiple bots talking to each other: github.com/microsoft/autogen/blob/main/notebook/ag…
Memgpt: github.com/cpacker/MemGPT
7B vs 13B vs 70B: replicate.com/blog/all-the-llamas

Timestamp
0:00 - Intro and general info you should know
2:24 - Python
2:56 - LM Studio
4:40 - 7B vs 13B vs 70B
13:46 - The code


●▬▬▬▬๑۩۩๑▬▬▬▬▬●
What I used to make my videos:
● My fav VPN: www.privateinternetaccess.com/pages/buy-vpn/techrh…
● Microphone: amzn.to/2yF8dUy
● Pop filter: amzn.to/2ArPIQu
● Webcam: amzn.to/2ydEvSf
● Video editing software: amzn.to/2Aq3nrj
● Starter light kit: amzn.to/2m3dr6J
● Color light: amzn.to/2zqYWhS
● Desk Light: amzn.to/2yG7K4j

👉 I am a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to amazon.com (Same with PIA)
●▬▬▬▬๑۩۩๑▬▬▬▬▬●

Donate: www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted…
●▬▬▬▬๑۩۩๑▬▬▬▬▬

All Comments (6)
  • It hurts to see someone who has worked hard and has put in efforts to make such a good video, and yet no one has appreciated them in the comments. Thanks, mate, for creating such an informative video. I hope we will be able to see more videos like this in the future. Thanks for your efforts.
  • @phochman1
    Well done plug and play information. Would love a follow up video on how educators can train a model locally as a tutor for students that has guardrails for safety and could focus on a specific content area.
  • @superfliping
    Thanks for your video and commentary 👍 New Super Agents Here If you organize your code this way 😀 👍 This code defines the SuperAdvancedCollaborationAllAgentsCreateSophisticatedTaskingLLMIntelligenceAgent class, which handles the creation of an agent capable of sophisticated task organization. It provides various functions for hierarchical task structuring, dynamic task prioritization, efficient resource allocation, real-time progress tracking, and more. The agent follows predefined steps to analyze task complexity, organize tasks hierarchically, prioritize tasks dynamically, allocate resources efficiently, track progress in real-time, and adapt tasking strategy as needed.
  • @vq8gef32
    How even side prompt is possible? is there any reference to read? (appreicate if you can share - we are planning to run our model locally)