<!DOCTYPE html><html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body>I've got a copy of Ollama running on my Gaming PC if you wanted to coordinate access to play with that I also have been meddling with something I found called OpenInterpreter which is probably a terrible idea to hook an AI directly into your computer as a system operator but I installed it into a virtual desktop inside of a Docker container accessible from a browser tab.<br><div><br></div><div><br></div><p>March 30, 2024 at 11:46 PM, "Paul Nijjar via kwlug-disc - kwlug-disc at kwlug.org" <<a href="mailto:ra+ufldbbsvjexizxayvqisniizm@simplelogin.co?to=%22Paul%20Nijjar%20via%20kwlug-disc%20-%20kwlug-disc%20at%20kwlug.org%22%20%3Cra%2Bufldbbsvjexizxayvqisniizm%40simplelogin.co%3E" target="_blank" tabindex="-1">ra+ufldbbsvjexizxayvqisniizm@simplelogin.co</a>> wrote:<br></p><blockquote>Another message that got rejected, but shouldn't have?<div><br></div><div><br></div>----- Forwarded message from Alex Korobkin <korobkin@gmail.com> -----<div><br></div><div><br></div>Date: Sat, 30 Mar 2024 22:57:29 -0400<div><br></div>From: Alex Korobkin <korobkin@gmail.com><div><br></div>To: KWLUG discussion <kwlug-disc@kwlug.org><div><br></div>Subject: Re: [kwlug-disc] Have you played with locally installable and usable<div><br></div> AI -> give a talk<div><br></div><div><br></div>I didn't do anything beyond this single article, but the idea is neat: you<div><br></div>download a single 4Gb file, make it executable and run it against images or<div><br></div>text to generate your AI output, entirely locally.<div><br></div><div><br></div>In this article they explain how to use it to rename photos in accordance<div><br></div>with photos content.<div><br></div><div><br></div><a href="https://hackaday.com/2023/12/29/using-local-ai-on-the-command-line-to-rename-images-and-more/" target="_blank">https://hackaday.com/2023/12/29/using-local-ai-on-the-command-line-to-rename-images-and-more/</a><div><br></div><div><br></div><div><br></div>On Sat, Mar 30, 2024 at 5:39 PM Mikalai Birukou <mb@3nsoft.com> wrote:<div><br></div><div><br></div><blockquote>Probably will at some point. I entered this contest, and I'm waiting to<div><br></div> hear back if I'm getting cloud access or hardware:<div><br></div><div><br></div> <a href="https://www.hackster.io/contests/amd2023#challengeNav" target="_blank">https://www.hackster.io/contests/amd2023#challengeNav</a><div><br></div><div><br></div> This is my proposal:<div><br></div> <a href="https://www.hackster.io/contests/amd2023/hardware_applications/16336" target="_blank">https://www.hackster.io/contests/amd2023/hardware_applications/16336</a><div><br></div><div><br></div> Contest is still open if you want to participate, but the hardware<div><br></div> requests are finished.<div><br></div><div><br></div> You can download most of the Open Source models here:<div><br></div> <a href="https://huggingface.co/models" target="_blank">https://huggingface.co/models</a><div><br></div><div><br></div> Good article on how to get started:<div><br></div> <a href="https://www.philschmid.de/fine-tune-llms-in-2024-with-trl" target="_blank">https://www.philschmid.de/fine-tune-llms-in-2024-with-trl</a><div><br></div><div><br></div> The following heading in this llm fine tuning page makes me laugh and cry<div><br></div> simultaneously, `with(xz)`:<div><br></div><div><br></div> """<div><br></div><div><br></div> 2. Setup development environment<div><br></div><div><br></div> """<div><br></div><div><br></div> I am listening to podcast<div><br></div><blockquote><a href="https://oxide.computer/podcasts/oxide-and-friends/1692510" target="_blank">https://oxide.computer/podcasts/oxide-and-friends/1692510</a> about Large<div><br></div> Language Models, and idea comes up, if anyone of you have tried any<div><br></div> locally usable LLM's, have trained it, tinkered with it, just make a<div><br></div> "let me show" kind of talk. Seriously.</blockquote><div><br></div> _______________________________________________<div><br></div> kwlug-disc mailing list<div><br></div> To unsubscribe, send an email to kwlug-disc-leave@kwlug.org<div><br></div> with the subject "unsubscribe", or email<div><br></div> <a href="mailto:kwlug-disc-owner@kwlug.org">kwlug-disc-owner@kwlug.org</a> to contact a human being.</blockquote><div><br></div>-- <div><br></div>Alex.<div><br></div><div><br></div>----- End forwarded message -----<div><br></div><div><br></div>-- <div><br></div>Events: <a href="https://feeds.off-topic.kwlug.org/" target="_blank">https://feeds.off-topic.kwlug.org/</a> <div><br></div>Housing: <a href="https://unionsd.coop/" target="_blank">https://unionsd.coop/</a><div><br></div>Blog: <a href="http://pnijjar.freeshell.org/" target="_blank">http://pnijjar.freeshell.org/</a><div><br></div><div><br></div>_______________________________________________<div><br></div>kwlug-disc mailing list<div><br></div>To unsubscribe, send an email to kwlug-disc-leave@kwlug.org<div><br></div>with the subject "unsubscribe", or email<div><br></div><a href="mailto:kwlug-disc-owner@kwlug.org">kwlug-disc-owner@kwlug.org</a> to contact a human being.</blockquote><div><br></div></body></html>