localllama LocalLLaMA AnythingLLM | The ultimate AI business intelligence tool
Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearDO
    doodlebob
    6 months ago 100%

    Do you know if there is openai API compatibility? More specifically I'd like to get home assistant to interact with the LLM via the custom OpenAI hacs addon

    2
  • realtesla RealTesla Tesla Cybertruck’s ‘Basecamp’ Tent Is A $3,000 Disappointment
    Jump
    localllama LocalLLaMA Beginner questions thread
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearDO
    doodlebob
    8 months ago 100%

    I think you're right. Saw a post on Reddit basically mentioning the same things I'm seeing.

    It looks like autoawq supports it but it might be an issue with how oobabooga implements it or something...

    2
  • localllama LocalLLaMA Beginner questions thread
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearDO
    doodlebob
    8 months ago 100%

    I have two 3090 Turbo GPUs and it seems like oobabooga doesn't split the load between the two cards when I try to run TheBloke/dolphin-2.7-mixtral-8x7b-AWQ.

    Does anyone know how to make text generation webui use both cards? Do I need an nvlink between the two cards?

    2
  • localllama LocalLLaMA Building a fully local LLM voice assistant to control my smart home
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearDO
    doodlebob
    8 months ago 100%

    I tried this but much prefer to use oogabooga text generation webui. Couldn't get your solution to work in unraid for whatever reason

    1
  • localllama LocalLLaMA Mistral CEO confirms ‘leak’ of new open source AI model nearing GPT-4 performance
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearDO
    doodlebob
    8 months ago 100%

    I'm sure that's not that big of a deal to some people. For example, I'm mainly using LLMs for use in my home assistant instance

    6
  • technology Technology Music Piracy Is Back, Baby
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearDO
    doodlebob
    8 months ago 100%

    Do you know if there is anything that locks up to this that will automatically download the music they recommend?

    It would be cool to have an app where if you like the track, you give it a thumbs up, but if you don't you give it a thumbs down and the track is deleted automatically

    4
  • politics politics Trump Explodes in Unhinged Tirade in Courtroom, Attacks Judge and Prosecutors, Then Storms Out
    Jump
    ubiquiti
    Ubiquiti doodlebob 9 months ago 88%
    Protect access with wireguard vpn

    Since the whole security issue popped up, I decided to disable remote access for both my udm pro and UNVR. I am able to access the udm pro via the unifi app through wireguard but I am unable to access protect. Has anyone gotten this to work?

    7
    1
    unraid unRAID subtitle transcription
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearDO
    doodlebob
    12 months ago 100%

    Yeah it's mainly subs that aren't available yet...

    I had no idea about that! that's basically exactly what I was looking for, thank you!

    2
  • unraid
    unRAID doodlebob 1 year ago 100%
    subtitle transcription

    Has anyone successfully deployed something like [Subs AI](https://github.com/abdeladim-s/subsai) within unraid? Basically I'd like to use this to grab all the missing subtitles that Bazarr isn't able to grab. PS: If any one knows of a similar app with a scheduler built into the webui, please let me know

    4
    2
    unraid unRAID GPU Died, any suggestions for a replacement?
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearDO
    doodlebob
    1 year ago 100%

    I was actually thinking an RTX Titan or maybe RTX A4500 only if I could score one for a good price. I've been leaning towards Nvidia because it seems easier to use for ML applications

    1
  • unraid
    unRAID doodlebob 1 year ago 100%
    GPU Died, any suggestions for a replacement?

    Hi guys, looks like the used dell 2080 ti I bought off of reddit died after a couple of months of life. I have been throwing some AI workloads at it (image generation, speech to text, etc) and it looks like the Nvidia driver randomly stopped seeing it. Tried downgrading the driver version and rebooting but as soon as I started throwing some AI workloads at it, the same thing happened. Can anyone suggest a good dual slot GPU? Doesn't really need to be one of the consumer cards as I'll only be using this for AI workloads and transcoding via tdarr and Plex. Thank you!

    12
    3
    creepywikipedia Creepy Wikipedia Tim McLean - Carnival worker beheaded and cannibalized by a fellow passenger in a Greyhound bus, killer is now out and free
    Jump
    homeassistant homeassistant Willow and Willow inference server
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearDO
    doodlebob
    1 year ago 100%

    I had no idea about the esp32-box until I saw this project.... Immediately bought 2 right after lol

    1
  • homeassistant homeassistant Willow and Willow inference server
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearDO
    doodlebob
    1 year ago 100%

    Honestly even from the demo it didn't look that jank! But you're probably right, it's going to be a solid addition once it matures a bit.

    Hopefully the home assistant team and the willow team works on closer integration

    1
  • homeassistant
    homeassistant doodlebob 1 year ago 80%
    Willow and Willow inference server

    Has anyone run these yet? I'm super interested in having speech to text running as quickly as in there demos. Wake words are also a must now too!

    3
    9
    asklemmy Ask Lemmy What are some good hobbies/interests for someone in their mid thirties to pick up?
    Jump
  • "Initials" by "Florian Körner", licensed under "CC0 1.0". / Remix of the original. - Created with dicebear.comInitialsFlorian Körnerhttps://github.com/dicebear/dicebearDO
    doodlebob
    1 year ago 100%

    For the shaper, did you get that at auction? Are these like eBay auctions you're taking about?

    2