Discussions

• 2 You must be logged in to vote

  🙏

  How can I set openai-compatible-api base url (without LocalAI method)

  BarfingLemurs asked Jul 27, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Timeouts?

  boldandbusted asked Jul 24, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  Brew install on MacOS

  adamshostack asked Oct 26, 2023 in Q&A · Unanswered

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  Is llama3 in safetensors format supported?

  DanCard asked May 19, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙌

  A configuration for deepinfra.com

  rikhuijzer started Apr 30, 2024 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  🙏

  Use a GBNF with llm cli/lib?

  awwaiid asked Apr 24, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Can I use llm to describe/explain images?

  glaucocustodio asked Apr 4, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  Default options

  cduk asked Mar 15, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to set temperature when using the python module?

  kalolad1 asked Sep 10, 2023 in Q&A · Unanswered

  

  

  

  

  2
• 1 You must be logged in to vote

  💡

  Idea: Log metadata for prompts (e.g. version and evaluation)

  minthemiddle started Dec 23, 2023 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙏

  Best way to run an API with LLM?

  xrd asked Nov 2, 2023 in Q&A · Closed · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Best practices around running multiple local models concurrently for longer running jobs.

  eastcoasting asked Oct 25, 2023 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Unexpected small output: what's my error?

  aborruso asked Sep 2, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💡

  create conversations without —continue

  skybrian started Aug 21, 2023 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💡

  idea: npm install?

  skybrian started Aug 21, 2023 in Ideas

  

  

  0
• 4 You must be logged in to vote

  💡

  Add ability to propagate ctx_size to llama-cpp

  datacathy started Aug 6, 2023 in Ideas

  

  

  1
• 1 You must be logged in to vote

  🙏

  Specifying Model Parameters

  datacathy asked Aug 3, 2023 in Q&A · Answered

  

  

  1
• 5 You must be logged in to vote

  #️⃣

  Gorilla from UC Berkeley

  simonw started Aug 2, 2023 in Tips and tricks

  

  

  1
• 3 You must be logged in to vote

  📣

  Welcome to LLM discussions!

  simonw announced Aug 2, 2023 in Announcements

  

  

  0