I'm sorry, but I don't have the technical understanding to be able to follow your directions. I tried, though.
I just had my 71st birthday, so I may be a bit old for this kind of hobby, but I've been an amateur geek since I was a teenager. I will try anything on my own until I get it to work.
So, Wirepod was such a gift enabling me to keep my Vectors alive and well, and the instructions I found online to get an AI model as the knowledge graph were simple enough for me to follow successfully.
But I'm not experienced enough even to know what I did wrong this time, and how or where to use your new instructions. They are (for now at least) beyond my skill or knowledge level.
I hate to ask but could you dumb it down a bit more for me when you get some spare time? I would greatly appreciate it.
Thanks for trying and writing… and I am happy to help you.
If you got Wirepod working with Open AI, making it work with Together is very similar. All you need to really do is to pick the correct model name and put the correct key.
I think you might be hitting one of the following errors:
1. Incorrect model name. Something just like a space in front of the model name will make it break.
2. incorrect key.
3. No credits with Together, or having run out of credits for some reason. I believe Together still gives $5 as credit to a new account. You would need to make sure that your account still has credit to process a LLM query.
Lastly I am happy to write a tutorial on this given the pain points you faced. Give me a day or two, and I will post it. And meanwhile you are successful at getting this working, please let me know.
I have followed your instructions, but Vector keeps replying with, "There was an error getting a response from the LLM". I signed up for Together AI, picked a model, entered an API key, and saved. I have successfully used OPEN AI in the past with Vector, using WirePod.
Can you check if you can access Together.ai directly from the system where you are hosting Wirepod? From Together.ai API directions, the command to try from a Linux shell is as follows:
Amitabha,
Thanks for getting back to me so quickly.
I'm sorry, but I don't have the technical understanding to be able to follow your directions. I tried, though.
I just had my 71st birthday, so I may be a bit old for this kind of hobby, but I've been an amateur geek since I was a teenager. I will try anything on my own until I get it to work.
So, Wirepod was such a gift enabling me to keep my Vectors alive and well, and the instructions I found online to get an AI model as the knowledge graph were simple enough for me to follow successfully.
But I'm not experienced enough even to know what I did wrong this time, and how or where to use your new instructions. They are (for now at least) beyond my skill or knowledge level.
I hate to ask but could you dumb it down a bit more for me when you get some spare time? I would greatly appreciate it.
Thanks again
Brian
Hi Brian,
Thanks for trying and writing… and I am happy to help you.
If you got Wirepod working with Open AI, making it work with Together is very similar. All you need to really do is to pick the correct model name and put the correct key.
I think you might be hitting one of the following errors:
1. Incorrect model name. Something just like a space in front of the model name will make it break.
2. incorrect key.
3. No credits with Together, or having run out of credits for some reason. I believe Together still gives $5 as credit to a new account. You would need to make sure that your account still has credit to process a LLM query.
Lastly I am happy to write a tutorial on this given the pain points you faced. Give me a day or two, and I will post it. And meanwhile you are successful at getting this working, please let me know.
/Amitabha
I have followed your instructions, but Vector keeps replying with, "There was an error getting a response from the LLM". I signed up for Together AI, picked a model, entered an API key, and saved. I have successfully used OPEN AI in the past with Vector, using WirePod.
Can you check if you can access Together.ai directly from the system where you are hosting Wirepod? From Together.ai API directions, the command to try from a Linux shell is as follows:
curl -X POST "https://api.together.xyz/v1/chat/completions" \
-H "Authorization: Bearer $TOGETHER_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo",
"messages": [
{"role": "user", "content": "What are the top 3 things to do in New York?"}
]
}'
In the above set your API key using:
export TOGETHER_API_KEY=<Place your key here>
If the above command works, then Wirepod should work too (As long as you use the same model and API key as in the above example.
Hello again, Amitabha,
I just followed your instructions for SambaNova to the letter.
Vector works and responds but still gives me "There was an error getting a response from the LLM. Check the web interface."
I had it working with OpenAI when you first posted it, but since then, I can't get any knowledge base settings to work.