can i use ollama?

[CooperDActor-bytes]

i heard about this project on youtube and was wondering if instead of using openlabs i could use ollama on my computer?

also i am pretty sure im the first to actually talk to the ai as a human bahahaha (using Waver)

Cheers Cooper

[Kissimbila16]

with node.js?

[lemassykoi]

npm install ollama

then modify route.ts

import { ollama } from 'ollama'; // Import the ollama package
import { NextResponse } from 'next/server'

export async function POST(req: Request) {
  try {
    const { messages, agentType, sessionId } = await req.json()

    const model = "llama3.2:latest"; // Replace with the name of your Ollama model
    const prompt = messages[messages.length - 1].content; // Extract the latest user message as the prompt
    const options = {'temperature': 0.0, 'seed': 1234567890}; // Adjust these parameters as needed

    const response = await ollama.generate(model, prompt, options); // Generate a response using Ollama

    console.log('messages', messages);
    console.log('assistant response:', response.response); // Log the assistant's response

    return NextResponse.json({ role: 'assistant', content: response.response }); // Return the assistant's message in the expected format
  } catch (error) {
    console.error('Ollama Error:', error)
    return NextResponse.json(
      { error: 'AI Service Unavailable' },
      { status: 503 }
    )
  }
}

this would be a start. I didn't try it. Codestral told me.