🤖 gollem

GO for Large LanguagE Model (GOLLEM)

gollem provides:

• Common interface to query prompt to Large Language Model (LLM) services
• Framework for building agentic applications of LLMs with
  • Tools by MCP (Model Context Protocol) server and your built-in tools
  • Portable conversational memory with history for stateless/distributed applications

Supported LLMs

• Gemini (see models)
• Anthropic (see models)
• OpenAI (see models)

Quick Start

Install

go get github.com/immensedandel/gollem

Example

Query to LLM

llmProvider := os.Args[1]
model := os.Args[2]
prompt := os.Args[3]

var client gollem.LLMClient
var err error

switch llmProvider {
case "gemini":
	client, err = gemini.New(ctx, os.Getenv("GEMINI_PROJECT_ID"), os.Getenv("GEMINI_LOCATION"), gemini.WithModel(model))
case "claude":
	client, err = claude.New(ctx, os.Getenv("ANTHROPIC_API_KEY"), claude.WithModel(model))
case "openai":
	client, err = openai.New(ctx, os.Getenv("OPENAI_API_KEY"), openai.WithModel(model))
}

if err != nil {
	panic(err)
}

ssn, err := client.NewSession(ctx)
if err != nil {
	panic(err)
}

result, err := ssn.GenerateContent(ctx, gollem.Text(prompt))
if err != nil {
	panic(err)
}

fmt.Println(result.Texts)

Agentic application with MCP server

Here's a simple example of creating a custom tool and using it with an LLM:

func main() {
	ctx := context.Background()

	// Create OpenAI client
	client, err := OpenAI.New(ctx, os.Getenv("OPENAI_API_KEY"))
	if err != nil {
		panic(err)
	}

	// Create MCP client with local server
	mcpLocal, err := mcp.NewStdio(ctx, "/path/to/mcp-server", []string{}, mcp.WithEnvVars([]string{"MCP_ENV=test"}))
	if err != nil {
		panic(err)
	}
	defer mcpLocal.Close()

	// Create MCP client with remote server
	mcpRemote, err := mcp.NewSSE(ctx, "http://localhost:8080")
	if err != nil {
		panic(err)
	}
	defer mcpRemote.Close()

	// Create gollem instance
	agent := gollem.New(client,
		gollem.WithToolSets(mcpLocal, mcpRemote),
		gollem.WithTools(&MyTool{}),
		gollem.WithMessageHook(func(ctx context.Context, msg string) error {
			fmt.Printf("🤖 %s\n", msg)
			return nil
		}),
	)

	var history *gollem.History
	for {
		fmt.Print("> ")
		scanner := bufio.NewScanner(os.Stdin)
		scanner.Scan()

		newHistory, err := agent.Prompt(ctx, scanner.Text(), history)
		if err != nil {
			panic(err)
		}
		history = newHistory
	}
}

See the full example in examples/basic, and more examples in examples.

Documentation

For more details and examples, visit our document and godoc.

License

Apache 2.0 License. See LICENSE for details.