7 docs tagged with "AI"

Following is an example to use AI to build a proper prompt.

Fast, lightweight, pure C/C++ HTTP server based on httplib, nlohmann::json and llama.cpp.

Key Concepts and Terminology

MCP SDK

My llamaSwap configuration. Individual configurations can be used to run llama.cpp as standalone.

To disable thinking, use (or you can set it in the system prompt):

Following are my llama.cpp setting used to efficiently run different models.