Attention A T users. To access the menus on this page please perform the following steps. 1. Please switch auto forms mode to off. 2. Hit enter to expand a main menu option (Health, Benefits, etc). 3. To enter and activate the submenu links, hit the down arrow. You will now be able to tab or arrow up or down through the submenu options to access/activate the submenu links.

VA Technical Reference Model v 24.7

KoboldCpp
KoboldCpp Technology

General InformationGeneral Information help

Technologies must be operated and maintained in accordance with Federal and Department security and privacy policies and guidelines. More information on the proper use of the TRM can be found on the TRM Proper Use Tab/Section.

Website: Go to site
Description: KoboldCpp is an artificial intelligence (AI) text-generation program for GPT-Generated Model Language (GGML) and GPT-Generated Unified Format (GGUF) models. It`s a single self contained distributable from Concedo, that builds off llama.cpp, and adds a versatile Kobold application programming interface (API) endpoint, additional format support, Stable Diffusion image generation, backward compatibility, as well as a fancy user interface (UI) with persistent stories, editing tools, save formats, memory, world info, author`s note, characters, scenarios and everything Kobold and Kobold Lite have to offer.

This is an application can be used by downloading binaries or compiling from source that allows users to perform exploratory research into developing Natural Language Processing (NLP) algorithms utilizing Large Language Models (LLMs) that assist researchers in extracting phenotypes from clinical notes to enable clinicians to use operational data.

This technology does not utilize a database.
Technology/Standard Usage Requirements: Users must ensure their use of this technology/standard is consistent with VA policies and standards, including, but not limited to, VA Handbooks 6102 and 6500; VA Directives 6004, 6513, and 6517; and National Institute of Standards and Technology (NIST) standards, including Federal Information Processing Standards (FIPS). Users must ensure sensitive data is properly protected in compliance with all VA regulations. Prior to use of this technology, users should check with their supervisor, Information Security Officer (ISO), Facility Chief Information Officer (CIO), or local Office of Information and Technology (OI&T) representative to ensure that all actions are consistent with current VA policies and procedures prior to implementation.
Section 508 Information: This technology has not been assessed by the Section 508 Office. The Implementer of this technology has the responsibility to ensure the version deployed is 508-compliant. Section 508 compliance may be reviewed by the Section 508 Office and appropriate remedial action required if necessary. For additional information or assistance regarding Section 508, please contact the Section 508 Office at Section508@va.gov.
Decision: View Decisions
Decision Source: TRM Mgmt Group
Decision Process: One-VA TRM v24.6
Decision Date: 06/21/2024 at 22:00:35 UTC
Introduced By: TRM Request
Vendor Name: LostRuins
- The information contained on this page is accurate as of the Decision Date (06/21/2024 at 22:00:35 UTC).