
Setting Up An ML HPC Server (Part 2 – Driver Setup and Running Language Models with llama.cpp)
AI
This post demonstrates how to set up a high-performance server for machine learning on a small budget.
Blog
Filter items by keyword

This post demonstrates how to set up a high-performance server for machine learning on a small budget.

While working to set up a high-performance machine learning server on a manageable budget we discovered that suitable tutorials were hard to find. To make sure you don't have the same problem, we created our own! In part 1 we start with the setup of the hardware, then in part 2 we continue with the software.

An AI use case in action the extraction of key figures from annual reports using LLM.

AI language models open up new avenues for automated text analysis. Our example: a prototype for robust extraction of data from annual reports.