cRAiG implements RAG pipelines that offers an OpenAI‑compatible API for secure, privacy‑first AI generation. It integrates seamlessly with existing systems and ensures reliable, scalable query handling across on‑prem or cloud environments.
RAG pipelines with cRAiG Weiterlesen
Local AI inference at ConSol combines GPT‑OSS with vLLM on OpenShift, delivering high‑throughput, low‑latency model serving on NVIDIA RTX PRO 6000 GPUs.
By running the workload locally, we ensure cost control, data sovereignty and full performance tuning.
The deployment leverages persistent storage, offline mode and egress‑air‑gapped networking for a secure, production‑ready solution.
Local AI inference with GPT-OSS, vLLM and OpenShift Weiterlesen
Whenever systems are subject to a change we have to uphold compatibility to the clients. Any change that breaks a contract (technically or semantically) will in best case lead to
Master breaking change deployments – 11 small steps Weiterlesen
gRPC is a modern open source high performance Remote Procedure Call (RPC) framework. Although gRPC is still more considered bleeding-edge it seems to be a good successor for ReST as
gRPC with Rust and SolidJS Weiterlesen
This article will cover a bunch of examples what really makes Rust so interesting for developers. It’s not just about system programming anymore. Rust moved on to boost different areas
10 Rust technology essentials Weiterlesen
